I used my one free online article to read Ted Chiang’s February 9, 2023 article in The New Yorker, “ChatGPT Is a Blurry Jpeg of the Web.” It’s well worth the price of an issue (if they include it in one), one of those mind-expanding explanations of technology that ignites the imagination and shifts how one looks at a problem.
Ted Chiang, my favorite science fiction author, is a master of the pithy analogy. He describes the current crop of large learning models—GPT-3 (ChatGPT), DALL*E, etc. —in terms of data compression and decompression. These may well be the same terms in which AI practitioners understand these problems, but Chiang articulates the connection so well, it’s hard not to see learning, both machine and human, in these terms. It feels revelatory.
If you’re already versed in compression algorithms, do read Ted Chiang’s article. It’s wonderful. But for my friends and family who aren’t in technology, with whom I’ve been discussing these text-and-art generating systems, I have a simplified walkthrough—my own stab at pithy analogies.Continue reading