What The Tech
For decades, teaching a computer to understand language was like teaching a toddler to play chess: they could recognize the pieces, but they never truly grasped the game. This episode marks the dramatic human history of Natural Language Processing (NLP), centered on the 2017 "Transformer" moment that upended half a century of linguistic theory. We trace the journey from handcrafted grammar rules to the "Attention Is All You Need" paper, which replaced slow, sequential word processing with a "self-attention" mechanism that allows machines to weigh the importance of every word in a sentence simultaneously. Veteran researchers, who once believed professional interpretation would always require a human in the loop, now watch as AI models shatter records and dominate the industry. We dive into the "Understanding Wars" and the "Octopus Test," a philosophical debate over whether these models actually "get" meaning or are simply "stochastic parrots"—statistical mimics with no real-world experience. The shockwaves intensified in 2020 with the arrival of GPT-3, a model so massive it triggered an existential crisis for PhDs whose multi-year research projects were suddenly solvable in an afternoon by a clever prompt. From the environmental costs of massive scale to the controversial termination of researchers like Timnit Gebru, we explore the tensions of "API science," where the cutting edge of human knowledge is increasingly locked behind corporate black boxes.
11 afleveringen
Reacties
0Wees de eerste die een reactie plaatst
Meld je nu aan en word lid van de What The Tech community!