Earlier than Emily Bender and I’ve checked out a menu, she has dismissed artificial intelligence chatbots as “plagiarism machines” and “artificial textual content extruders”. Quickly after the meals arrives, the professor of linguistics provides that the vaunted giant language fashions (LLMs) that underpin them are “born shitty”.
Since OpenAI launched its wildly common ChatGPT chatbot in late 2022, AI corporations have sucked in tens of billions of {dollars} in funding by promising scientific breakthroughs, materials abundance and a brand new chapter in human civilisation. AI is already able to doing entry-level jobs and can quickly “uncover new data”, OpenAI chief Sam Altman informed a convention this month.
In accordance with Bender, we’re being offered a lie: AI is not going to fulfil these guarantees, and nor will it kill us all, as others have warned. AI is, regardless of the hype, fairly unhealthy at most duties and even the most effective techniques obtainable right now lack something that may very well be referred to as intelligence, she argues. Current claims that fashions are growing a capability to grasp the world past the information they’re educated on are nonsensical. We’re “imagining a thoughts behind the textual content”, she says, however “the understanding is all on our finish”.
Bender, 51, is an professional in how computer systems mannequin human language. She spent her early educational profession in Stanford and Berkeley, two Bay Space establishments which are the wellsprings of the fashionable AI revolution, and labored at YY Applied sciences, a pure language processing firm. She witnessed the bursting of the dotcom bubble in 2000 first-hand.
Her mission now could be to deflate AI, which she’s going to solely check with in air quotes and says ought to actually simply be referred to as automation. “If we wish to get previous this bubble, I feel we’d like extra individuals not falling for it, not believing it, and we’d like these individuals to be in positions of energy,” she says.
In a latest guide referred to as The AI Con, she and her co-author, the sociologist Alex Hanna, take a sledgehammer to AI hype and lift the alarm concerning the know-how’s extra insidious results. She is evident on her motivation. “I feel what it comes all the way down to is: no person ought to have the ability to impose their view on the world,” she says. Because of the massive sums invested, a tiny cabal of males has the power to form what occurs to giant swaths of society and, she provides, “it actually will get my goat”.
Her thesis is that the whizzy chatbots and image-generation instruments created by OpenAI and rivals Anthropic, Elon Musk’s xAI, Google and Meta are little greater than “stochastic parrots”, a time period that she coined in a 2021 paper. A stochastic parrot, she wrote, is a system “for haphazardly stitching collectively sequences of linguistic types it has noticed in its huge coaching information, in response to probabilistic details about how they mix, however with none reference to which means”.
The paper shot her to prominence and triggered a backlash in AI circles. Two of her co-authors, senior members of the moral AI group at Google, misplaced their jobs on the firm shortly after publication. Bender has additionally confronted criticism from different lecturers for what they regard as a heretical stance. “It appears like persons are mad that I’m undermining what they see because the type of crowning achievement of our area,” she says.
The controversy highlighted tensions between these seeking to commercialise AI quick and opponents warning of its harms and urging extra accountable improvement. Within the 4 years since, the previous group has been ascendant.
We’re assembly in a low-key sushi restaurant in Fremont, Seattle, not removed from the College of Washington the place Bender teaches. We’re virtually the one patrons on a sun-drenched Monday afternoon in Might, and the waiter has bored with asking us what we’d like after half-hour and three makes an attempt. As a substitute we flip to the iPad on the desk, which guarantees to streamline the method.
It achieves the other. “I’m going to get a kind of,” says Bender: “add to cart. Precise meals might differ from picture. Good, as a result of the picture is gray. That is nice. Yeah. Present me the . . . the place’s the otoro? There we go. Ah, it may very well be they don’t have it.” We quit. The waiter returns and confirms they do the truth is have the otoro, a fatty reduce of tuna stomach. Realising I’m British, he lingers to ask which soccer group I assist, gives his commiserations to me on Arsenal ending as runners-up this season and tells me he’s a Tottenham fan. I’m wondering if it’s too late to revert to the iPad.
Menu
Kamakura Japanese Delicacies and Sushi
3520 Fremont Ave N, Seattle, 98103
Otoro nigiri x2 $31.90
Salmon nigiri x2 $8
Agedashi x2 $8
Avocado maki $5.95
Edamame $3.50
Barley tea x2 $5
Complete (together with tax and tip) $82.56
Bender was not all the time destined to take the combat to the world’s greatest corporations. A decade in the past, “I used to be minding my very own enterprise doing grammar engineering,” she says. However after a wave of social actions, together with Black Lives Matter, swept via campus, “I began asking, properly, the place do I sit? What energy do I’ve and the way can I take advantage of it?” She arrange a category on ethics in language know-how and some years later discovered herself “having simply endless arguments on Twitter about why language fashions don’t ‘perceive’, with pc scientists who didn’t have the primary bit of coaching in linguistics”.
Finally, Altman himself got here to spar. After Bender’s paper got here out, he tweeted “i’m a stochastic parrot, and so r u”. Sarcastically, given Bender’s critique of AI as a regurgitation machine, her phrase is now typically attributed to him.
She sees her position as “with the ability to converse reality to energy based mostly on my educational experience”. The reality from her perspective is that the machines are inherently way more restricted than we’ve got been led to imagine.
Her critique of the know-how is layered on a extra human concern: that chatbots being lauded as a brand new paradigm in intelligence threaten to speed up social isolation, environmental degradation and job loss. Coaching cutting-edge fashions prices billions of {dollars} and requires monumental quantities of energy and water, in addition to employees within the growing world keen to label distressing photographs or categorise textual content for a pittance. The final word impact of all this work and vitality will probably be to create chatbots that displace these whose artwork, literature and data are AI’s uncooked information right now.
“We’re not attempting to vary Sam Altman’s thoughts. We are attempting to be a part of the discourse that’s altering different individuals’s minds about Sam Altman and his know-how,” she says.
The desk is now stuffed with dishes. The otoro nigiri is mushy, tender and each bit nearly as good as Bender promised. We’ve each ordered agedashi tofu, completely deep-fried so it stays agency in its pool of dashi and soy sauce. Salmon nigiri, avocado maki and tea additionally dot the area between us.
Bender and Hanna had been writing The AI Con in late 2024, which they describe within the guide as the height of the AI increase. However since then the race to dominate the know-how has solely intensified. Main corporations together with OpenAI, Anthropic and Chinese language rival DeepSeek have launched what Google’s AI group describe as “pondering fashions, able to reasoning via their ideas earlier than responding”.
The power to motive would signify a big milestone on the journey in direction of AI that would outperform specialists throughout the complete vary of human intelligence, a purpose sometimes called synthetic basic intelligence, or AGI. Quite a lot of essentially the most distinguished individuals within the area — together with Altman, OpenAI’s former chief scientist and co-founder Ilya Sutskever and Elon Musk have claimed that purpose is at hand.
Anthropic chief Dario Amodei describes AGI as “an imprecise time period which has gathered a number of sci-fi baggage and hype”. However by subsequent 12 months, he argues, we might have instruments which are “smarter than a Nobel Prize winner throughout most related fields”, “can management present bodily instruments” and “show unsolved mathematical theorems”. In different phrases, with extra information, computing energy and analysis breakthroughs, right now’s AI fashions or one thing that carefully resembles them might lengthen the boundaries of human understanding and cognitive capacity.
Bender dismisses the concept, describing the know-how as “a flowery wrapper round some spreadsheets”. LLMs ingest reams of knowledge and base their responses on the statistical likelihood of sure phrases occurring alongside others. Computing enhancements, an abundance of on-line information and analysis breakthroughs have made that course of far faster, extra subtle and extra related. However there isn’t any magic and no emergent thoughts, says Bender.
“If you happen to’re going to study the patterns of which phrases go collectively for a given language, if it’s not within the coaching information, it’s not going to be within the output system. That’s simply elementary,” she says.
In 2020, Bender wrote a paper evaluating LLMs to a hyper-intelligent octopus eavesdropping on human dialog: it would choose up the statistical patterns however would have little hope of understanding which means or intent, or of with the ability to check with something exterior of what it had heard. She arrives at our lunch right now sporting a pair of picket octopus earrings.
There are different sceptics within the area, similar to AI researcher Gary Marcus, who argue the transformational potential of right now’s finest fashions has been massively oversold and that AGI stays a pipe dream. Per week after Bender and I meet, a gaggle of researchers at Apple publish a paper echoing a few of Bender’s critiques. The perfect “reasoning” fashions right now “face a whole accuracy collapse past sure complexities”, the authors write — though researchers had been fast to criticise the paper’s methodology and conclusions.
Sceptics are typically drowned out by boosters with greater profiles and deeper pockets. OpenAI is raising $40bn from investors led by SoftBank, the Japanese know-how investor, whereas rivals xAI and Anthropic have additionally secured billions of {dollars} within the final 12 months. OpenAI, Anthropic and xAI are collectively valued at near $500bn right now. Earlier than ChatGPT was launched, OpenAI and Anthropic had been valued at a fraction of that and xAI didn’t exist.
“It’s to their profit to have everybody imagine that it’s a pondering entity that could be very, very highly effective as a substitute of one thing that’s, you recognize, a glorified Magic 8 Ball,” says Bender.
We’ve been speaking for an hour and a half, the bowl of edamame beans between us steadily dwindling, and our cups of barley tea have been refilled greater than as soon as. As Bender returns to her predominant theme, I discover she has quietly constructed an origami chicken from her chopstick wrapper. AI’s boosters is perhaps hawking false guarantees, however their actions have actual penalties, she says. “The extra we construct techniques round this know-how, the extra we push employees out of sustainable careers and likewise reduce off the entry-level positions . . . After which there’s all of the environmental affect,” she says.
Bender is entertaining firm, a Cassandra with a wry grin and twinkling eye. At occasions it feels she is taking part in as much as the position of nemesis to the tech bosses who stay down the Pacific coast in and round San Francisco.
However the place Bender’s bêtes noires in Silicon Valley would possibly gush over the potential of the know-how, she will appear blinkered in one other method. Once I ask her if she sees one optimistic use for AI, all she’s going to concede is that it would assist her discover a track.
I ask how she squares her twin claims that chatbots are bullshit mills and able to devouring giant parts of the labour market. Bender says they are often concurrently “ineffective and detrimental”, and offers the instance of a chatbot that would spin up plausible-looking information articles with none precise reporting — nice for the host of a web site making a living from click-based promoting, much less so for journalists and the truth-seeking public.
She argues forcefully that chatbots are born flawed as a result of they’re educated on information units riddled with bias. Even one thing as slim as an organization’s insurance policies would possibly include prejudices and errors, she says.
Aren’t these actually critiques of society quite than know-how? Bender counters that know-how constructed on prime of the mess of society doesn’t simply replicate its errors however reinforces them, as a result of customers suppose “that is so huge it’s all-encompassing and it will probably see every little thing and so subsequently it has this view from nowhere. I feel it’s all the time vital to recognise that there isn’t any view from nowhere.”
Bender dedicates The AI Con to her two sons, who’re composers, and she or he is very animated describing the deleterious affect of AI on the artistic industries.
She is scathing, too, about AI’s potential to empathise or provide companionship. When a chatbot tells you that you’re heard or that it understands, that is nothing however placebo. “When Mark Zuckerberg means that there’s a requirement for friendships past what we even have and he’s going to fill that demand together with his AI pals, actually that’s mainly tech corporations saying, ‘We’re going to isolate you from one another and make it possible for your entire connections are mediated via tech’.”
But employers are deploying the know-how, and discovering worth in it. AI has accelerated the speed at which software program engineers can write code, and greater than 500mn individuals frequently use ChatGPT.
AI can also be a cornerstone of nationwide coverage underneath US President Donald Trump, with superiority within the know-how seen as being important to successful a brand new chilly warfare with China. That has added urgency to the race and drowned out requires extra stringent laws. We talk about the parallels between the hype of right now’s AI second and the origins of the sphere within the Fifties, when mathematician John McCarthy and pc scientist Marvin Minsky organised a workshop at Dartmouth Faculty to debate “pondering machines”. Within the background throughout that period was an existential competitors with the Soviet Union. This time the Crimson Scare stems from concern that China will develop AGI earlier than the US, and use its mastery of the know-how to undermine its rival.
That is specious, says Bender, and beating China to some stage of superintelligence is a pointless purpose, given the nation’s capacity to catch up rapidly, which was demonstrated by the launch of a ChatGPT rival by DeepSeek earlier this 12 months. “If OpenAI builds AGI right now, they’re constructing it for China in three months.”
Nonetheless, competitors between the 2 powers has created enormous business alternatives for US start-ups. On Trump’s first full day of his second time period, he invited Altman to the White Home to unveil Stargate, a $500bn information centre mission designed to cement the US’s AI primacy. The mission has since expanded overseas, in what these concerned describe as “business diplomacy” designed to bolster America’s sphere of affect utilizing the know-how.
If Bender is true that AI is simply automation in a shiny wrapper, this unprecedented outlay of economic and political capital will obtain little greater than the erosion of already fragile professions, social establishments and the setting.
So why, I ask, are so many individuals satisfied it is a extra consequential know-how than the web? Some have a business incentive to imagine, others are extra sincere however no much less deluded, she says. “The emperor has no garments. However it’s shocking how many individuals wish to be the bare emperor.”
George Hammond is the FT’s enterprise capital correspondent
Discover out about our newest tales first — observe FT Weekend on Instagram, Bluesky and X, and sign up to obtain the FT Weekend publication each Saturday morning
