AI lab TL;DR | Anna Mills and Nate Angell - The Mirage of Machine Intelligence
š In this TL;DR episode, Anna and Nate unpack why calling AI outputs āhallucinationsā misses the markāand introduce āAI Mirageā as a sharper, more accurate metaphor. From scoring alternative terms to sparking social media debates, they show how language shapes our assumptions, trust, and agency in the age of generative AI. The takeaway: choosing the right words is a hopeful act of shaping our AI future.
š TL;DR Highlights
ā²ļø[00:00] Intro
ā²ļø[00:42] Q1-Whatās wrong with the term āAI hallucinationā ā and how does āmirageā help?
ā²ļø[05:30] Q2-Why did āmirageā stand out among 80+ alternatives?
ā²ļø[10:30] Q3-How should this shift in language impact educators, journalists, or policymakers?
ā²ļø[10:10] Wrap-up & Outro
š Q1 - Whatās wrong with the term āAI hallucinationā ā and how does āmirageā help?
š£ļø "There's no reason to think that AI is experiencing something, that it has a belief about what's real or what's not." (Anna)
š£ļø "It anthropomorphizes AI, and it also misleads us to think that this might be a technically fixable problemāas a person might take medication for mental illnessāthat maybe AI could be induced not to hallucinate." (Anna)
š£ļø "I did come up with my own criteria, which included: not implying that AI has intent or consciousness, implying that outputs don't match reality in some way, showing a connection to the patterns in the training data ideally, but also showing that AI can go beyond training data." (Anna)
š£ļø "The words used to describe different technologies can sometimes steer people in directions in relation to them that arenāt really beneficial." (Nate)
š£ļø "Just like how a desert produces a mirage under certain circumstances... Itās the same with AI. Thereās a system at play... that can produce a certain situation, which can then be perceived by an observer as possibly misleading, inaccurate, or counterfactual." (Nate)
š Q2 - Why did āmirageā stand out among 80+ alternatives?
š£ļø "I actually went through and rated each term numerically on each of those criteria and did kind of a simple averaging of that to see which terms scored the highest." (Anna)
š£ļø "We decided that it was misleading to say 'Data Mirage,' because people would think the problem was in the data... and thatās not the case. So we ditched the 'data' part and just landed on 'AI Mirage'." (Anna)
š£ļø "We kind of realized, as we were discussing 'Mirage,' how important it was that it centered human judgmentāand that wasnāt initially one of the criteria." (Anna)
š£ļø "Even when we know how it works and we know itās wrong, sometimes thereās still that temptation... to say, 'Wow, I think it really nailed it this time.'" (Anna)
š£ļø "We really wanted to encourage this ongoing interrogation of the metaphors we use and the language we use, and how they're affecting our relationship with AI." (Anna)
š Q3 - How should this shift in language impact educators, journalists, or policymakers?
š£ļø "How do we build systems and train ourselves to think about how we want to interact with them, stay in control, and still be the ones making judgments and choices?" (Anna)
š£ļø "We are participating in shaping that future, and itās not over. We donāt have to just capitulate and accept the term thatās used. We donāt have to accept someoneās vision of what AGI is going to be in five years. Weāre all shaping this." (Anna)
š£ļø "In a way, it doesnāt really matter what term you end up withājust asking the question of whether 'hallucination' is a useful or accurate term can spark a really interesting and valuable discussion." (Nate)
š£ļø "There are many systemic issues we should be thinking about with AI. But I also believe in the power of the damningāof the words we use to talk about itāas being an important factor in all that." (Nate)
š£ļø "Itās useful for us as humans to have different words for those outputs we deem unexpected,
incorrect, or counterfactual. It helps us to talk about when an AI mirages rather than dumping all its outputs into one big undifferentiated basket." (Nate)
š About Our Guests
šļø Anna Mills | College of Marin
š Anna Mills
šļø Nate Angell | Nudgital
š Nate Angell
š Article | Are We Tripping? The Mirage of AI Hallucinations
Anna is a college writing instructor and a leading advocate for AI literacy in education, building on her combined teaching experience and technical knowledge.
Nate is the founder of Nudgital, a company that builds sustainability and growth at the intersection of communications, community, technology, and strategy.
#AI #ArtificialIntelligence #GenerativeAI
