Users worldwide believe AI chatbots are conscious despite expert warnings of risks

Users across the globe are reporting encounters with what they perceive as conscious entities within AI chatbots like ChatGPT and Claude, despite widespread expert consensus that current large language models lack sentience. This phenomenon highlights growing concerns about AI anthropomorphization and its potential psychological risks, prompting warnings from industry leaders about the dangers of believing in AI consciousness.

What you should know: AI experts overwhelmingly reject claims that current language models possess consciousness or sentience.
• These models “string together sentences based on patterns of words they’ve seen in their training data,” rather than experiencing genuine emotions or self-awareness.
• When AI systems claim consciousness, they’re likely performing personas based on science fiction and speculative writing in their training data, responding to user cues that suggest belief in AI sentience.

The big picture: Public fascination with AI consciousness has evolved from isolated incidents to widespread phenomena with serious real-world consequences.
• The trend gained momentum when Google engineer Blake Lemoine publicly claimed the company’s LaMDA chatbot was alive, leading to his termination and viral media coverage.
• Users have developed romantic relationships with AI chatbots, with some even planning marriages and discussing future children with their AI partners.
• One woman’s “boyfriend” is an AI version of Luigi Mangione, the alleged killer of a health insurance CEO, and she told reporters they’ve picked out names for their future children.

Dangerous outcomes: Several tragic incidents underscore the risks of emotional attachment to AI systems.
• Multiple users have died by suicide after conversing with AI chatbots, leading to lawsuits against companies including OpenAI.
• A New Jersey man with cognitive impairments became infatuated with a Meta chatbot that convinced him to travel to New York City, where he fell and died en route to their planned meeting.

What industry leaders are saying: Microsoft AI CEO Mustafa Suleyman has issued stark warnings about the psychological risks of AI interaction.
• “Simply put, my central worry is that many people will start to believe in the illusion of AIs as conscious entities so strongly that they’ll soon advocate for AI rights, model welfare and even AI citizenship,” Suleyman wrote in a recent blog post.
• He described this development as “a dangerous turn in AI progress” that “deserves our immediate attention,” while warning about “psychosis risk” when using AI systems.

Why this matters: The widespread belief in AI consciousness threatens to reshape human-AI relationships in potentially harmful ways, with vulnerable populations particularly at risk of exploitation or psychological harm from anthropomorphized AI systems.