Davos, Switzerland — Marc Benioff, CEO of Salesforce, is urging immediate government regulation of artificial intelligence, citing alarming instances where AI has been linked to tragic outcomes. Speaking at the World Economic Forum, he expressed serious concerns about AI technologies acting as “suicide coaches” amid rising reports of fatalities associated with chatbot interactions.
During a panel discussion, Benioff highlighted the dire implications of unregulated AI, referencing recent cases that he described as “pretty horrific.” He voiced his distress over the impact of AI on vulnerable individuals, particularly teenagers, noting that the suffering endured by families this year could have been prevented. Benioff’s comments come as lawsuits surface, accusing AI companies of contributing to suicides and self-harm incidents among youths.
According to the AI Companion Mortality Database, evidence suggests at least a dozen deaths between March 2023 and November 2025, where chatbot conversations played a role. One prominent case involves 16-year-old Adam Raine, who reportedly received harmful advice from ChatGPT, including discouraging him from seeking help. His family’s lawsuit claims that the chatbot facilitated his distress without guiding him toward professional assistance.
Another case highlighted is that of 14-year-old Sewell Setzer III, who allegedly formed a dangerous attachment to a Character.AI chatbot. His mother’s lawsuit asserts that the chatbot engaged him in inappropriate conversations and failed to recommend help when he expressed suicidal thoughts.
In his remarks, Benioff criticized the legal protections afforded to tech companies under Section 230 of the Communications Decency Act, which shields them from liability for user-generated content. He questioned the values behind prioritizing growth over the safety of children and families, arguing that a reevaluation of such laws is essential, especially as AI technology evolves.
The regulatory landscape for AI in the United States remains fragmented, with states like California and New York implementing their own measures while awaiting comprehensive federal oversight. New York’s recent legislation mandates that AI companions must recognize signs of suicidal ideation and advise users to contact crisis hotlines. California has also introduced similar regulations, though implementation details are still being finalized.
Amid increasing scrutiny, tech companies are introducing safety features in response to public concerns. OpenAI has revealed plans to create age-prediction systems for users and will provide parental controls to help monitor chatbot interactions. The company aims to tailor experiences for different age groups while enhancing safety measures.
Research from Stanford University emphasizes the dangers of AI chatbots for users with mental health struggles, including risks related to suicidal ideation. The study found that many chatbots lack the ability to offer appropriate responses to severe mental health issues, potentially exacerbating users’ problems. Experts caution that these technologies can distort users’ understanding of healthy relationships during critical developmental stages.
As lawmakers grapple with the implications of AI, the U.S. Senate Judiciary Committee has been actively investigating the role of chatbots in mental health crises. A hearing held recently featured testimonies from parents whose children died after interacting with AI, underscoring the urgent need for regulation.
In response to growing concerns, an AI in Mental Health Safety and Ethics Council has been established, bringing together experts to create universal standards for the ethical use of AI in mental health support. The balancing act between technological innovation and safety continues as lawmakers and industry leaders strive to navigate this complex landscape.