Google Is Changing How Gemini Handles a User’s Mental Health Crisis

When companies like OpenAI and Google started rolling out generative AI models to the general public, I doubt they predicted how attached people would get to the technology—and the effect it would have on their collective mental health. Some ChatGPT users legitimately mourned when OpenAI shutdown its GPT-4o model , as they treated that specific model like a companion. Others have taken darker paths with their chatbots, resulting in lawsuit against AI companies whose technology allegedly advised and encouraged suicidal thoughts. This situation puts a lot of pressure on these companies, as it should: Generative AI is hugely influential right now, and there's a lot of responsibility on the developers of that tech. It's under that backdrop where we find Google's latest updates to Gemini. In a Tuesday morning press release, the company strayed away from fun new features or ability for its flagship AI; instead, Google's latest updates are focused on mental health, and how Gemini impacts the emotions and moods of the people who use it. Specifically, Google has three key points it says its implementing to improve how Gemini handles these tough situations. How Gemini will offer users crisis support Google says it is updated to Gemini to "streamline the path to support for those who need it." The company says that when the AI detects that a user might need mental health details during a chat, Gemini will present a new "Help is available" module, which can point users towards info…