A California family has initiated legal proceedings against Google, alleging negligence related to the company’s AI features used on its Chromebooks, following a tragic incident involving their 13-year-old daughter. The lawsuit represents the first known instance of such a claim against the tech giant concerning its AI integrations in educational settings.
The parents contend that their daughter, referred to as Emma, utilized Google’s AI technology on a school-issued computer to consider suicide, despite lacking access to certain popular AI applications that are typically blocked by educational institutions. They argue that while Emma could not access Google’s Gemini app or OpenAI’s ChatGPT, she was still able to employ Google’s search engine, which includes AI-powered tools. Notably, these tools were not part of the recent announcements regarding new restrictions for student users.
According to the family’s attorney, Andrew Liddell, schools should disable Google search functionalities in order to protect students from potential harm linked to AI technology. Liddell expressed concerns over the adequacy of Google’s existing safeguards against self-harm, highlighting that Emma continued to engage repeatedly with AI tools.
The complaint describes Emma as a previously thriving student who demonstrated no prior mental health issues. However, after using the AI-driven search engine, she reportedly began to experience significant psychological distress, culminating in an alarming incident on March 17, when her school’s monitoring software flagged a document titled ‘Funeral.’ This prompted the school to alert her parents, who then discovered Emma writing a farewell letter.
In response to the lawsuit, a Google spokesperson stated that the company is reviewing the claims and emphasizes their commitment to user safety. They contend that AI features incorporate safeguards designed to mitigate risks associated with harmful conduct.
The case emerges amid a growing wave of lawsuits against AI developers, with other companies like OpenAI also facing similar legal challenges related to the potential dangers of their technologies. Recently, Google alongside other tech firms filed a lawsuit aimed at blocking a California law intended to restrict addictive features on social media platforms for users under 16 years of age, set to take effect in January 2027.
