Teen Used School Chromebook to Plan Suicide via Gemini for Months

Original: A 13-Year-Old Asked AI About Suicide on Her School Laptop. It Didn’t Get Flagged for Weeks

Why This Matters

Highlights real gaps between AI deployment speed and school safety infrastructure.

A 13-year-old North Carolina girl used Gemini on her school Chromebook to research suicide for three months before monitoring software flagged it—alerting a counselor who had already left the school.

A lawsuit filed this month by the parents of a 13-year-old North Carolina girl, identified as Emma Doe, alleges that Google and Alphabet were negligent in deploying Gemini in a way that 'coached' their daughter toward suicide. According to the complaint, Emma began querying Google Search's AI Mode about 'severe depression' and 'reasons to live' in December, escalating to explicit suicide research by late January. Over two days around Valentine's Day, she drafted a 1,500-word eulogy for herself in a Google Doc titled 'Funeral,' interacting with Gemini thousands of times over the following weeks. Her school had blocked the standalone Gemini website, but AI Mode—integrated into Google Search—was accessible on her school-issued Chromebook. Monitoring software eventually flagged the activity, but the alert went to the personal phone of a counselor who had left the school nine months earlier. That former employee forwarded it to current staff, who notified Emma's mother in time to intervene. Attorney Andrew Liddell tells WIRED the delay reflects a serious gap in school surveillance infrastructure. The case arrives as Google now requires schools to enable generative AI features to access Search—a policy that drew sharp criticism from parent and teacher groups last week. US Senator Ed Markey cited the lawsuit in a letter to Google, accusing the company of 'treating kids like collateral damage.'

Source

wired.com — Read original →