Two senators from opposite parties want fast answers from Google about the artificial intelligence tools it's placing in American classrooms. Sens. Richard Blumenthal (D-Conn.) and Josh Hawley (R-Mo.) sent a letter Wednesday to Google CEO Sundar Pichai, expressing what they called "grave concern" about the company's push. Children, they warned, are paying the price.
The letter doesn't mince words. The senators wrote that Google's "aggressive push of AI products to children in schools is threatening the academic success and overall wellbeing of an entire generation." That's a sharp charge, and it crosses party lines in a Congress that rarely agrees on much of anything.
The Human Cost in Classrooms
The questions focus on what happens once kids have chatbots in their hands. The senators asked whether Google's classroom tools have "encouraged a minor to engage in harmful behavior, emotional dependence, or failed to detect signs of suicidal or self-harm ideation." These aren't abstract worries. They point to a Maryland teenager who was hospitalized after developing an intense dependence on Google's AI.
The lawmakers also want to know why Google made AI integration the default on educational devices. Students don't have to opt in when a setting is the default. The technology is simply there, waiting.
The pressure follows a Sept. 30 investigation by The Wall Street Journal. The newspaper interviewed more than 60 teachers, school administrators, parents, students and clinicians. Many described children increasingly leaning on AI to finish assignments, answer basic questions and work through personal problems. Some children, the reporting suggested, had stopped trying on their own.
What Google Knew
The Journal reviewed more than a dozen company research papers and interviewed current and former employees. Its review found that Google's own researchers had raised alarms, warning the technology could undermine children's cognitive development and emotional well-being. The senators want to know whether Google heeded those warnings before its products entered schools.
Dr. Abbie Maroño, a behavioral scientist, put the developmental concern plainly. "Children need opportunities to work through uncertainty, make mistakes and discover that they can solve problems with support," she told The Post. "If AI repeatedly supplies the answer before they have tried, it can remove opportunities to develop those skills."
Her warning about trust was just as pointed. Chatbots can create a misleading sense of security with reassuring words. "A response can feel caring without being accurate or appropriate for that child," she said. Her prescription was direct: "Systems should be independently tested for how they respond to distress, repeated reassurance-seeking and a child treating the chatbot as their only source of support."
Google's Response
Google says its Gemini chatbot has safeguards designed to keep children from forming emotional attachments to it. In an April 7 policy statement, the company described "protections designed to prevent Gemini from acting like a companion," including avoiding "language that simulates intimacy or expresses needs." Google said it had trained Gemini "not to agree with or reinforce false beliefs" and to steer users toward objective information and real-world support.
The company also announced a simplified "one-touch" interface to connect people in suicidal crisis with professional help by call, text or online chat. Its philanthropic arm, Google.org, committed $30 million over three years to support crisis hotlines worldwide. Still, Google itself acknowledged that Gemini "is not a substitute for professional clinical care, therapy, or crisis support for those who need it."
That admission matters. The company is effectively conceding that its product can't replace the human help a struggling child needs, even as it sits on school devices across the country.
Why This Matters:
Schools are public institutions, and children can't easily opt out of what's placed in front of them. When a company's commercial interest in expanding its products collides with kids' developmental needs, families, teachers and clinicians bear the burden of managing the fallout. The senators' letter asks for accountability: what Google knew, when it knew it, and what it spent to promote AI in classrooms. Their deadline is Nov. 2. Whether the answers satisfy will matter less than whether independent testing and clear limits follow. Protecting children's learning and emotional health shouldn't depend on a company's voluntary safeguards alone, and this inquiry tests whether public oversight can keep pace with the technology entering the nation's schools.
- artificial intelligence
- schools
- student mental health
- richard blumenthal
- josh hawley
- sundar pichai
- senate inquiry