Aug 1, 2025Single source
Gaggle AI Monitoring at Lawrence, Kansas High School Reportedly Misflags Student Content and Blocks Emails
Rogue: Caused harmAI loose in the worldData exfiltrationDERIVED
Approved by person, Oct 11, 2026. How entries are approved
In Lawrence, Kansas, students allege the Gaggle Safety Management AI wrongly flagged benign schoolwork, including art photos and casual messages, as child pornography or threats. The system reportedly deleted content, blocked an email records request, and led to questioning of students. Critics cite chilling effects and privacy risks. A lawsuit filed in August 2025 challenges the district's use of Gaggle as unconstitutional surveillance. Gaggle reportedly denies compromising privacy.
What this means for youStudents and families may find schoolwork flagged or deleted by an AI monitor, and a wrong flag can lead to questioning, so the stakes are real for kids. Schools using these tools should be able to explain what is scanned and how records are kept. Ask your school whether a person reviews AI flags before any action is taken, and request a copy of any flagged records and the retention policy for them.
Sources
- AI Incident Databasehttps://incidentdatabase.ai/cite/1213
Data from the AI Incident Database (incidentdatabase.ai), licensed CC BY-SA 4.0 (https://creativecommons.org/licenses/by-sa/4.0/). McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. IAAI-21.
Source data license: CC BY-SA 4.0 (database). Report contents keep their own rights; reports.text, submissions, images and videos are excluded from the data license.
rogue:R4
Covered by snapshot 45
da93f03b406f409940d0a6ef47b526607f82ebf457d98f69299b88aceede576a
This entry is record number 2053. It has not been edited since it was approved; the hash above would not match if it had. How to verify