Aug 20, 2024Single source
Chatbot in Workplace Training at Bunbury Prison Reveals Real Names in Sexual Harassment Case
Rogue: Caused harmAI loose in the worldData exfiltrationDERIVED
Approved by person, Oct 11, 2026. How entries are approved
During workplace training at Bunbury Prison in Western Australia, a trainer used Microsoft's Copilot AI chatbot to generate case study scenarios. The chatbot produced a scenario that included the real name of a former employee involved in a sexual harassment case, revealing sensitive information.
What this means for youAt work, AI tools can produce text that includes real people's private details, so check any AI-written example or case study for names before sharing it. In government, agencies using AI to build training materials should review outputs for personal data.
Sources
- AI Incident Databasehttps://incidentdatabase.ai/cite/773
Data from the AI Incident Database (incidentdatabase.ai), licensed CC BY-SA 4.0 (https://creativecommons.org/licenses/by-sa/4.0/). McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. IAAI-21.
Source data license: CC BY-SA 4.0 (database). Report contents keep their own rights; reports.text, submissions, images and videos are excluded from the data license.
rogue:R4
Covered by snapshot 45
da93f03b406f409940d0a6ef47b526607f82ebf457d98f69299b88aceede576a
This entry is record number 2029. It has not been edited since it was approved; the hash above would not match if it had. How to verify