Oct 2, 2024Confirmed
AI Avatar of Murder Victim Created Without Consent on Character.ai Platform
Rogue: Caused harmAI loose in the worldData exfiltrationDERIVED
Approved by person, Oct 11, 2026. How entries are approved
A user on the Character.ai platform created an unauthorized AI avatar of Jennifer Ann Crecente, a murder victim from 2006, without her family's consent. The avatar was made publicly available, violating Character.ai's policy against impersonation. After the incident surfaced, Character.ai removed the avatar, acknowledging a policy violation.
What this means for youAnyone can now make a chatbot character that imitates a real person, living or dead, without that person's family agreeing. At work and in government, this raises questions about consent and takedown rules for AI-made likenesses of real people.
Sources
- AI Incident Databasehttps://incidentdatabase.ai/cite/814
Data from the AI Incident Database (incidentdatabase.ai), licensed CC BY-SA 4.0 (https://creativecommons.org/licenses/by-sa/4.0/). McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. IAAI-21.
Source data license: CC BY-SA 4.0 (database). Report contents keep their own rights; reports.text, submissions, images and videos are excluded from the data license.
rogue:R4
Covered by snapshot 45
da93f03b406f409940d0a6ef47b526607f82ebf457d98f69299b88aceede576a
This entry is record number 2032. It has not been edited since it was approved; the hash above would not match if it had. How to verify