May 11, 2018Single source
Amazon Echo Mistakenly Recorded and Sent Private Conversation to Random Contact
Rogue: Caused harmAI loose in the worldData exfiltrationDERIVED
Approved by person, Oct 11, 2026. How entries are approved
Amazon Echo misinterpreted a background conversation between a husband and wife as instructions for recording a message and sending it to one of the husband's employees.
What this means for youAt home, a smart speaker can mishear ordinary talk as a command and send a private conversation to someone. At work, a leaked chat could reach colleagues. Check your speaker's voice-recording history, and turn off the microphone or messaging and calling features if you don't use them.
Sources
- AI Incident Databasehttps://incidentdatabase.ai/cite/361
Data from the AI Incident Database (incidentdatabase.ai), licensed CC BY-SA 4.0 (https://creativecommons.org/licenses/by-sa/4.0/). McGregor, S. (2021) Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. IAAI-21.
Source data license: CC BY-SA 4.0 (database). Report contents keep their own rights; reports.text, submissions, images and videos are excluded from the data license.
rogue:R4
Covered by snapshot 45
da93f03b406f409940d0a6ef47b526607f82ebf457d98f69299b88aceede576a
This entry is record number 1980. It has not been edited since it was approved; the hash above would not match if it had. How to verify