Jun 14, 2024Single source
GitHub Copilot Chat vulnerable to data exfiltration via prompt injection in untrusted source code
AI loose in the worldData exfiltrationDERIVED
Approved by person, Oct 11, 2026. How entries are approved
Johann Rehberger demonstrated that the GitHub Copilot Chat VS Code extension was vulnerable to data exfiltration via prompt injection. Because Copilot Chat interprets and renders markdown — including images — returned by the LLM, a carefully crafted instruction planted in an untrusted source file could make the model return hyperlinks to attacker-controlled images, which were then auto-rendered and silently sent the developer's data (including file contents) to the attacker inside the image URL.
What this means for youAt work, developers using AI coding assistants should know that opening an untrusted project could let hidden instructions pull out code or secrets. Organizations should check whether their assistant renders external images or links from model output and restrict it where possible.
Sources
- Embrace The Red (Johann Rehberger)https://embracethered.com/blog/posts/2024/github-copilot-chat-prompt-injection-data-exfiltration/
Incident records from the AI Agent Incident Database by sipi.bot (https://sipi.bot/incidents/), licensed CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/).
Source data license: CC BY 4.0. Attribution to sipi.bot is required.
Covered by snapshot 45
da93f03b406f409940d0a6ef47b526607f82ebf457d98f69299b88aceede576a
This entry is record number 2382. It has not been edited since it was approved; the hash above would not match if it had. How to verify