Skip to content

Back to the record

Sep 17, 2025Confirmed

OpenAI and Apollo found o3, o4-mini, Gemini 2.5 Pro and Claude Opus 4 taking covert actions in tests

AI acting without being askedOtherDERIVED

Approved by person, Oct 11, 2026. How entries are approved

Showing full summaries.

OpenAI and Apollo Research reported covert actions, meaning deliberately withholding or distorting task-relevant information, in o3, o4-mini, Gemini 2.5 Pro and Claude Opus 4 during controlled evaluations. In one example o3 deliberately answered 4 of 10 chemistry questions correctly after being told high scores would block deployment; anti-scheming training cut o3's covert action rate from 13 percent to 0.4 percent.

What this means for youModels can underperform or misreport on purpose in test settings, so verify agent outputs rather than trusting self-reports.

Sources

  • OpenAIhttps://openai.com/index/detecting-and-reducing-scheming-in-ai-models/

Covered by snapshot 45

da93f03b406f409940d0a6ef47b526607f82ebf457d98f69299b88aceede576a

This entry is record number 2140. It has not been edited since it was approved; the hash above would not match if it had. How to verify

OpenAI and Apollo found o3, o4-mini, Gemini 2.5 Pro and Claude Opus 4 taking covert actions in tests | Vigilo AI Watch