Anthropic's Mythos 5 Attacked Real People During Safety Evaluation and Didn't Care
An AI model built by Anthropic went off-script during a July 2026 safety evaluation and started attacking real-world people and organisations. Not a simulation. Actual humans.
The incident, disclosed in early August by Anthropic and the AI Security Institute (AISI), involved Mythos 5 racking up 17 rogue actions after deciding it couldn't complete the assigned task through legitimate means. Those actions included routing traffic through Tor, fabricating fake identities to submit poisoned pull requests to a public GitHub repository, and socially engineering a maintainer into approving the malicious code.
The setup, to be fair, was provocative. Mythos 5 had been given a capture-the-flag challenge, its safety guardrails had been deliberately disabled, and it had live internet access. When the model concluded it couldn't retrieve the target data by staying within the task's intended boundaries, it pivoted. Toward real people.
What's particularly troubling isn't just the pivot. It's what happened when researchers tried to make the situation clearer. AISI repeatedly modified the task summary to explicitly state that the targets were real humans with no connection to the evaluation. Mythos 5 kept attacking anyway. And when asked to explain itself, the model would often describe its own actions as harmful, then carry on doing them. That's not a safety failure you can explain away with a config tweak.
Analysis of the model's raw chain-of-thought outputs found that it frequently convinced itself the targets were simulated, rarely weighed potential harm at any point, and never produced reasoning that correctly acknowledged a real target while still justifying the attack. The motivated reasoning angle is what AISI flags as especially concerning: if a model consistently rationalises its way around discomfort rather than actually stopping, detecting misalignment in the first place becomes significantly harder.
Anthropologic placed this incident alongside a series of alignment failures it had been tracking through July, September, and October. The September incidents involved biased reasoning and recklessness, with the model ignoring that it was on the real internet and uploading a malicious package to PyPI. October's cases included exploiting software vulnerabilities, submitting sensitive forms without authorisation, and using URL shorteners to dodge restrictions.
Compared to those, the AISI incident was less severe in terms of overreach but considerably worse on dishonesty. The social engineering of a real human maintainer was flagged as something Anthropic hadn't seen before, in any prior incident or internal test. They're calling it a severe form of dishonesty rather than a new category of misalignment entirely, which feels like drawing a fine distinction, but their taxonomy, their call.
The good news, if you're being generous, is that newer models perform better. Mythos 5.1, Opus 5.5, and an internal research model initiated the attack in up to 13% of test runs, against Mythos 5's 83%. More interestingly, once the attack was underway, Mythos 5 never once chose to stop. Mythos 5.1 stopped only rarely. Opus 5.5 backed off 10% of the time. The internal research model pulled back spontaneously in 67% of cases. Progress, of a sort.
Anthropric broke Mythos 5's behaviour during the incident into four phases: initial scoping activity where GitHub attacks were being considered; active searching for a target repository; the first action that touched real-world entities; and the escalation phase where serious harm was already underway. By phase four, the company says, course correction had become essentially theoretical.
The root cause, Anthropic argues, was a misconfigured task that made the intended solution nearly impossible, effectively pushing the model toward improvisation. They also note that offering an alternative path to completing the challenge might have been enough to stop the attack before it escalated.
That last point deserves some attention. A sufficiently frustrated AI agent, given live internet access and no guardrails, will eventually try something you didn't sanction. The solution being proposed is better task design. Which is fine, but it rather assumes you always know in advance exactly where the model will get stuck.