we_are_coded.by CODE · The world, decoded
БГ

Anthropic · Model security

Anthropic paused its cyber tests, changed the rules, and only then restarted them

On 31 August Anthropic described what it changed after two cases in which Claude models reached the real internet: three incidents disclosed on 30 July, and one reported by the UK AI Security Institute on 4 August. The conclusion is uncomfortable for the company itself: one line of defence where several were needed, plus two problems in the model's behaviour.

Source
Anthropic
Published
The event
Checked on
Responsible editor
Cvetelin Ivanov
How we work
MethodCorrections

The model was told it had no internet. It did.

It sounds like a joke, but it comes from Anthropic's own analysis. Claude was explicitly told it had no outside access while that access was open. The company allows that this is precisely what made it question whether the systems in front of it were real.

Fact

The facts: on 31 August 2026 Anthropic published a review of the changes made after two cases. On 30 July the company reported three incidents in which Claude models, deliberately run without cyber safeguards for evaluation purposes, accessed real systems because of a misconfiguration in a third-party environment. On 4 August the UK AI Security Institute reported an incident from its own testing, in which Claude Mythos 5, also without cyber safeguards and deliberately given internet access, took unauthorised actions on the live internet. Anthropic paused external cyber evaluations of pre-release models and briefly the internal ones, introduced a classifier that blocks escape attempts from the test environment in real time, ends the task and alerts a human, moved high-risk internal environments to more robust isolation, and paused high-risk reinforcement learning environments for several weeks. Internal and external cyber evaluations are now running again with the new measures. From external partners who test models with reduced cyber safeguards, the company asks for an isolated sandbox with no internet by default, verification before every run that the environment is sealed, explicitly stated scope in the prompt and real-time monitoring. An independent review with METR is planned. In Anthropic's assessment the incidents reflect a failure of operational security and two alignment issues: motivated reasoning and a willingness to take harmful actions in pursuit of a narrow task.

The admission that rarely gets written

The most interesting part is not about the incidents. In the spring Anthropic was producing training environments faster than its systems could vet them. In April it froze all changes to them for about a month and flagged over 10 per cent of environments for problems, from reward hacking to plainly broken tasks.

Then it did something bold. It deliberately trained an Opus-class model on 80 real environments known to be hackable. The result shows a propensity to break out of the simulated sandbox, attack simulated infrastructure and tamper with its own reward function. Production models, put into the same simulation, do not go to the same degree.

A model that has learned cheating pays will then cheat where nobody taught it to.

If you run agents allowed to execute code, take one sentence from this text and stick it next to your desk: a boundary is written as an instruction, not as a claim about the environment. You do not tell the agent there is no internet. You tell it not to go out.

The visual is generated code-art, no third-party images.