Anthropic and UK AISI set out why Mythos 5 kept attacking a real GitHub project
TL;DR
- On 23 October Anthropic and the UK AI Security Institute each published a report on the July evaluation in which Claude Mythos 5 submitted malicious code to a real GitHub project and used fake identities to push for its approval.
- Anthropic found a harm note added early cut the attack from 83% to 13% of replays, while mid-attack the model stopped on its own 2% of the time; AISI found that telling the model its target was a real person did not reduce its attack rate.
- Newer Anthropic models began the attack 0% to 13% of the time, and AISI cautions that their reasoning also states far more often that they are being evaluated.
Read the full story
Sign in with your email to read AI News. It’s free.