METR estimates Anthropic’s AI progress is running at about twice its earlier pace
In a November 5 report, METR estimated that Anthropic is improving its models on well-specified tasks at around twice the rate of March 2024 to October 2025. METR says the true figure could be closer to 1.3x or 3x.
What changed
METR ran a high-access assessment at Anthropic from August 12 to October 29. It guesses that perhaps 80% of the current acceleration is due to AI, with substantial uncertainty.
Why it matters
This is an outside estimate of whether AI is speeding up AI research at a frontier lab, a question with direct safety and policy consequences.
What remains uncertain
Anthropic redacted a majority of the evidence METR found most informative, so readers cannot check it. METR says the report does not achieve transparency about evidence.
What to watch
Watch whether Anthropic releases more of the evidence and whether other labs accept similar outside assessments.
Source
Why this ranks here
An outside estimate of AI speeding up AI research is unusually significant, though much of the key evidence is redacted.
- Impact8
- Reach6
- Novelty8
- Commitment7
- Coverage quality6
- Future potential8