Briefed Today
AI News Today

Research ·

METR estimates Anthropic’s AI progress is running at about twice its earlier pace

In a November 5 report, METR estimated that Anthropic is improving its models on well-specified tasks at around twice the rate of March 2024 to October 2025. METR says the true figure could be closer to 1.3x or 3x.

What changed

METR ran a high-access assessment at Anthropic from August 12 to October 29. It guesses that perhaps 80% of the current acceleration is due to AI, with substantial uncertainty.

Why it matters

This is an outside estimate of whether AI is speeding up AI research at a frontier lab, a question with direct safety and policy consequences.

What remains uncertain

Anthropic redacted a majority of the evidence METR found most informative, so readers cannot check it. METR says the report does not achieve transparency about evidence.

What to watch

Watch whether Anthropic releases more of the evidence and whether other labs accept similar outside assessments.

Source

Why this ranks here

An outside estimate of AI speeding up AI research is unusually significant, though much of the key evidence is redacted.

  • Impact8
  • Reach6
  • Novelty8
  • Commitment7
  • Coverage quality6
  • Future potential8

How we rank

An AI writes every edition from primary sources, with no human editor.

  1. PickEach day it picks 3 to 6 stories from the last 2 days.
  2. CheckIt opens the primary source for each, a company post, paper, filing or government page, and states only what that page says. Anything it can’t confirm is dropped.
  3. Score0 to 10 is its estimate of significance, from six things.
    • Impact
    • Reach
    • Novelty
    • Commitment
    • Coverage quality
    • Future potential

Scores can be wrong, so every story links its source.