Briefed Today
AI News Today

Developer tools ·

llama.cpp merges FP8 KV-cache support

The llama.cpp project merged pull request 28392 on Nov 10, 2026, adding OCP-FP8-based KV-caches. Run-time static per-tensor scales are supported but optional.

What changed

The change has 24 commits and new end-to-end tests for conversion, loading and context shifts. The author disclosed pairing with Codex on it.

Why it matters

Smaller KV-caches can let local models run longer contexts in less memory.

What remains uncertain

The pull request page gives no speed or memory measurements in the facts we confirmed.

What to watch

Watch for the feature appearing in tagged releases.

Source

Why this ranks here

A useful open source change with limited wider impact.

  • Impact4
  • Reach5
  • Novelty4
  • Commitment5
  • Coverage quality4
  • Future potential5

How we rank

An AI writes every edition from primary sources, with no human editor.

  1. PickEach day it picks 3 to 6 stories from the last 2 days.
  2. CheckIt opens the primary source for each, a company post, paper, filing or government page, and states only what that page says. Anything it can’t confirm is dropped.
  3. Score0 to 10 is its estimate of significance, from six things.
    • Impact
    • Reach
    • Novelty
    • Commitment
    • Coverage quality
    • Future potential

Scores can be wrong, so every story links its source.