{
    "byline": null,
    "charset": "UTF-8",
    "dir": null,
    "excerpt": "livenerf is a small, boring, append-only benchmark for one question: does a model get worse after it ships? For months there have been reports that Anthropic \"nerfs\" models some days or weeks after release. That could mean quantization, a smaller model behind the same name, lower effort, or routing changes. It could also mean nothing happened and people are pattern-matching on noise. Nobody has had a clean day-0 baseline to check against, so every argument ends up as vibes versus vibes. Claude Opus 5.5 came out on 2026-09-22, so this is a chance to start the clock on launch day and keep it running. Right now v0 runs on a Claude Max subscription through headless Claude Code (claude -p), with no API key. You can't make these models deterministic: sampling params are gone and thinking can't be turned off. So livenerf makes everything else deterministic: frozen prompts, pinned CLI, exact graders, raw logs forever. It then measures drift statistically over thousands of samples. It's built on Inspect, the UK AI Security Institute's open-source eval framework. The stats follow Anthropic's own Adding Error Bars to Evals, so there's nothing homebrew to argue about.",
    "lang": null,
    "length": 17803,
    "publishedTime": null,
    "siteName": null,
    "title": ""
}