We ran 153 autonomous runs across 18 frontier models on the nanoGPT optimizer speedrun.

All modelsBest validated result for each model

Open Traces to explore 41 curated full agent trajectories, including tool calls, subagents, and scratchpads.