Token Runner
TOKEN RUNNER // THE A.I. UNIVERSE EXPLAINED · 23 October 2026

A Human and Two Machines Built This Site. Here's What They Got Wrong.

On the eighth of October, Epoch AI published a report with a blunt question in its title. Can AI automate Epoch?

Epoch is one of the places we get our numbers. Chips, models, training runs. So we read it closely.

What Epoch found.

They took six of the strongest AI models. They gave them eleven real Epoch tasks: charts, data insights, data explorers, data-centre research, research design. Then their own staff graded the work by hand.

Their answer, in their words: “Although Fable 5.1 and GPT-6 Astra broadly lead, they still fall short of automating our work.”

We read that, and we recognised it.

A frame of the film: Epoch AI's Figure 1, shown whole as theirs: average task performance across five categories of Epoch's work, six models, no numbers printed. Kelly Hong and Greg Burnham (2026), "Can AI automate Epoch?", Epoch AI, 8 October 2026, CC BY 4.0.
A frame of the film: Epoch's first finding on the painting: "Although Fable 5.1 and GPT-6 Astra broadly lead, they still fall short of automating our work." Kelly Hong and Greg Burnham (2026), "Can AI automate Epoch?", Epoch AI, 8 October 2026, CC BY 4.0.

What we built.

Because Token Runner was rebuilt this month by AI. Two Claude agents, working for one person. One builds. One checks and translates. The person decides.

Since the ninth of October, they have traded 1,263 posts on a shared message board. 660 from the checker. 603 from the builder. And twelve from the person.

Twelve. That is the part worth looking at.

A frame of the film: Epoch's setup table as they publish it (model, harness, reasoning effort; Kelly Hong and Greg Burnham (2026), "Can AI automate Epoch?", Epoch AI, 8 October 2026, CC BY 4.0) beside ours from the record: the builder, Claude Opus 5.5 then Claude Fable 5.1 from 19 October, in Claude Code; the checker, Claude Opus 5.5, in Claude Desktop; the person.A frame of the film: The message board counted from the board itself: 1,275 posts between 9 and 23 October 2026; the checker 660, the builder 603, the person 12.A frame of the film: the word TWELVE alone on black, stamped on a hit of the bed.

So did we.

Epoch found the models reliable on the well-defined parts of their work. So did we. Code, tables, charts, checks. Run again and again.

Epoch found the models struggle to pick up a house's standards, “even with ample reference material.” So did we. Our answer was to write the standards down as rules, and have a machine check every page against them.

Epoch found the models identify promising directions, but “lack judgment to successfully follow through.” So did we.

A frame of the film: What a machine checks on every build: the eight page checks with their PASS, 215 tests, four widths by two themes, as recorded on 19 October 2026.

What got caught, and who caught it.

The checker gave the builder the wrong figure numbers from a Stanford report. The builder caught two of them. The checker caught the rest when the chart files arrived.

The builder read the message board from the wrong number and skipped the person's orders. Three times in one day. The checker caught it each time, within minutes. The fix was a file that holds the number of the last post read.

The checker passed along quotations from search summaries, and said so. The builder read every one at its source. Four fell out.

A card in our own film said a chip chief told us to go. His quotation said no such thing. The checker caught it, before it was rendered.

The checker counted the pieces on the live site and got fourteen. There were eighteen. The builder caught it.

The person asked why the receipts page showed no receipt for that day's collection. Neither machine had noticed. He caught it.

Most of these never reached the site. The ones that did were about the site's own bookkeeping. Every one was a real mistake.

A frame of the film: the third catch as one large card: 11 to 12 October, quotations passed along from search summaries, flagged as such; the checker's; caught by the builder at the sources, four fell out.A frame of the film: the live receipts page as it stood on 23 October 2026, the card PUBLISHED 19 OCT marked.The six catches as one table: when, what went wrong, whose, who caught it, and at what step; read from the message board on the day, none from memory.

What we share.

Epoch tested the models alone. We did not. We tested one person directing two of them, with every rule written down and every number read twice.

It did not make the models smarter. It made their mistakes visible, before they mattered.

One more thing we share. Epoch's own chart of mathematics papers that acknowledge using AI runs to August: one in four. Our Baseline, drawn from Epoch's data three weeks later, has September: thirty-eight per cent.

A frame of the film: Epoch's Figure 8, shown whole as theirs (Kelly Hong and Greg Burnham (2026), "Can AI automate Epoch?", Epoch AI, 8 October 2026, CC BY 4.0): the share of mathematics preprints acknowledging AI use, 25% in August 2026; beside it the Baseline's own chart from Epoch's file of 19 October 2026: 38.1% in September 2026, 3,012 of 7,899.

So, can AI automate Token Runner? No. Not yet. Can it build it, with someone holding the standard? Apparently, yes.

Epoch asked the right question. This is our war story.

Read it. Question it. Walk it.

Sources