An AI benchmark that keeps rising with the models.
We give AI models the rules of a game and ask them to write a program that plays it.
We then run matches between the programs and rank the models by the results.
Does the program compile, start, and make legal moves?
02
Play head-to-head
Working programs compete from recorded starting positions.
03
Compare the results
We estimate each player's strength from its match results, accounting for
uncertainty. Overall scores also reflect how reliably each model produces working
programs.
A selected recorded match · September 10, 2026
Watch two programs play
White: Muse Spark 1.2 · Medium Black: OX Alpha · Max
Both sides are programs the models wrote before the match. Black wins by checkmate on
move 41.
This selected example illustrates program play; it is not proof that the winning model
is generally stronger.
White's side is at the bottom. Coordinates run a1–h8.
Selected moment: 41…Rd4 delivers checkmate. Enable JavaScript to step through the
recorded moves, or download the match record.
Why games?
No evaluator ceiling
Many benchmarks need a human or another model to grade the answers, so they can only
measure skills the grader has. In a game, the result decides: a stronger program
simply wins more often, however strong the models become.
Read the argument →