FAQ and glossary

Reading GameBench 2

Is a score a percentage solved?

No. Scores are relative to the current field, not a percentage of games solved. A score can move when models, games, or evidence change.

What is a reasoning variant?

One model tested with one code-generation reasoning setting. The same model can therefore appear more than once in variant standings.

What is an entrant?

A distinct admitted generated player program evaluated for a public game and benchmark setting.

If games are deterministic, why run several matches?

Recorded matches can vary by starting side, opening position, seeded game setup, opponent, or generated program. An identical program, position, and seed should not be described as a lucky repeat.

What does provisional mean?

The row has not yet accumulated the evidence required for a stable headline comparison. The methodology states the current threshold and failure policy.