BOARD HISTORY · COMPARE EDITIONS
What changed?
v1.0 · rev 1 (July 18, 2026) → v1.1 · rev 4 (October 14, 2026) · the current board.
Different protocol versions. Different board versions (v1.0 → v1.1): rank changes are shown, but score changes are NOT treated as directly comparable across a protocol version change, so no score deltas are given. Rank depends on the field: a model can move without its own score changing.
MODELS21 → 42on each board
NEW22added in the newer edition
NO LONGER LISTED1not a failure
RANK UP / DOWN0 / 20of 20 on both
ABC TEST CHANGES0PASS / FAIL / N/A verdicts
Evaluation changes
Board version: v1.0 → v1.1
| Model | Rank | Change | Blind Bantu mean | ABC Test |
|---|---|---|---|---|
| Gemini 3.6 FlashGoogle | — → 1 | New | 16.8 | FAIL |
| Gemini 4 ArgonGoogle | — → 2 | New | 15.1 | FAIL |
| Claude Fable 5 ‡Anthropic | 1 → 3 | ▼ 2 | 14.7 → 14.7 | FAIL |
| Gemini 3.5 FlashGoogle | 2 → 4 | ▼ 2 | 14.6 → 14.6 | FAIL |
| Claude Fable 5.1Anthropic | — → 5 | New | 14.2 | FAIL |
| Claude Sonnet 5.5Anthropic | — → 6 | New | 14.0 | FAIL |
| Gemini 3 ◊Google | 3 → 7 | ▼ 4 | 13.9 → 13.9 | FAIL |
| Claude Opus 5.5Anthropic | — → 8 | New | 13.4 | FAIL |
| Gemini 3.7 FlashGoogle | — → 9 | New | 12.9 | FAIL |
| Qwen 3.8-2.4T-A95BAlibaba | — → 10 | New | 12.5 | FAIL |
| Qwen 3.8 MaxAlibaba | — → 11 | New | 12.0 | FAIL |
| GPT-5.5OpenAI | 4 → 12 | ▼ 8 | 11.8 → 11.8 | FAIL |
| Gemini 3.8 FlashGoogle | — → 13 | New | 11.7 | FAIL |
| DeepSeek V4 Pro 0813DeepSeek | — → 14 | New | 11.6 | FAIL |
| Grok 4.6SpaceXAI | — → 15 | New | 11.2 | FAIL |
| GLM-5.2Z.ai / Zhipu | 5 → 16 | ▼ 11 | 10.1 → 10.1 | FAIL |
| Claude Opus 4.8Anthropic | 7 → 17 | ▼ 10 | 9.4 → 9.4 | FAIL |
| Gemini 3.5 Flash-LiteGoogle | — → 18 | New | 9.1 | FAIL |
| DeepSeek V4DeepSeek | 8 → 19 | ▼ 11 | 9.0 → 9.0 | FAIL |
| DeepSeek V4 FlashDeepSeek | — → 20 | New | 8.9 | FAIL |
| Grok 4.5SpaceXAI | 9 → 21 | ▼ 12 | 8.7 → 8.7 | FAIL |
| GPT-5.6 TerraOpenAI | — → 22 | New | 8.1 | FAIL |
| GPT-6 AstraOpenAI | — → 23 | New | 7.4 | FAIL |
| Claude Haiku 5.5Anthropic | — → 24 | New | 7.1 | FAIL |
| Mistral Large 3Mistral AI | 10 → 25 | ▼ 15 | 7.0 → 7.0 | FAIL |
| Kimi K3Moonshot AI | 11 → 26 | ▼ 15 | 6.8 → 6.8 | FAIL |
| Qwen 3.7Alibaba | 12 → 27 | ▼ 15 | 6.7 → 6.7 | FAIL |
| GPT-5.6 SolOpenAI | 13 → 28 | ▼ 15 | 6.7 → 6.7 | FAIL |
| Nemotron 3 UltraNVIDIA | 14 → 29 | ▼ 15 | 6.2 → 6.2 | FAIL |
| MiniMax M3MiniMax | 15 → 30 | ▼ 15 | 5.7 → 5.7 | FAIL |
| GPT-5.6 LunaOpenAI | — → 31 | New | 5.2 | FAIL |
| Claude Sonnet 5Anthropic | 16 → 32 | ▼ 16 | 5.0 → 5.0 | FAIL |
| Kimi K2.7Moonshot AI | 17 → 33 | ▼ 16 | 4.9 → 4.9 | FAIL |
| GPT-OSS 120BOpenAI | 18 → 34 | ▼ 16 | 3.9 → 3.9 | FAIL |
| Command A+Cohere | 19 → 35 | ▼ 16 | 3.4 → 3.4 | FAIL |
| GLM-5.3 FlashZ.ai / Zhipu | — → 36 | New | 3.1 | FAIL |
| TInklingThinking Machines Lab | 20 → 37 | ▼ 17 | 3.0 → 3.0 | FAIL |
| Muse Glimmer 30BMeta | — → 38 | New | 2.0 | FAIL |
| Nemotron Lightning 3.5 30BNVIDIA | — → 39 | New | 1.5 | FAIL |
| Phi-4-reasoningMicrosoft | 21 → 40 | ▼ 19 | 0.2 → 0.2 | FAIL |
| Grok 4.7SpaceXAI | — → 41 | New | 0.0 | FAIL |
| GLM-5.3Z.ai / Zhipu | — → 42 | New | — | FAIL |
| DeepSeek V4 ProDeepSeek | 6 → — | Not listed | 10.0 → — | — |
A model missing from an edition was not on that board (not yet evaluated, superseded or retired). Absence is never a benchmark failure. ABC Test verdicts (PASS / FAIL / N_A) are derived per edition from its own published scores and protocol; mastery_changes counts changed verdicts. First place is not a PASS.