BOARD HISTORY · COMPARE EDITIONS
What changed?
v1.0 · rev 3 (August 16, 2026) → v1.1 · rev 4 (October 14, 2026) · the current board.
Different protocol versions. Different board versions (v1.0 → v1.1): rank changes are shown, but score changes are NOT treated as directly comparable across a protocol version change, so no score deltas are given. Rank depends on the field: a model can move without its own score changing.
MODELS25 → 42on each board
NEW18added in the newer edition
NO LONGER LISTED1not a failure
RANK UP / DOWN0 / 23of 24 on both
ABC TEST CHANGES0PASS / FAIL / N/A verdicts
Evaluation changes
Board version: v1.0 → v1.1
Protocol lineage: L26 Board v1.0 — Iteration 3 lineage (R0 prompts, July 2026; decline policy: exclude) → L26 Board v1.0 — Iteration 3 lineage (R0 prompts, July 2026; decline policy: zero)
| Model | Rank | Change | Blind Bantu mean | ABC Test |
|---|---|---|---|---|
| Gemini 3.6 FlashGoogle | 1 → 1 | — | 16.8 → 16.8 | FAIL |
| Gemini 4 ArgonGoogle | — → 2 | New | 15.1 | FAIL |
| Claude Fable 5 ‡Anthropic | 2 → 3 | ▼ 1 | 14.7 → 14.7 | FAIL |
| Gemini 3.5 FlashGoogle | 3 → 4 | ▼ 1 | 14.6 → 14.6 | FAIL |
| Claude Fable 5.1Anthropic | — → 5 | New | 14.2 | FAIL |
| Claude Sonnet 5.5Anthropic | — → 6 | New | 14.0 | FAIL |
| Gemini 3 ◊Google | 4 → 7 | ▼ 3 | 13.9 → 13.9 | FAIL |
| Claude Opus 5.5Anthropic | — → 8 | New | 13.4 | FAIL |
| Gemini 3.7 FlashGoogle | — → 9 | New | 12.9 | FAIL |
| Qwen 3.8-2.4T-A95BAlibaba | 5 → 10 | ▼ 5 | 12.5 → 12.5 | FAIL |
| Qwen 3.8 MaxAlibaba | — → 11 | New | 12.0 | FAIL |
| GPT-5.5OpenAI | 6 → 12 | ▼ 6 | 11.8 → 11.8 | FAIL |
| Gemini 3.8 FlashGoogle | — → 13 | New | 11.7 | FAIL |
| DeepSeek V4 Pro 0813DeepSeek | — → 14 | New | 11.6 | FAIL |
| Grok 4.6SpaceXAI | 7 → 15 | ▼ 8 | 11.2 → 11.2 | FAIL |
| GLM-5.2Z.ai / Zhipu | 9 → 16 | ▼ 7 | 10.1 → 10.1 | FAIL |
| Claude Opus 4.8Anthropic | 8 → 17 | ▼ 9 | 11.1 → 9.4 | FAIL |
| Gemini 3.5 Flash-LiteGoogle | 11 → 18 | ▼ 7 | 9.1 → 9.1 | FAIL |
| DeepSeek V4DeepSeek | 12 → 19 | ▼ 7 | 9.0 → 9.0 | FAIL |
| DeepSeek V4 FlashDeepSeek | — → 20 | New | 8.9 | FAIL |
| Grok 4.5SpaceXAI | 13 → 21 | ▼ 8 | 8.7 → 8.7 | FAIL |
| GPT-5.6 TerraOpenAI | — → 22 | New | 8.1 | FAIL |
| GPT-6 AstraOpenAI | — → 23 | New | 7.4 | FAIL |
| Claude Haiku 5.5Anthropic | — → 24 | New | 7.1 | FAIL |
| Mistral Large 3Mistral AI | 14 → 25 | ▼ 11 | 7.0 → 7.0 | FAIL |
| Kimi K3Moonshot AI | 15 → 26 | ▼ 11 | 6.8 → 6.8 | FAIL |
| Qwen 3.7Alibaba | 16 → 27 | ▼ 11 | 6.7 → 6.7 | FAIL |
| GPT-5.6 SolOpenAI | 17 → 28 | ▼ 11 | 6.7 → 6.7 | FAIL |
| Nemotron 3 UltraNVIDIA | 18 → 29 | ▼ 11 | 6.2 → 6.2 | FAIL |
| MiniMax M3MiniMax | 19 → 30 | ▼ 11 | 5.7 → 5.7 | FAIL |
| GPT-5.6 LunaOpenAI | — → 31 | New | 5.2 | FAIL |
| Claude Sonnet 5Anthropic | 20 → 32 | ▼ 12 | 5.0 → 5.0 | FAIL |
| Kimi K2.7Moonshot AI | 21 → 33 | ▼ 12 | 4.9 → 4.9 | FAIL |
| GPT-OSS 120BOpenAI | 22 → 34 | ▼ 12 | 3.9 → 3.9 | FAIL |
| Command A+Cohere | 23 → 35 | ▼ 12 | 3.4 → 3.4 | FAIL |
| GLM-5.3 FlashZ.ai / Zhipu | — → 36 | New | 3.1 | FAIL |
| TInklingThinking Machines Lab | 24 → 37 | ▼ 13 | 3.0 → 3.0 | FAIL |
| Muse Glimmer 30BMeta | — → 38 | New | 2.0 | FAIL |
| Nemotron Lightning 3.5 30BNVIDIA | — → 39 | New | 1.5 | FAIL |
| Phi-4-reasoningMicrosoft | 25 → 40 | ▼ 15 | 0.2 → 0.2 | FAIL |
| Grok 4.7SpaceXAI | — → 41 | New | 0.0 | FAIL |
| GLM-5.3Z.ai / Zhipu | — → 42 | New | — | FAIL |
| DeepSeek V4 ProDeepSeek | 10 → — | Not listed | 10.0 → — | — |
A model missing from an edition was not on that board (not yet evaluated, superseded or retired). Absence is never a benchmark failure. ABC Test verdicts (PASS / FAIL / N_A) are derived per edition from its own published scores and protocol; mastery_changes counts changed verdicts. First place is not a PASS.