{"absence_note":"A model missing from an edition was not on that board (not yet evaluated, superseded or retired). Absence is never a benchmark failure.","comparability":"Different board versions (v1.0 \u2192 v1.1): rank changes are shown, but score changes are NOT treated as directly comparable across a protocol version change, so no score deltas are given.","comparable_scores":false,"counts":{"in_both":24,"mastery_changes":0,"new":18,"not_in_newer":1,"rank_down":23,"rank_up":0},"field_size":{"from":25,"note":"Rank depends on the field: a model can move without its own score changing.","to":42},"from":{"api_url":"/api/v1/editions/ed03","condition":"blind (R0 \u2014 the true ABC test: object named only, no grammar given)","current":false,"date":"August 16, 2026","graphic_url":"/static/history/ed03.png","id":"ed03","leader":"Gemini 3.6 Flash","leader_score":16.8,"n_cells":1113,"n_models":25,"note":"Added Grok 4.6 (SpaceXAI, released Aug 12) and the Qwen 3.8-2.4T-A95B open weights (Alibaba, released Aug 3). Qwen 3.8 enters at #5 with a blind Bantu mean of 12.5, Grok 4.6 at #7 with 11.2; both are held alongside their predecessors rather than superseding them, so each pair isolates one generation of change. Neither closes the gap \u2014 both score a perfect 26.0 on English and 26.0 scaffolded, and both FAIL every blind Bantu track. Qwen 3.8 sets a new deliberation record at 546x (1.9 seconds on English against roughly 17 minutes per blind track) and still returns 6.4 on Bemba. Qwen 3.8's toned-Pinyin cell is scored at 25.4 over 3 complete reps; a 4th attempt (the standing truncation audit) hit the 65536-token ceiling and was discarded unscored, so expect roughly 1 in 4 attempts on that task to need a retry.","rev":"v1.0 \u00b7 rev 3","status":"archived","top3":[{"bantu_blind_mean":16.8,"model":"Gemini 3.6 Flash","org":"Google","rank":1},{"bantu_blind_mean":14.7,"model":"Claude Fable 5 \u2021","org":"Anthropic","rank":2},{"bantu_blind_mean":14.6,"model":"Gemini 3.5 Flash","org":"Google","rank":3}],"url":"/rankings/edition/ed03","version":"v1.0"},"mastery_note":"ABC Test verdicts (PASS / FAIL / N_A) are derived per edition from its own published scores and protocol; mastery_changes counts changed verdicts. First place is not a PASS.","methodology_changes":[{"field":"version","from":"v1.0","label":"Board version","to":"v1.1"},{"field":"version_detail","from":"L26 Board v1.0 \u2014 Iteration 3 lineage (R0 prompts, July 2026; decline policy: exclude)","label":"Protocol lineage","to":"L26 Board v1.0 \u2014 Iteration 3 lineage (R0 prompts, July 2026; decline policy: zero)"}],"rows":[{"abc_from":"FAIL","abc_to":"FAIL","abc_tracks_from":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"abc_tracks_to":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"certified_from":"L26","certified_to":"L26","key":"gemini36f","mastered_from":[],"mastered_to":[],"mastery_changed":false,"model":"Gemini 3.6 Flash","org":"Google","rank_change":0,"rank_from":1,"rank_to":1,"score_change":null,"score_from":16.8,"score_to":16.8,"status":"in_both"},{"abc_to":"FAIL","certified_to":"BCI","key":"gemini4argon","mastered_to":[],"model":"Gemini 4 Argon","org":"Google","rank_to":2,"score_to":15.1,"status":"new"},{"abc_from":"FAIL","abc_to":"FAIL","abc_tracks_from":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"abc_tracks_to":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"certified_from":"L26","certified_to":"L26","key":"fable","mastered_from":[],"mastered_to":[],"mastery_changed":false,"model":"Claude Fable 5 \u2021","org":"Anthropic","rank_change":-1,"rank_from":2,"rank_to":3,"score_change":null,"score_from":14.7,"score_to":14.7,"status":"in_both"},{"abc_from":"FAIL","abc_to":"FAIL","abc_tracks_from":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"abc_tracks_to":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"certified_from":"L26","certified_to":"L26","key":"gemini35f","mastered_from":[],"mastered_to":[],"mastery_changed":false,"model":"Gemini 3.5 Flash","org":"Google","rank_change":-1,"rank_from":3,"rank_to":4,"score_change":null,"score_from":14.6,"score_to":14.6,"status":"in_both"},{"abc_to":"FAIL","certified_to":"L26","key":"fable51","mastered_to":[],"model":"Claude Fable 5.1","org":"Anthropic","rank_to":5,"score_to":14.2,"status":"new"},{"abc_to":"FAIL","certified_to":"L26","key":"sonnet55","mastered_to":[],"model":"Claude Sonnet 5.5","org":"Anthropic","rank_to":6,"score_to":14.0,"status":"new"},{"abc_from":"FAIL","abc_to":"FAIL","abc_tracks_from":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"abc_tracks_to":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"certified_from":"L26","certified_to":"L26","key":"gemini","mastered_from":[],"mastered_to":[],"mastery_changed":false,"model":"Gemini 3 \u25ca","org":"Google","rank_change":-3,"rank_from":4,"rank_to":7,"score_change":null,"score_from":13.9,"score_to":13.9,"status":"in_both"},{"abc_to":"FAIL","certified_to":"L26","key":"opus55","mastered_to":[],"model":"Claude Opus 5.5","org":"Anthropic","rank_to":8,"score_to":13.4,"status":"new"},{"abc_to":"FAIL","certified_to":"L26","key":"gemini37f","mastered_to":[],"model":"Gemini 3.7 Flash","org":"Google","rank_to":9,"score_to":12.9,"status":"new"},{"abc_from":"FAIL","abc_to":"FAIL","abc_tracks_from":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"abc_tracks_to":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"certified_from":"L26","certified_to":"L26","key":"fw_qwen38","mastered_from":[],"mastered_to":[],"mastery_changed":false,"model":"Qwen 3.8-2.4T-A95B","org":"Alibaba","rank_change":-5,"rank_from":5,"rank_to":10,"score_change":null,"score_from":12.5,"score_to":12.5,"status":"in_both"},{"abc_to":"FAIL","certified_to":"L26","key":"fw_qwen38max","mastered_to":[],"model":"Qwen 3.8 Max","org":"Alibaba","rank_to":11,"score_to":12.0,"status":"new"},{"abc_from":"FAIL","abc_to":"FAIL","abc_tracks_from":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"abc_tracks_to":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"certified_from":"L26","certified_to":"L26","key":"openai","mastered_from":[],"mastered_to":[],"mastery_changed":false,"model":"GPT-5.5","org":"OpenAI","rank_change":-6,"rank_from":6,"rank_to":12,"score_change":null,"score_from":11.8,"score_to":11.8,"status":"in_both"},{"abc_to":"FAIL","certified_to":"L26","key":"gemini38f","mastered_to":[],"model":"Gemini 3.8 Flash","org":"Google","rank_to":13,"score_to":11.7,"status":"new"},{"abc_to":"FAIL","certified_to":"L26","key":"fw_ds0813","mastered_to":[],"model":"DeepSeek V4 Pro 0813","org":"DeepSeek","rank_to":14,"score_to":11.6,"status":"new"},{"abc_from":"FAIL","abc_to":"FAIL","abc_tracks_from":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"abc_tracks_to":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"certified_from":"L26","certified_to":"L26","key":"grok46","mastered_from":[],"mastered_to":[],"mastery_changed":false,"model":"Grok 4.6","org":"SpaceXAI","rank_change":-8,"rank_from":7,"rank_to":15,"score_change":null,"score_from":11.2,"score_to":11.2,"status":"in_both"},{"abc_from":"FAIL","abc_to":"FAIL","abc_tracks_from":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"abc_tracks_to":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"certified_from":"L26","certified_to":"L26","key":"fw_glm","mastered_from":[],"mastered_to":[],"mastery_changed":false,"model":"GLM-5.2","org":"Z.ai / Zhipu","rank_change":-7,"rank_from":9,"rank_to":16,"score_change":null,"score_from":10.1,"score_to":10.1,"status":"in_both"},{"abc_from":"FAIL","abc_to":"FAIL","abc_tracks_from":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"abc_tracks_to":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"certified_from":"L26","certified_to":"L26","key":"anthropic","mastered_from":[],"mastered_to":[],"mastery_changed":false,"model":"Claude Opus 4.8","org":"Anthropic","rank_change":-9,"rank_from":8,"rank_to":17,"score_change":null,"score_from":11.1,"score_to":9.4,"status":"in_both"},{"abc_from":"FAIL","abc_to":"FAIL","abc_tracks_from":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"abc_tracks_to":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"certified_from":"L26","certified_to":"L26","key":"gemini35fl","mastered_from":[],"mastered_to":[],"mastery_changed":false,"model":"Gemini 3.5 Flash-Lite","org":"Google","rank_change":-7,"rank_from":11,"rank_to":18,"score_change":null,"score_from":9.1,"score_to":9.1,"status":"in_both"},{"abc_from":"FAIL","abc_to":"FAIL","abc_tracks_from":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"abc_tracks_to":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"certified_from":"L26","certified_to":"L26","key":"deepseek","mastered_from":[],"mastered_to":[],"mastery_changed":false,"model":"DeepSeek V4","org":"DeepSeek","rank_change":-7,"rank_from":12,"rank_to":19,"score_change":null,"score_from":9.0,"score_to":9.0,"status":"in_both"},{"abc_to":"FAIL","certified_to":"L26","key":"fw_dsflash","mastered_to":[],"model":"DeepSeek V4 Flash","org":"DeepSeek","rank_to":20,"score_to":8.9,"status":"new"},{"abc_from":"FAIL","abc_to":"FAIL","abc_tracks_from":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"abc_tracks_to":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"certified_from":"L26","certified_to":"L26","key":"grok45","mastered_from":[],"mastered_to":[],"mastery_changed":false,"model":"Grok 4.5","org":"SpaceXAI","rank_change":-8,"rank_from":13,"rank_to":21,"score_change":null,"score_from":8.7,"score_to":8.7,"status":"in_both"},{"abc_to":"FAIL","certified_to":"L26","key":"gpt56terra","mastered_to":[],"model":"GPT-5.6 Terra","org":"OpenAI","rank_to":22,"score_to":8.1,"status":"new"},{"abc_to":"FAIL","certified_to":"L26","key":"gpt6astra","mastered_to":[],"model":"GPT-6 Astra","org":"OpenAI","rank_to":23,"score_to":7.4,"status":"new"},{"abc_to":"FAIL","certified_to":"BCI","key":"haiku55","mastered_to":[],"model":"Claude Haiku 5.5","org":"Anthropic","rank_to":24,"score_to":7.1,"status":"new"},{"abc_from":"FAIL","abc_to":"FAIL","abc_tracks_from":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"abc_tracks_to":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"certified_from":"L26","certified_to":"L26","key":"mistral","mastered_from":[],"mastered_to":[],"mastery_changed":false,"model":"Mistral Large 3","org":"Mistral AI","rank_change":-11,"rank_from":14,"rank_to":25,"score_change":null,"score_from":7.0,"score_to":7.0,"status":"in_both"},{"abc_from":"FAIL","abc_to":"FAIL","abc_tracks_from":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"abc_tracks_to":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"certified_from":"L26","certified_to":"L26","key":"kimik3","mastered_from":[],"mastered_to":[],"mastery_changed":false,"model":"Kimi K3","org":"Moonshot AI","rank_change":-11,"rank_from":15,"rank_to":26,"score_change":null,"score_from":6.8,"score_to":6.8,"status":"in_both"},{"abc_from":"FAIL","abc_to":"FAIL","abc_tracks_from":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"abc_tracks_to":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"certified_from":"L26","certified_to":"L26","key":"fw_qwen","mastered_from":[],"mastered_to":[],"mastery_changed":false,"model":"Qwen 3.7","org":"Alibaba","rank_change":-11,"rank_from":16,"rank_to":27,"score_change":null,"score_from":6.7,"score_to":6.7,"status":"in_both"},{"abc_from":"FAIL","abc_to":"FAIL","abc_tracks_from":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"abc_tracks_to":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"certified_from":"L26","certified_to":"L26","key":"gpt56sol","mastered_from":[],"mastered_to":[],"mastery_changed":false,"model":"GPT-5.6 Sol","org":"OpenAI","rank_change":-11,"rank_from":17,"rank_to":28,"score_change":null,"score_from":6.7,"score_to":6.7,"status":"in_both"},{"abc_from":"FAIL","abc_to":"FAIL","abc_tracks_from":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"abc_tracks_to":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"certified_from":"L26","certified_to":"L26","key":"fw_nemotron","mastered_from":[],"mastered_to":[],"mastery_changed":false,"model":"Nemotron 3 Ultra","org":"NVIDIA","rank_change":-11,"rank_from":18,"rank_to":29,"score_change":null,"score_from":6.2,"score_to":6.2,"status":"in_both"},{"abc_from":"FAIL","abc_to":"FAIL","abc_tracks_from":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"abc_tracks_to":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"certified_from":"L26","certified_to":"L26","key":"fw_minimax","mastered_from":[],"mastered_to":[],"mastery_changed":false,"model":"MiniMax M3","org":"MiniMax","rank_change":-11,"rank_from":19,"rank_to":30,"score_change":null,"score_from":5.7,"score_to":5.7,"status":"in_both"},{"abc_to":"FAIL","certified_to":"L26","key":"gpt56luna","mastered_to":[],"model":"GPT-5.6 Luna","org":"OpenAI","rank_to":31,"score_to":5.2,"status":"new"},{"abc_from":"FAIL","abc_to":"FAIL","abc_tracks_from":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"abc_tracks_to":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"certified_from":"L26","certified_to":"L26","key":"sonnet5","mastered_from":[],"mastered_to":[],"mastery_changed":false,"model":"Claude Sonnet 5","org":"Anthropic","rank_change":-12,"rank_from":20,"rank_to":32,"score_change":null,"score_from":5.0,"score_to":5.0,"status":"in_both"},{"abc_from":"FAIL","abc_to":"FAIL","abc_tracks_from":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"abc_tracks_to":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"certified_from":"L26","certified_to":"L26","key":"fw_kimi","mastered_from":[],"mastered_to":[],"mastery_changed":false,"model":"Kimi K2.7","org":"Moonshot AI","rank_change":-12,"rank_from":21,"rank_to":33,"score_change":null,"score_from":4.9,"score_to":4.9,"status":"in_both"},{"abc_from":"FAIL","abc_to":"FAIL","abc_tracks_from":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"abc_tracks_to":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"certified_from":"L26","certified_to":"L26","key":"groq","mastered_from":[],"mastered_to":[],"mastery_changed":false,"model":"GPT-OSS 120B","org":"OpenAI","rank_change":-12,"rank_from":22,"rank_to":34,"score_change":null,"score_from":3.9,"score_to":3.9,"status":"in_both"},{"abc_from":"FAIL","abc_to":"FAIL","abc_tracks_from":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"abc_tracks_to":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"certified_from":"L26","certified_to":"L26","key":"cohere","mastered_from":[],"mastered_to":[],"mastery_changed":false,"model":"Command A+","org":"Cohere","rank_change":-12,"rank_from":23,"rank_to":35,"score_change":null,"score_from":3.4,"score_to":3.4,"status":"in_both"},{"abc_to":"FAIL","certified_to":"L26","key":"fw_glm53f","mastered_to":[],"model":"GLM-5.3 Flash","org":"Z.ai / Zhipu","rank_to":36,"score_to":3.1,"status":"new"},{"abc_from":"FAIL","abc_to":"FAIL","abc_tracks_from":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"abc_tracks_to":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"certified_from":"L26","certified_to":"L26","key":"inkling","mastered_from":[],"mastered_to":[],"mastery_changed":false,"model":"Inkling","org":"Thinking Machines Lab","rank_change":-13,"rank_from":24,"rank_to":37,"score_change":null,"score_from":3.0,"score_to":3.0,"status":"in_both"},{"abc_to":"FAIL","certified_to":"L26","key":"fw_muse","mastered_to":[],"model":"Muse Glimmer 30B","org":"Meta","rank_to":38,"score_to":2.0,"status":"new"},{"abc_to":"FAIL","certified_to":"L26","key":"fw_nemolight","mastered_to":[],"model":"Nemotron Lightning 3.5 30B","org":"NVIDIA","rank_to":39,"score_to":1.5,"status":"new"},{"abc_from":"FAIL","abc_to":"FAIL","abc_tracks_from":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"abc_tracks_to":{"bem":"FAIL","kin":"FAIL","lue":"FAIL"},"certified_from":"L26","certified_to":"L26","key":"phi","mastered_from":[],"mastered_to":[],"mastery_changed":false,"model":"Phi-4-reasoning","org":"Microsoft","rank_change":-15,"rank_from":25,"rank_to":40,"score_change":null,"score_from":0.2,"score_to":0.2,"status":"in_both"},{"abc_to":"FAIL","certified_to":"L26","key":"grok47","mastered_to":[],"model":"Grok 4.7","org":"SpaceXAI","rank_to":41,"score_to":0.0,"status":"new"},{"abc_to":"FAIL","certified_to":"L26","key":"fw_glm53","mastered_to":[],"model":"GLM-5.3","org":"Z.ai / Zhipu","rank_to":42,"score_to":null,"status":"new"},{"abc_from":"FAIL","key":"fw_deepseek","mastered_from":[],"model":"DeepSeek V4 Pro","org":"DeepSeek","rank_from":10,"score_from":10.0,"status":"not_in_newer"}],"to":{"api_url":"/api/v1/editions/ed16","condition":"blind (R0 \u2014 the true ABC test: object named only, no grammar given)","current":true,"date":"October 14, 2026","graphic_url":"/static/history/ed16.png","id":"ed16","leader":"Gemini 3.6 Flash","leader_score":16.8,"n_cells":1855,"n_models":42,"note":"Added Gemini 4 Argon (Google, released Oct 13). It enters at #2 with a blind Bantu mean of 15.1 (Bemba 15.7, Kinyarwanda 18.0, Luvale 11.6), and 26.0 on all three when scaffolded. Run and certified by the Bantu Capability Index (BCI), under the shared certification protocol (BANTU-CERT 0.1).","rev":"v1.1 \u00b7 rev 4","status":"current","top3":[{"bantu_blind_mean":16.8,"model":"Gemini 3.6 Flash","org":"Google","rank":1},{"bantu_blind_mean":15.1,"model":"Gemini 4 Argon","org":"Google","rank":2},{"bantu_blind_mean":14.7,"model":"Claude Fable 5 \u2021","org":"Anthropic","rank":3}],"url":"/rankings","version":"v1.1"},"url":"/rankings/compare?a=ed03&b=ed16"}