Controlled CivBench on Vox Populi 5.2.7, Civilization V
Matched MapsA controlled version of CivBench (Chen et al., 2026). Each LLM strategists rotate through 3 standard maps (8 players), each game features 2 of the same LLM strategists + 6 Vox Populi AI players. Experimented with 2 conditions: having LLMs make a decision every turn (base); having them make a decision every 5 turns, or when an important event comes up (per-5). baseline_experiment: vanilla-standard-fixed; estimator: attention; strength_table: strength Each cell averages every unique run for its seed, final player position, strategist, and condition; seating rotations and repeated runs contribute equally. The strength table's leading Avg column pools each row's runs. Click a numeric column heading to sort.
Compare strategists and experimental conditions with a VPAI baseline on the same maps and starting positions, so differences in performance can be assessed with the starting setup held constant.
Strategists exceed VPAI strength in 334/744 matched map-and-seat comparisons (44.9%); strength differences range from -0.495 to +0.425.
Click a cell to explore that starting position.
Seed 1
Strength
| Strategist | Condition | Avg | Avg rank | 0: Arabia | 1: The Zulus | 2: China | 3: Brazil | 4: Polynesia | 5: Denmark | 6: Austria | 7: Ethiopia |
|---|---|---|---|---|---|---|---|---|---|---|
| VPAI | 0.50 | #4.5 | 0.50 | 0.50 | 0.50 | 0.50 | 0.50 | 0.50 | 0.50 | 0.50 |
| Null | Every-turn | 0.28 | #5.8 | 0.55 | 0.57 | 0.44 | 0.27 | 0.17 | 0.11 | 0.06 | 0.05 |
| GPT-OSS-120B-Simple | Every-turn | 0.38 | #4.7 | 0.50 | 0.48 | 0.69 | 0.35 | 0.58 | 0.26 | 0.16 | 0.25 |
| GPT-OSS-120B-Simple | Per-5 | 0.37 | #5.2 | 0.57 | 0.39 | 0.53 | 0.26 | 0.59 | 0.07 | 0.31 | 0.24 |
| Opus-5.5-Simple | Per-5 | 0.58 | #3.6 | 0.55 | 0.43 | 0.73 | 0.87 | 0.71 | 0.14 | 0.57 | 0.64 |
| GLM-5.1-Simple | Every-turn | 0.46 | #4.6 | 0.51 | 0.55 | 0.49 | 0.46 | 0.63 | 0.51 | 0.34 | 0.20 |
| GLM-5.2-Simple | Every-turn | 0.47 | #4.6 | 0.50 | 0.54 | 0.75 | 0.43 | 0.71 | 0.04 | 0.43 | 0.39 |
| GLM-5.2-Simple | Per-5 | 0.44 | #4.7 | 0.57 | 0.39 | 0.57 | 0.40 | 0.86 | 0.03 | 0.27 | 0.45 |
| GLM-5.3-Simple | Per-5 | 0.57 | #3.7 | 0.51 | 0.55 | 0.73 | 0.68 | 0.77 | 0.14 | 0.50 | 0.68 |
| GLM-5.3-Flash-Simple | Every-turn | 0.44 | #4.5 | 0.56 | 0.59 | 0.52 | 0.52 | 0.48 | 0.13 | 0.43 | 0.32 |
| GLM-5.3-Flash-Simple | Per-5 | 0.45 | #4.7 | 0.50 | 0.50 | 0.51 | 0.49 | 0.69 | 0.26 | 0.32 | 0.34 |
| MiniMax-M2.7-Simple | Every-turn | 0.46 | #4.4 | 0.67 | 0.48 | 0.49 | 0.50 | 0.48 | 0.10 | 0.38 | 0.56 |
| MiniMax-M2.7-Simple | Per-5 | 0.46 | #4.5 | 0.51 | 0.72 | 0.45 | 0.58 | 0.33 | 0.15 | 0.54 | 0.43 |
| MiniMax-M3-Simple | Per-5 | 0.48 | #4.6 | 0.50 | 0.49 | 0.72 | 0.32 | 0.64 | 0.19 | 0.40 | 0.57 |
| Kimi-K2.7-Simple | Every-turn | 0.47 | #4.7 | 0.52 | 0.50 | 0.62 | 0.68 | 0.62 | 0.09 | 0.39 | 0.38 |
| Kimi-K2.7-Simple | Per-5 | 0.49 | #4.1 | 0.51 | 0.51 | 0.65 | 0.55 | 0.55 | 0.22 | 0.46 | 0.44 |
| Kimi-K2.6-Simple | Every-turn | 0.51 | #4.1 | 0.53 | 0.44 | 0.57 | 0.63 | 0.92 | 0.23 | 0.46 | 0.33 |
| DeepSeek-V4-Flash-Simple | Every-turn | 0.45 | #4.6 | 0.51 | 0.45 | 0.72 | 0.60 | 0.55 | 0.11 | 0.36 | 0.28 |
| DeepSeek-V4-Flash-Simple | Per-5 | 0.48 | #4.1 | 0.72 | 0.42 | 0.66 | 0.30 | 0.75 | 0.07 | 0.63 | 0.33 |
| DeepSeek-V4.1-Flash-Simple | Per-5 | 0.46 | #4.6 | 0.50 | 0.48 | 0.68 | 0.51 | 0.77 | 0.05 | 0.55 | 0.11 |
| Qwen-3.5-Simple | Every-turn | 0.46 | #5.1 | 0.50 | 0.43 | 0.60 | 0.29 | 0.71 | 0.13 | 0.56 | 0.45 |
| Qwen-3.5-Simple | Per-5 | 0.40 | #4.9 | 0.51 | 0.58 | 0.51 | 0.56 | 0.27 | 0.21 | 0.42 | 0.18 |
| Qwen-3.6-27B-Simple | Every-turn | 0.37 | #5.2 | 0.49 | 0.54 | 0.56 | 0.31 | 0.42 | 0.04 | 0.17 | 0.46 |
| Qwen-3.6-27B-Simple | Per-5 | 0.38 | #5.2 | 0.49 | 0.47 | 0.48 | 0.23 | 0.49 | 0.16 | 0.35 | 0.38 |
| Qwen-3.8-27B-Simple | Every-turn | 0.47 | #4.4 | 0.56 | 0.51 | 0.70 | 0.43 | 0.66 | 0.20 | 0.30 | 0.39 |
| Qwen-3.8-27B-Simple | Per-5 | 0.47 | #4.6 | 0.50 | 0.68 | 0.65 | 0.51 | 0.46 | 0.18 | 0.33 | 0.42 |
| Qwen-3.8-Flash-Next-Simple | Per-5 | 0.42 | #5.1 | 0.62 | 0.63 | 0.52 | 0.43 | 0.56 | 0.10 | 0.22 | 0.39 |
| Gemma-4-Simple | Every-turn | 0.43 | #4.8 | 0.50 | 0.50 | 0.50 | 0.63 | 0.28 | 0.24 | 0.46 | 0.37 |
| Gemma-4-Simple | Per-5 | 0.42 | #4.9 | 0.52 | 0.43 | 0.53 | 0.58 | 0.33 | 0.25 | 0.36 | 0.35 |
| GPT-6-Luna-Simple | Per-5 | 0.50 | #4.1 | 0.53 | 0.44 | 0.59 | 0.67 | 0.57 | 0.23 | 0.55 | 0.44 |
| Nemotron-3-Super-Simple | Every-turn | 0.41 | #5.3 | 0.50 | 0.52 | 0.66 | 0.34 | 0.54 | 0.08 | 0.12 | 0.56 |
| Nemotron-3-Super-Simple | Per-5 | 0.43 | #4.6 | 0.89 | 0.47 | 0.54 | 0.36 | 0.49 | 0.04 | 0.20 | 0.42 |
| VPAI | Every-turn | 0.47 | #4.5 | 0.55 | 0.56 | 0.52 | 0.48 | 0.51 | 0.32 | 0.43 | 0.41 |
- 0
- 0.25
- 0.5
- 0.75
- 1
Focus
- Domination
- Culture
- Diplomatic
- Science
Strategy
| Strategist | Condition | Military | Nuclear | Naval and air | Economy | Other | |||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Off | Def | CDef | Mob | MTrn | Rec | Rng | Mobl | Nuke | UNuk | Nav | NRec | Air | AA | Carr | Lift | Exp | Gro | Tile | Infr | Prod | Gold | Sci | Cul | Hap | NGro | NTile | WCon | GP | Wond | Rel | Dip | Esp | Spc | |
| Completed-experiment average | 38 | 61 | 58 | 49 | 57 | 44 | 52 | 44 | 33 | 26 | 51 | 42 | 40 | 40 | 28 | 29 | 41 | 66 | 63 | 63 | 75 | 70 | 76 | 68 | 71 | 42 | 41 | 45 | 68 | 46 | 47 | 70 | 54 | 41 |
| GPT-OSS-120B-Simple | Every-turn | 16 | 34 | 29 | 26 | 30 | 42 | 23 | 23 | 0 | 0 | 43 | 35 | 6 | 2 | 1 | 2 | 53 | 67 | 57 | 68 | 79 | 64 | 67 | 77 | 87 | 46 | 35 | 53 | 87 | 70 | 51 | 90 | 74 | 18 |
| GPT-OSS-120B-Simple | Per-5 | 27 | 37 | 38 | 39 | 40 | 44 | 33 | 37 | 14 | 14 | 51 | 43 | 20 | 15 | 10 | 17 | 52 | 64 | 56 | 65 | 80 | 64 | 65 | 70 | 79 | 53 | 44 | 50 | 79 | 61 | 47 | 82 | 64 | 24 |
| Opus-5.5-Simple | Per-5 | 30 | 57 | 60 | 42 | 51 | 20 | 56 | 45 | 30 | 22 | 49 | 41 | 50 | 52 | 46 | 49 | 42 | 62 | 60 | 54 | 62 | 57 | 68 | 68 | 62 | 51 | 52 | 50 | 62 | 48 | 48 | 57 | 51 | 51 |
| GLM-5.1-Simple | Every-turn | 60 | 81 | 77 | 75 | 81 | 54 | 78 | 65 | 84 | 28 | 69 | 49 | 58 | 56 | 17 | 20 | 33 | 83 | 79 | 80 | 94 | 87 | 92 | 79 | 86 | 50 | 43 | 58 | 67 | 36 | 53 | 84 | 67 | 40 |
| GLM-5.2-Simple | Every-turn | 44 | 73 | 66 | 64 | 64 | 48 | 59 | 49 | 33 | 9 | 52 | 41 | 41 | 39 | 10 | 17 | 41 | 72 | 71 | 71 | 87 | 82 | 89 | 74 | 81 | 38 | 38 | 46 | 71 | 46 | 49 | 81 | 54 | 36 |
| GLM-5.2-Simple | Per-5 | 44 | 69 | 63 | 58 | 59 | 49 | 59 | 50 | 32 | 18 | 51 | 45 | 46 | 47 | 38 | 39 | 50 | 70 | 68 | 68 | 84 | 78 | 86 | 74 | 78 | 45 | 45 | 48 | 69 | 54 | 57 | 75 | 54 | 44 |
| GLM-5.3-Simple | Per-5 | 55 | 65 | 58 | 55 | 64 | 47 | 62 | 55 | 20 | 15 | 62 | 53 | 53 | 51 | 34 | 37 | 45 | 63 | 67 | 60 | 69 | 72 | 78 | 73 | 71 | 52 | 52 | 53 | 65 | 55 | 62 | 70 | 55 | 44 |
| GLM-5.3-Flash-Simple | Every-turn | 41 | 59 | 55 | 51 | 55 | 48 | 58 | 51 | 38 | 39 | 58 | 49 | 54 | 53 | 49 | 50 | 44 | 67 | 62 | 51 | 58 | 62 | 65 | 63 | 65 | 51 | 51 | 51 | 61 | 48 | 56 | 63 | 56 | 51 |
| GLM-5.3-Flash-Simple | Per-5 | 44 | 56 | 54 | 50 | 56 | 46 | 56 | 50 | 52 | 50 | 56 | 49 | 56 | 55 | 49 | 49 | 43 | 66 | 60 | 50 | 57 | 60 | 63 | 60 | 61 | 49 | 50 | 50 | 59 | 49 | 52 | 58 | 55 | 49 |
| MiniMax-M2.7-Simple | Every-turn | 59 | 57 | 63 | 53 | 69 | 52 | 56 | 57 | 57 | 40 | 55 | 50 | 51 | 51 | 50 | 50 | 58 | 52 | 50 | 49 | 61 | 59 | 65 | 73 | 64 | 51 | 49 | 52 | 69 | 51 | 57 | 74 | 78 | 52 |
| MiniMax-M2.7-Simple | Per-5 | 56 | 52 | 54 | 51 | 61 | 46 | 52 | 56 | 50 | 52 | 58 | 53 | 46 | 50 | 50 | 50 | 60 | 54 | 49 | 50 | 58 | 53 | 61 | 73 | 58 | 49 | 47 | 50 | 73 | 50 | 52 | 63 | 71 | 52 |
| MiniMax-M3-Simple | Per-5 | 43 | 61 | 59 | 44 | 52 | 52 | 50 | 46 | 45 | 43 | 51 | 47 | 37 | 39 | 36 | 36 | 62 | 71 | 62 | 50 | 77 | 59 | 66 | 75 | 62 | 44 | 44 | 45 | 74 | 72 | 57 | 52 | 47 | 34 |
| Kimi-K2.7-Simple | Every-turn | 26 | 71 | 68 | 55 | 68 | 42 | 65 | 40 | 54 | 28 | 50 | 40 | 58 | 61 | 13 | 24 | 32 | 74 | 70 | 73 | 89 | 73 | 89 | 60 | 80 | 33 | 29 | 40 | 67 | 26 | 32 | 65 | 56 | 51 |
| Kimi-K2.7-Simple | Per-5 | 34 | 68 | 66 | 55 | 66 | 43 | 64 | 47 | 30 | 21 | 55 | 46 | 50 | 52 | 15 | 16 | 30 | 76 | 70 | 73 | 87 | 74 | 86 | 65 | 78 | 41 | 36 | 46 | 72 | 38 | 39 | 66 | 61 | 44 |
| Kimi-K2.6-Simple | Every-turn | 37 | 68 | 65 | 56 | 67 | 44 | 67 | 51 | 20 | 15 | 52 | 43 | 45 | 41 | 15 | 16 | 27 | 76 | 68 | 75 | 89 | 76 | 87 | 60 | 81 | 40 | 35 | 47 | 67 | 25 | 38 | 61 | 59 | 47 |
| DeepSeek-V4-Flash-Simple | Every-turn | 46 | 64 | 58 | 56 | 60 | 51 | 54 | 51 | 58 | 55 | 54 | 51 | 53 | 52 | 50 | 50 | 49 | 62 | 57 | 56 | 65 | 59 | 76 | 64 | 67 | 51 | 51 | 50 | 58 | 50 | 55 | 62 | 53 | 52 |
| DeepSeek-V4-Flash-Simple | Per-5 | 51 | 61 | 58 | 58 | 61 | 50 | 56 | 51 | 54 | 55 | 53 | 51 | 52 | 52 | 50 | 50 | 48 | 61 | 57 | 55 | 65 | 57 | 77 | 65 | 63 | 51 | 51 | 50 | 61 | 50 | 56 | 60 | 53 | 53 |
| DeepSeek-V4.1-Flash-Simple | Per-5 | 34 | 66 | 65 | 49 | 63 | 54 | 60 | 52 | 43 | 36 | 57 | 51 | 53 | 58 | 48 | 49 | 37 | 72 | 73 | 65 | 73 | 71 | 89 | 84 | 79 | 53 | 53 | 54 | 77 | 52 | 64 | 72 | 62 | 49 |
| Qwen-3.5-Simple | Every-turn | 36 | 65 | 61 | 39 | 57 | 45 | 50 | 48 | 32 | 15 | 53 | 45 | 41 | 43 | 20 | 21 | 38 | 69 | 68 | 69 | 71 | 82 | 72 | 68 | 78 | 48 | 44 | 48 | 77 | 47 | 47 | 83 | 57 | 30 |
| Qwen-3.5-Simple | Per-5 | 37 | 64 | 62 | 42 | 60 | 44 | 55 | 51 | 44 | 41 | 56 | 50 | 49 | 53 | 38 | 40 | 42 | 66 | 66 | 66 | 68 | 76 | 70 | 65 | 76 | 51 | 49 | 50 | 74 | 48 | 50 | 73 | 61 | 40 |
| Qwen-3.6-27B-Simple | Every-turn | 29 | 62 | 59 | 48 | 46 | 26 | 36 | 25 | 13 | 1 | 44 | 25 | 12 | 13 | 2 | 2 | 25 | 46 | 47 | 59 | 68 | 78 | 71 | 59 | 52 | 15 | 13 | 17 | 49 | 22 | 23 | 65 | 42 | 26 |
| Qwen-3.6-27B-Simple | Per-5 | 27 | 63 | 61 | 45 | 48 | 26 | 40 | 27 | 13 | 2 | 45 | 25 | 11 | 11 | 2 | 2 | 29 | 55 | 54 | 61 | 69 | 79 | 72 | 63 | 58 | 20 | 16 | 21 | 52 | 29 | 26 | 55 | 37 | 26 |
| Qwen-3.8-27B-Simple | Every-turn | 25 | 51 | 48 | 31 | 39 | 33 | 34 | 26 | 0 | 0 | 33 | 17 | 8 | 6 | 0 | 0 | 34 | 65 | 61 | 63 | 79 | 72 | 72 | 62 | 59 | 17 | 16 | 22 | 58 | 33 | 36 | 84 | 31 | 19 |
| Qwen-3.8-27B-Simple | Per-5 | 21 | 46 | 46 | 28 | 37 | 28 | 36 | 23 | 0 | 0 | 33 | 18 | 4 | 5 | 1 | 1 | 34 | 65 | 60 | 60 | 78 | 69 | 73 | 63 | 57 | 22 | 20 | 23 | 60 | 36 | 34 | 80 | 28 | 29 |
| Qwen-3.8-Flash-Next-Simple | Per-5 | 16 | 46 | 46 | 26 | 35 | 20 | 35 | 22 | 19 | 9 | 36 | 22 | 23 | 25 | 15 | 18 | 33 | 70 | 63 | 65 | 81 | 70 | 76 | 60 | 61 | 33 | 33 | 42 | 69 | 28 | 37 | 76 | 36 | 42 |
| Gemma-4-Simple | Every-turn | 59 | 75 | 70 | 79 | 77 | 57 | 61 | 53 | 66 | 63 | 69 | 58 | 70 | 65 | 57 | 54 | 36 | 65 | 67 | 73 | 80 | 79 | 77 | 64 | 74 | 52 | 53 | 51 | 57 | 48 | 55 | 61 | 53 | 50 |
| Gemma-4-Simple | Per-5 | 61 | 72 | 66 | 72 | 73 | 60 | 58 | 53 | 69 | 55 | 63 | 53 | 63 | 54 | 53 | 49 | 46 | 70 | 68 | 72 | 75 | 73 | 76 | 67 | 70 | 52 | 53 | 49 | 55 | 51 | 52 | 57 | 51 | 53 |
| GPT-6-Luna-Simple | Per-5 | 15 | 72 | 65 | 33 | 58 | 41 | 59 | 49 | 40 | 38 | 48 | 45 | 61 | 63 | 47 | 48 | 20 | 61 | 61 | 56 | 86 | 54 | 91 | 55 | 71 | 49 | 50 | 50 | 76 | 19 | 47 | 72 | 63 | 79 |
| Nemotron-3-Super-Simple | Every-turn | 33 | 54 | 55 | 48 | 57 | 55 | 32 | 31 | 0 | 0 | 37 | 32 | 20 | 10 | 4 | 1 | 45 | 73 | 72 | 74 | 86 | 82 | 85 | 80 | 80 | 29 | 31 | 37 | 81 | 70 | 44 | 79 | 47 | 32 |
| Nemotron-3-Super-Simple | Per-5 | 37 | 50 | 52 | 45 | 57 | 54 | 38 | 38 | 21 | 21 | 43 | 34 | 11 | 6 | 6 | 6 | 42 | 73 | 75 | 71 | 81 | 79 | 82 | 76 | 78 | 31 | 33 | 35 | 80 | 69 | 49 | 76 | 49 | 29 |
- 0 forbid
- 30 enough
- 50 balanced (in-game AI)
- 70 prioritize
- 100 emergency focus
Diplomacy
| Strategist | Condition | Diplomacy | Personality | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Bal | Frd | With | Agst | Loy | Den | Fgv | Mean | Need | Chat | Dec | |
| Matched in-game AI | 6.6 | 7.5 | 7.8 | 7.5 | 4.1 | 5.9 | 4.8 | 7.1 | 7.0 | 3.5 | 6.8 |
| GPT-OSS-120B-Simple | Every-turn | 6.6 | 9.3 | 9.6 | 8.0 | 6.9 | 4.7 | 7.3 | 4.5 | 6.4 | 3.5 | 4.8 |
| GPT-OSS-120B-Simple | Per-5 | 6.7 | 8.8 | 9.3 | 7.5 | 5.2 | 5.0 | 6.2 | 5.5 | 6.7 | 3.9 | 5.7 |
| Opus-5.5-Simple | Per-5 | 6.6 | 7.8 | 8.1 | 7.5 | 6.1 | 5.3 | 5.7 | 4.7 | 6.4 | 4.0 | 5.6 |
| GLM-5.1-Simple | Every-turn | 6.7 | 8.1 | 8.0 | 7.0 | 6.7 | 5.4 | 4.9 | 5.5 | 6.4 | 4.9 | 3.7 |
| GLM-5.2-Simple | Every-turn | 6.8 | 8.4 | 8.4 | 6.9 | 7.1 | 4.4 | 5.7 | 5.1 | 6.2 | 4.7 | 4.7 |
| GLM-5.2-Simple | Per-5 | 6.6 | 8.0 | 8.3 | 7.1 | 6.2 | 4.9 | 5.4 | 5.3 | 6.6 | 4.0 | 5.0 |
| GLM-5.3-Simple | Per-5 | 6.6 | 8.8 | 8.2 | 7.1 | 6.7 | 3.5 | 5.3 | 5.0 | 5.7 | 6.7 | 4.8 |
| GLM-5.3-Flash-Simple | Every-turn | 6.6 | 7.5 | 7.8 | 6.8 | 5.1 | 5.3 | 5.1 | 5.6 | 6.6 | 4.6 | 5.5 |
| GLM-5.3-Flash-Simple | Per-5 | 6.6 | 7.5 | 7.7 | 7.4 | 4.7 | 5.8 | 5.1 | 5.8 | 6.7 | 3.7 | 6.0 |
| MiniMax-M2.7-Simple | Every-turn | 6.6 | 8.1 | 8.7 | 8.0 | 5.5 | 6.7 | 4.9 | 6.3 | 6.9 | 4.9 | 5.9 |
| MiniMax-M2.7-Simple | Per-5 | 6.6 | 7.2 | 8.0 | 7.7 | 5.3 | 6.9 | 4.8 | 7.2 | 6.8 | 4.0 | 6.5 |
| MiniMax-M3-Simple | Per-5 | 6.6 | 7.6 | 7.9 | 7.3 | 4.4 | 6.3 | 4.4 | 7.2 | 6.7 | 5.5 | 6.7 |
| Kimi-K2.7-Simple | Every-turn | 6.7 | 8.1 | 7.6 | 5.9 | 7.2 | 3.4 | 6.4 | 3.5 | 4.4 | 4.8 | 3.8 |
| Kimi-K2.7-Simple | Per-5 | 6.6 | 7.8 | 8.1 | 6.5 | 6.9 | 4.6 | 5.9 | 4.8 | 5.0 | 4.6 | 4.5 |
| Kimi-K2.6-Simple | Every-turn | 6.7 | 7.8 | 8.1 | 7.5 | 6.5 | 5.2 | 5.6 | 4.6 | 4.7 | 4.7 | 4.6 |
| DeepSeek-V4-Flash-Simple | Every-turn | 6.6 | 7.5 | 7.8 | 7.5 | 4.5 | 5.9 | 4.8 | 6.0 | 6.9 | 3.5 | 6.2 |
| DeepSeek-V4-Flash-Simple | Per-5 | 6.6 | 7.5 | 7.8 | 7.5 | 4.3 | 5.7 | 4.8 | 6.3 | 6.8 | 3.5 | 6.4 |
| DeepSeek-V4.1-Flash-Simple | Per-5 | 6.6 | 7.8 | 7.9 | 6.8 | 5.1 | 4.7 | 5.1 | 4.6 | 6.4 | 3.6 | 5.2 |
| Qwen-3.5-Simple | Every-turn | 6.7 | 8.4 | 8.7 | 7.5 | 7.7 | 4.8 | 6.4 | 4.0 | 4.9 | 7.2 | 4.0 |
| Qwen-3.5-Simple | Per-5 | 6.7 | 8.1 | 8.3 | 7.8 | 7.3 | 5.1 | 6.2 | 4.2 | 4.9 | 6.6 | 4.5 |
| Qwen-3.6-27B-Simple | Every-turn | 6.7 | 6.9 | 8.0 | 7.9 | 5.9 | 4.4 | 6.4 | 4.6 | 5.5 | 4.8 | 4.8 |
| Qwen-3.6-27B-Simple | Per-5 | 6.7 | 7.4 | 8.4 | 7.4 | 6.3 | 4.8 | 6.1 | 4.8 | 5.9 | 4.6 | 4.8 |
| Qwen-3.8-27B-Simple | Every-turn | 6.8 | 8.2 | 8.7 | 6.8 | 7.8 | 3.4 | 7.3 | 4.0 | 5.8 | 5.4 | 3.6 |
| Qwen-3.8-27B-Simple | Per-5 | 6.7 | 7.9 | 8.3 | 6.4 | 7.7 | 3.1 | 7.1 | 3.7 | 5.8 | 5.4 | 3.3 |
| Qwen-3.8-Flash-Next-Simple | Per-5 | 6.6 | 7.2 | 8.3 | 6.2 | 6.7 | 3.0 | 5.7 | 3.4 | 5.8 | 8.0 | 4.0 |
| Gemma-4-Simple | Every-turn | 6.6 | 7.2 | 7.8 | 7.5 | 5.0 | 5.7 | 4.8 | 6.2 | 6.8 | 3.7 | 6.3 |
| Gemma-4-Simple | Per-5 | 6.6 | 7.3 | 7.7 | 7.5 | 4.4 | 5.8 | 4.7 | 6.5 | 6.7 | 3.5 | 6.7 |
| GPT-6-Luna-Simple | Per-5 | 6.7 | 8.0 | 9.1 | 7.7 | 7.9 | 4.3 | 6.4 | 3.2 | 5.1 | 3.9 | 3.6 |
| Nemotron-3-Super-Simple | Every-turn | 6.7 | 8.5 | 8.8 | 7.0 | 7.5 | 4.2 | 7.4 | 4.3 | 6.1 | 4.2 | 5.7 |
| Nemotron-3-Super-Simple | Per-5 | 6.6 | 8.2 | 8.4 | 6.7 | 6.2 | 4.7 | 6.8 | 5.3 | 6.6 | 4.0 | 5.7 |
- 1 lowest
- 4
- 5.5 middle
- 7
- 10 highest
Commitment
| Strategist | Condition | Acts % | Revises % | Touched | Step | Net % | Persona |
|---|---|---|---|---|---|---|
| Completed-experiment average | 58 | 51 | 6.2 | 9.1 | 27 | 5.9 |
| GPT-OSS-120B-Simple | Every-turn | 94 | 41 | 4.7 | 13.9 | 12 | 13.5 |
| GPT-OSS-120B-Simple | Per-5 | 28 | 60 | 5.6 | 13.9 | 21 | 6.1 |
| Opus-5.5-Simple | Per-5 | 32 | 41 | 5.9 | 6.5 | 33 | 1.0 |
| GLM-5.1-Simple | Every-turn | 93 | 79 | 4.7 | 5.2 | 19 | 2.9 |
| GLM-5.2-Simple | Every-turn | 96 | 38 | 4.3 | 8.0 | 25 | 4.1 |
| GLM-5.2-Simple | Per-5 | 29 | 53 | 4.6 | 7.6 | 46 | 1.7 |
| GLM-5.3-Simple | Per-5 | 31 | 76 | 3.0 | 8.8 | 32 | 4.8 |
| GLM-5.3-Flash-Simple | Every-turn | 93 | 13 | 2.8 | 8.5 | 43 | 1.6 |
| GLM-5.3-Flash-Simple | Per-5 | 32 | 29 | 3.6 | 8.1 | 44 | 0.7 |
| MiniMax-M2.7-Simple | Every-turn | 98 | 10 | 2.9 | 11.1 | 47 | 4.5 |
| MiniMax-M2.7-Simple | Per-5 | 30 | 20 | 3.1 | 11.0 | 52 | 2.5 |
| MiniMax-M3-Simple | Per-5 | 30 | 16 | 4.9 | 12.0 | 71 | 3.4 |
| Kimi-K2.7-Simple | Every-turn | 96 | 62 | 9.0 | 9.4 | 6 | 8.2 |
| Kimi-K2.7-Simple | Per-5 | 30 | 80 | 10.6 | 9.1 | 11 | 4.1 |
| Kimi-K2.6-Simple | Every-turn | 93 | 52 | 7.5 | 10.5 | 10 | 6.7 |
| DeepSeek-V4-Flash-Simple | Every-turn | 97 | 12 | 4.8 | 4.8 | 39 | 0.8 |
| DeepSeek-V4-Flash-Simple | Per-5 | 31 | 41 | 5.0 | 4.1 | 39 | 0.4 |
| DeepSeek-V4.1-Flash-Simple | Per-5 | 30 | 68 | 6.4 | 4.2 | 33 | 1.2 |
| Qwen-3.5-Simple | Every-turn | 99 | 60 | 6.1 | 6.4 | 10 | 18.6 |
| Qwen-3.5-Simple | Per-5 | 32 | 72 | 7.8 | 6.4 | 16 | 10.1 |
| Qwen-3.6-27B-Simple | Every-turn | 99 | 55 | 10.1 | 7.2 | 8 | 12.6 |
| Qwen-3.6-27B-Simple | Per-5 | 29 | 75 | 12.2 | 7.6 | 14 | 5.4 |
| Qwen-3.8-27B-Simple | Every-turn | 98 | 67 | 6.4 | 8.6 | 10 | 18.3 |
| Qwen-3.8-27B-Simple | Per-5 | 30 | 87 | 9.6 | 8.8 | 15 | 10.6 |
| Qwen-3.8-Flash-Next-Simple | Per-5 | 30 | 94 | 14.0 | 5.0 | 15 | 19.2 |
| Gemma-4-Simple | Every-turn | 97 | 13 | 2.3 | 19.1 | 32 | 1.2 |
| Gemma-4-Simple | Per-5 | 30 | 36 | 2.6 | 16.1 | 36 | 0.9 |
| GPT-6-Luna-Simple | Per-5 | 31 | 80 | 7.1 | 5.4 | 22 | 3.6 |
| Nemotron-3-Super-Simple | Every-turn | 83 | 35 | 6.7 | 13.5 | 11 | 4.7 |
| Nemotron-3-Super-Simple | Per-5 | 29 | 45 | 7.1 | 12.5 | 27 | 1.9 |
- 2 SD below the average strategist
- 1 SD below
- average
- 1 SD above
- 2 SD above
Grand strategy
| Strategist | Condition | 0: Arabia | 1: The Zulus | 2: China | 3: Brazil | 4: Polynesia | 5: Denmark | 6: Austria | 7: Ethiopia |
|---|---|---|---|---|---|---|---|---|
| Null | Spaceship 47% | Spaceship 54% | Spaceship 56% | Spaceship 41% | United Nations 51% | Conquest 50% | Spaceship 53% | Spaceship 64% |
| Vanilla | Culture 37% | Conquest 70% | Spaceship 55% | Spaceship 74% | United Nations 67% | Conquest 78% | United Nations 38% | Spaceship 67% |
| GPT-OSS-120B-Simple | Every-turn | United Nations 57% | Conquest 52% | Spaceship 54% | United Nations 52% | United Nations 48% | Conquest 51% | United Nations 53% | United Nations 67% |
| GPT-OSS-120B-Simple | Per-5 | United Nations 50% | Conquest 78% | Spaceship 52% | Culture 100% | Conquest 64% | Spaceship 43% | United Nations 61% | United Nations 59% |
| Opus-5.5-Simple | Per-5 | Culture 50% | Conquest 70% | Culture 100% | Culture 100% | Culture 100% | Spaceship 80% | United Nations 100% | Culture 100% |
| GLM-5.1-Simple | Every-turn | Spaceship 91% | Conquest 100% | Spaceship 59% | Culture 80% | Culture 100% | Conquest 100% | United Nations 64% | Culture 100% |
| GLM-5.2-Simple | Every-turn | Spaceship 100% | Conquest 87% | Spaceship 89% | Culture 100% | Culture 100% | Conquest 87% | United Nations 98% | Culture 100% |
| GLM-5.2-Simple | Per-5 | Spaceship 100% | Conquest 100% | Spaceship 50% | Culture 100% | Culture 100% | Conquest 67% | United Nations 100% | Culture 93% |
| GLM-5.3-Simple | Per-5 | Spaceship 100% | Conquest 100% | Spaceship 88% | Culture 100% | Culture 67% | Conquest 83% | United Nations 100% | Culture 100% |
| GLM-5.3-Flash-Simple | Every-turn | Culture 98% | Conquest 96% | Spaceship 100% | Culture 100% | Culture 50% | Conquest 80% | Culture 89% | Culture 100% |
| GLM-5.3-Flash-Simple | Per-5 | Culture 50% | Conquest 100% | Spaceship 81% | Culture 100% | Culture 100% | Conquest 100% | Culture 100% | Culture 95% |
| MiniMax-M2.7-Simple | Every-turn | Culture 100% | Conquest 100% | Spaceship 50% | Culture 100% | United Nations 47% | Conquest 100% | Culture 100% | Culture 100% |
| MiniMax-M2.7-Simple | Per-5 | Culture 100% | Conquest 100% | Spaceship 100% | Culture 100% | Culture 100% | Conquest 100% | Culture 100% | Culture 100% |
| MiniMax-M3-Simple | Per-5 | Culture 100% | Conquest 100% | Culture 99% | Culture 98% | Culture 97% | Conquest 100% | Culture 100% | Culture 100% |
| Kimi-K2.7-Simple | Every-turn | Spaceship 99% | Conquest 80% | Spaceship 90% | Culture 69% | Culture 59% | Spaceship 56% | United Nations 74% | Culture 75% |
| Kimi-K2.7-Simple | Per-5 | Spaceship 99% | Conquest 100% | Culture 50% | Culture 100% | Culture 77% | Conquest 80% | United Nations 100% | Spaceship 74% |
| Kimi-K2.6-Simple | Every-turn | Spaceship 95% | Conquest 93% | Spaceship 100% | Culture 100% | United Nations 57% | Conquest 91% | United Nations 90% | Spaceship 72% |
| DeepSeek-V4-Flash-Simple | Every-turn | Spaceship 100% | Conquest 88% | Spaceship 87% | Culture 100% | Culture 100% | Conquest 67% | United Nations 100% | Culture 100% |
| DeepSeek-V4-Flash-Simple | Per-5 | Spaceship 100% | Conquest 100% | Spaceship 63% | Culture 100% | Culture 100% | Conquest 88% | United Nations 100% | Culture 100% |
| DeepSeek-V4.1-Flash-Simple | Per-5 | United Nations 50% | Conquest 100% | Spaceship 96% | Culture 100% | Culture 100% | Conquest 65% | United Nations 100% | Culture 100% |
| Qwen-3.5-Simple | Every-turn | Culture 58% | Conquest 77% | United Nations 40% | Culture 85% | Culture 96% | Conquest 69% | United Nations 91% | Spaceship 44% |
| Qwen-3.5-Simple | Per-5 | Spaceship 68% | Conquest 100% | Spaceship 72% | Culture 100% | Culture 74% | Conquest 69% | United Nations 100% | Culture 54% |
| Qwen-3.6-27B-Simple | Every-turn | Culture 83% | Conquest 100% | Spaceship 70% | Culture 72% | Culture 54% | Conquest 50% | United Nations 72% | Spaceship 71% |
| Qwen-3.6-27B-Simple | Per-5 | Culture 50% | Conquest 100% | Spaceship 55% | Culture 93% | Culture 100% | Spaceship 50% | United Nations 93% | Culture 72% |
| Qwen-3.8-27B-Simple | Every-turn | Culture 100% | Conquest 47% | Culture 56% | Spaceship 45% | Culture 54% | Conquest 54% | United Nations 92% | Spaceship 44% |
| Qwen-3.8-27B-Simple | Per-5 | Spaceship 60% | Conquest 42% | Spaceship 76% | Culture 56% | Culture 75% | Spaceship 46% | United Nations 87% | Culture 81% |
| Qwen-3.8-Flash-Next-Simple | Per-5 | Spaceship 95% | Conquest 100% | Spaceship 80% | Culture 100% | Culture 100% | Conquest 33% | United Nations 81% | Culture 52% |
| Gemma-4-Simple | Every-turn | Spaceship 100% | Conquest 100% | Spaceship 80% | Culture 100% | Culture 79% | Conquest 100% | United Nations 100% | Culture 98% |
| Gemma-4-Simple | Per-5 | Spaceship 100% | Conquest 100% | Spaceship 100% | Culture 88% | Culture 100% | Conquest 70% | Culture 50% | Culture 100% |
| GPT-6-Luna-Simple | Per-5 | Spaceship 100% | Conquest 52% | Spaceship 100% | Culture 100% | Spaceship 100% | Spaceship 75% | Spaceship 77% | Spaceship 100% |
| Nemotron-3-Super-Simple | Every-turn | Spaceship 75% | Conquest 81% | Culture 50% | Culture 70% | Culture 100% | Conquest 51% | Culture 99% | Spaceship 64% |
| Nemotron-3-Super-Simple | Per-5 | Culture 77% | Conquest 79% | Culture 48% | Spaceship 55% | Culture 100% | Conquest 74% | United Nations 57% | Culture 50% |
- Conquest
- Culture
- United Nations
- Spaceship
Policies
| Strategist | Condition | Ancient | Medieval | Industrial | Ideology | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Trad | Auth | Prog | Feal | Stat | Art | Ind | Imp | Rat | Free | Auto | Ord | |
| Matched in-game AI | 75 | 25 | 0 | 39 | 16 | 45 | 14 | 25 | 59 | 27 | 25 | 44 |
| Null | 94 | 100 | 94 | 81 | 62 | 75 | 50 | 50 | 19 | 25 | 25 | 50 |
| GPT-OSS-120B-Simple | Every-turn | 100 | 100 | 100 | 94 | 100 | 94 | 88 | 75 | 88 | 31 | 12 | 56 |
| GPT-OSS-120B-Simple | Per-5 | 100 | 81 | 100 | 100 | 100 | 81 | 88 | 44 | 94 | 6 | 25 | 56 |
| Opus-5.5-Simple | Per-5 | 56 | 19 | 38 | 25 | 25 | 56 | 31 | 6 | 100 | 6 | 19 | 75 |
| GLM-5.1-Simple | Every-turn | 56 | 25 | 69 | 38 | 38 | 69 | 12 | 38 | 69 | 12 | 25 | 50 |
| GLM-5.2-Simple | Every-turn | 50 | 25 | 62 | 44 | 38 | 56 | 25 | 25 | 81 | 31 | 6 | 56 |
| GLM-5.2-Simple | Per-5 | 62 | 25 | 88 | 31 | 44 | 69 | 25 | 19 | 81 | 6 | 19 | 56 |
| GLM-5.3-Simple | Per-5 | 44 | 25 | 50 | 50 | 19 | 56 | 19 | 31 | 81 | 19 | 19 | 69 |
| GLM-5.3-Flash-Simple | Every-turn | 88 | 25 | 88 | 69 | 38 | 75 | 38 | 25 | 100 | 19 | 25 | 69 |
| GLM-5.3-Flash-Simple | Per-5 | 81 | 38 | 81 | 81 | 25 | 75 | 12 | 38 | 94 | 6 | 25 | 69 |
| MiniMax-M2.7-Simple | Every-turn | 69 | 25 | 12 | 56 | 6 | 50 | 0 | 19 | 69 | 25 | 19 | 62 |
| MiniMax-M2.7-Simple | Per-5 | 75 | 25 | 25 | 31 | 19 | 62 | 12 | 19 | 56 | 19 | 44 | 50 |
| MiniMax-M3-Simple | Per-5 | 88 | 38 | 12 | 62 | 50 | 75 | 94 | 38 | 44 | 19 | 25 | 56 |
| Kimi-K2.7-Simple | Every-turn | 38 | 25 | 81 | 56 | 19 | 56 | 12 | 25 | 69 | 25 | 12 | 69 |
| Kimi-K2.7-Simple | Per-5 | 25 | 25 | 75 | 69 | 44 | 38 | 25 | 44 | 81 | 19 | 25 | 69 |
| Kimi-K2.6-Simple | Every-turn | 44 | 25 | 88 | 44 | 50 | 62 | 44 | 25 | 81 | 31 | 25 | 50 |
| DeepSeek-V4-Flash-Simple | Every-turn | 38 | 25 | 88 | 50 | 38 | 38 | 31 | 12 | 100 | 25 | 19 | 56 |
| DeepSeek-V4-Flash-Simple | Per-5 | 38 | 25 | 88 | 56 | 25 | 56 | 25 | 31 | 88 | 19 | 19 | 75 |
| DeepSeek-V4.1-Flash-Simple | Per-5 | 56 | 25 | 25 | 19 | 25 | 56 | 31 | 19 | 81 | 6 | 19 | 56 |
| Qwen-3.5-Simple | Every-turn | 75 | 62 | 94 | 69 | 100 | 94 | 69 | 44 | 81 | 31 | 12 | 56 |
| Qwen-3.5-Simple | Per-5 | 88 | 75 | 94 | 100 | 94 | 88 | 62 | 62 | 75 | 19 | 25 | 75 |
| Qwen-3.6-27B-Simple | Every-turn | 100 | 100 | 100 | 69 | 94 | 88 | 62 | 62 | 100 | 12 | 31 | 56 |
| Qwen-3.6-27B-Simple | Per-5 | 100 | 94 | 100 | 69 | 94 | 75 | 62 | 69 | 88 | 12 | 31 | 44 |
| Qwen-3.8-27B-Simple | Every-turn | 75 | 50 | 100 | 62 | 94 | 81 | 56 | 44 | 50 | 19 | 19 | 62 |
| Qwen-3.8-27B-Simple | Per-5 | 75 | 50 | 100 | 69 | 88 | 88 | 44 | 50 | 44 | 19 | 19 | 56 |
| Qwen-3.8-Flash-Next-Simple | Per-5 | 89 | 50 | 94 | 89 | 50 | 83 | 56 | 33 | 61 | 6 | 28 | 61 |
| Gemma-4-Simple | Every-turn | 81 | 31 | 94 | 56 | 75 | 44 | 75 | 50 | 94 | 31 | 38 | 44 |
| Gemma-4-Simple | Per-5 | 94 | 50 | 81 | 44 | 69 | 75 | 88 | 62 | 94 | 19 | 31 | 56 |
| GPT-6-Luna-Simple | Per-5 | 19 | 12 | 94 | 62 | 44 | 75 | 38 | 6 | 100 | 19 | 19 | 69 |
| Nemotron-3-Super-Simple | Every-turn | 81 | 44 | 100 | 69 | 81 | 88 | 44 | 12 | 75 | 25 | 38 | 38 |
| Nemotron-3-Super-Simple | Per-5 | 94 | 44 | 100 | 75 | 94 | 75 | 44 | 31 | 81 | 12 | 19 | 56 |
- 0% never
- 50%
- 100% always
Seed 2
Strength
| Strategist | Condition | Avg | Avg rank | 0: The Netherlands | 1: The Ottomans | 2: France | 3: Spain | 4: The Aztecs | 5: Brazil | 6: Arabia | 7: Poland |
|---|---|---|---|---|---|---|---|---|---|---|
| VPAI | 0.50 | #4.5 | 0.50 | 0.50 | 0.50 | 0.50 | 0.50 | 0.49 | 0.50 | 0.50 |
| Null | Every-turn | 0.38 | #5.4 | 0.05 | 0.53 | 0.51 | 0.54 | 0.44 | 0.14 | 0.64 | 0.21 |
| GPT-OSS-120B-Simple | Every-turn | 0.43 | #4.6 | 0.08 | 0.85 | 0.49 | 0.57 | 0.46 | 0.30 | 0.58 | 0.24 |
| GPT-OSS-120B-Simple | Per-5 | 0.42 | #5.0 | 0.02 | 0.47 | 0.50 | 0.58 | 0.55 | 0.19 | 0.70 | 0.37 |
| Opus-5.5-Simple | Per-5 | 0.54 | #4.2 | 0.02 | 0.79 | 0.49 | 0.70 | 0.44 | 0.37 | 0.72 | 0.84 |
| GLM-5.1-Simple | Every-turn | 0.54 | #3.9 | 0.23 | 0.80 | 0.49 | 0.75 | 0.46 | 0.22 | 0.68 | 0.70 |
| GLM-5.2-Simple | Every-turn | 0.55 | #3.7 | 0.01 | 0.66 | 0.66 | 0.84 | 0.44 | 0.72 | 0.51 | 0.59 |
| GLM-5.2-Simple | Per-5 | 0.48 | #4.7 | 0.09 | 0.75 | 0.54 | 0.60 | 0.41 | 0.24 | 0.55 | 0.62 |
| GLM-5.3-Simple | Per-5 | 0.64 | #3.1 | 0.11 | 0.72 | 0.58 | 0.69 | 0.52 | 0.86 | 0.76 | 0.90 |
| GLM-5.3-Flash-Simple | Every-turn | 0.50 | #4.2 | 0.06 | 0.67 | 0.52 | 0.59 | 0.47 | 0.73 | 0.52 | 0.83 |
| GLM-5.3-Flash-Simple | Per-5 | 0.48 | #4.9 | 0.19 | 0.67 | 0.52 | 0.53 | 0.47 | 0.42 | 0.51 | 0.50 |
| MiniMax-M2.7-Simple | Every-turn | 0.47 | #4.4 | 0.15 | 0.32 | 0.74 | 0.49 | 0.50 | 0.57 | 0.58 | 0.38 |
| MiniMax-M2.7-Simple | Per-5 | 0.47 | #4.1 | 0.05 | 0.69 | 0.51 | 0.76 | 0.50 | 0.43 | 0.54 | 0.32 |
| MiniMax-M3-Simple | Per-5 | 0.44 | #4.7 | 0.12 | 0.57 | 0.52 | 0.52 | 0.46 | 0.37 | 0.52 | 0.42 |
| Kimi-K2.7-Simple | Every-turn | 0.57 | #3.7 | 0.08 | 0.71 | 0.51 | 0.91 | 0.52 | 0.59 | 0.62 | 0.63 |
| Kimi-K2.7-Simple | Per-5 | 0.54 | #4.1 | 0.13 | 0.84 | 0.52 | 0.75 | 0.48 | 0.47 | 0.74 | 0.37 |
| Kimi-K2.6-Simple | Every-turn | 0.51 | #4.2 | 0.02 | 0.81 | 0.49 | 0.69 | 0.44 | 0.54 | 0.54 | 0.54 |
| DeepSeek-V4-Flash-Simple | Every-turn | 0.50 | #4.4 | 0.21 | 0.46 | 0.49 | 0.57 | 0.55 | 0.46 | 0.66 | 0.56 |
| DeepSeek-V4-Flash-Simple | Per-5 | 0.50 | #4.6 | 0.03 | 0.49 | 0.52 | 0.69 | 0.45 | 0.40 | 0.67 | 0.71 |
| DeepSeek-V4.1-Flash-Simple | Per-5 | 0.55 | #4.2 | 0.27 | 0.70 | 0.51 | 0.69 | 0.43 | 0.53 | 0.63 | 0.63 |
| Qwen-3.5-Simple | Every-turn | 0.56 | #4.2 | 0.02 | 0.81 | 0.57 | 0.73 | 0.41 | 0.51 | 0.57 | 0.83 |
| Qwen-3.5-Simple | Per-5 | 0.44 | #4.7 | 0.03 | 0.54 | 0.50 | 0.62 | 0.52 | 0.48 | 0.54 | 0.31 |
| Qwen-3.6-27B-Simple | Every-turn | 0.45 | #4.9 | 0.02 | 0.74 | 0.54 | 0.69 | 0.46 | 0.21 | 0.66 | 0.29 |
| Qwen-3.6-27B-Simple | Per-5 | 0.47 | #4.8 | 0.05 | 0.70 | 0.51 | 0.68 | 0.42 | 0.39 | 0.54 | 0.51 |
| Qwen-3.8-27B-Simple | Every-turn | 0.52 | #3.9 | 0.09 | 0.49 | 0.64 | 0.84 | 0.68 | 0.47 | 0.58 | 0.33 |
| Qwen-3.8-27B-Simple | Per-5 | 0.43 | #5.1 | 0.12 | 0.28 | 0.52 | 0.65 | 0.43 | 0.71 | 0.56 | 0.20 |
| Qwen-3.8-Flash-Next-Simple | Per-5 | 0.55 | #4.4 | 0.07 | 0.50 | 0.63 | 0.90 | 0.53 | 0.48 | 0.59 | 0.67 |
| Gemma-4-Simple | Every-turn | 0.41 | #5.1 | 0.01 | 0.54 | 0.59 | 0.53 | 0.43 | 0.22 | 0.71 | 0.29 |
| Gemma-4-Simple | Per-5 | 0.46 | #4.8 | 0.08 | 0.58 | 0.49 | 0.62 | 0.44 | 0.17 | 0.54 | 0.76 |
| GPT-6-Luna-Simple | Per-5 | 0.48 | #4.6 | 0.15 | 0.74 | 0.58 | 0.60 | 0.43 | 0.29 | 0.52 | 0.53 |
| Nemotron-3-Super-Simple | Every-turn | 0.50 | #4.4 | 0.02 | 0.74 | 0.50 | 0.66 | 0.47 | 0.40 | 0.69 | 0.52 |
| Nemotron-3-Super-Simple | Per-5 | 0.48 | #5.0 | 0.01 | 0.45 | 0.66 | 0.57 | 0.41 | 0.62 | 0.51 | 0.64 |
| VPAI | Every-turn | 0.50 | #4.5 | 0.24 | 0.65 | 0.57 | 0.51 | 0.48 | 0.47 | 0.59 | 0.52 |
- 0
- 0.25
- 0.5
- 0.75
- 1
Focus
- Domination
- Culture
- Diplomatic
- Science
Strategy
| Strategist | Condition | Military | Nuclear | Naval and air | Economy | Other | |||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Off | Def | CDef | Mob | MTrn | Rec | Rng | Mobl | Nuke | UNuk | Nav | NRec | Air | AA | Carr | Lift | Exp | Gro | Tile | Infr | Prod | Gold | Sci | Cul | Hap | NGro | NTile | WCon | GP | Wond | Rel | Dip | Esp | Spc | |
| Completed-experiment average | 40 | 61 | 59 | 50 | 57 | 45 | 52 | 45 | 36 | 27 | 48 | 40 | 41 | 41 | 27 | 29 | 44 | 67 | 64 | 64 | 75 | 70 | 77 | 66 | 70 | 41 | 40 | 44 | 66 | 44 | 48 | 69 | 53 | 44 |
| GPT-OSS-120B-Simple | Every-turn | 24 | 39 | 36 | 34 | 39 | 50 | 27 | 30 | 0 | 0 | 47 | 42 | 4 | 1 | 0 | 4 | 63 | 70 | 60 | 70 | 83 | 72 | 75 | 69 | 83 | 52 | 41 | 55 | 80 | 64 | 52 | 90 | 73 | 29 |
| GPT-OSS-120B-Simple | Per-5 | 28 | 43 | 41 | 43 | 44 | 47 | 37 | 37 | 2 | 1 | 49 | 39 | 18 | 10 | 10 | 9 | 57 | 66 | 60 | 66 | 78 | 69 | 68 | 62 | 77 | 51 | 42 | 47 | 75 | 56 | 39 | 82 | 69 | 31 |
| Opus-5.5-Simple | Per-5 | 31 | 59 | 61 | 44 | 49 | 19 | 57 | 43 | 24 | 11 | 47 | 43 | 49 | 51 | 46 | 50 | 42 | 61 | 60 | 53 | 64 | 58 | 67 | 66 | 63 | 51 | 52 | 50 | 61 | 43 | 47 | 55 | 51 | 51 |
| GLM-5.1-Simple | Every-turn | 50 | 72 | 66 | 61 | 72 | 49 | 68 | 59 | 50 | 34 | 60 | 43 | 67 | 54 | 15 | 20 | 35 | 84 | 81 | 81 | 94 | 86 | 92 | 79 | 85 | 48 | 41 | 54 | 69 | 30 | 50 | 84 | 67 | 47 |
| GLM-5.2-Simple | Every-turn | 48 | 68 | 60 | 58 | 60 | 46 | 55 | 48 | 46 | 36 | 50 | 40 | 45 | 48 | 24 | 26 | 47 | 72 | 72 | 72 | 87 | 82 | 89 | 72 | 83 | 40 | 40 | 47 | 68 | 41 | 55 | 79 | 56 | 48 |
| GLM-5.2-Simple | Per-5 | 49 | 66 | 61 | 61 | 60 | 51 | 58 | 53 | 61 | 52 | 53 | 47 | 60 | 57 | 46 | 47 | 52 | 68 | 68 | 67 | 81 | 77 | 84 | 66 | 77 | 46 | 45 | 49 | 65 | 49 | 53 | 71 | 58 | 53 |
| GLM-5.3-Simple | Per-5 | 60 | 63 | 58 | 58 | 65 | 48 | 63 | 58 | 55 | 35 | 62 | 53 | 61 | 58 | 43 | 48 | 53 | 64 | 69 | 61 | 67 | 69 | 75 | 73 | 69 | 51 | 52 | 54 | 62 | 52 | 63 | 68 | 56 | 47 |
| GLM-5.3-Flash-Simple | Every-turn | 46 | 58 | 54 | 49 | 53 | 48 | 57 | 49 | 42 | 38 | 56 | 51 | 54 | 53 | 50 | 50 | 44 | 69 | 62 | 51 | 56 | 60 | 64 | 61 | 65 | 52 | 51 | 51 | 60 | 44 | 61 | 64 | 56 | 51 |
| GLM-5.3-Flash-Simple | Per-5 | 44 | 57 | 54 | 49 | 57 | 44 | 57 | 50 | 46 | 41 | 54 | 49 | 52 | 54 | 50 | 50 | 46 | 68 | 61 | 50 | 56 | 56 | 65 | 59 | 59 | 51 | 50 | 50 | 57 | 40 | 52 | 60 | 55 | 50 |
| MiniMax-M2.7-Simple | Every-turn | 69 | 70 | 70 | 52 | 74 | 52 | 65 | 58 | 39 | 38 | 56 | 55 | 46 | 49 | 47 | 47 | 50 | 52 | 51 | 52 | 65 | 58 | 67 | 75 | 60 | 52 | 51 | 52 | 69 | 54 | 58 | 71 | 77 | 50 |
| MiniMax-M2.7-Simple | Per-5 | 63 | 63 | 55 | 52 | 66 | 53 | 56 | 55 | 33 | 10 | 54 | 48 | 51 | 52 | 50 | 50 | 56 | 55 | 51 | 51 | 61 | 54 | 60 | 70 | 61 | 48 | 50 | 50 | 65 | 57 | 54 | 66 | 72 | 52 |
| MiniMax-M3-Simple | Per-5 | 56 | 62 | 63 | 54 | 67 | 52 | 67 | 55 | 60 | 53 | 39 | 42 | 37 | 42 | 37 | 36 | 59 | 67 | 64 | 51 | 79 | 57 | 72 | 62 | 60 | 41 | 41 | 43 | 60 | 54 | 60 | 51 | 45 | 46 |
| Kimi-K2.7-Simple | Every-turn | 30 | 67 | 64 | 50 | 63 | 43 | 60 | 43 | 21 | 10 | 42 | 33 | 50 | 52 | 5 | 19 | 32 | 73 | 68 | 73 | 89 | 75 | 88 | 59 | 79 | 27 | 24 | 40 | 68 | 26 | 38 | 68 | 57 | 59 |
| Kimi-K2.7-Simple | Per-5 | 35 | 67 | 65 | 53 | 65 | 46 | 62 | 49 | 46 | 20 | 53 | 44 | 59 | 58 | 13 | 24 | 38 | 79 | 74 | 76 | 87 | 74 | 88 | 62 | 79 | 42 | 40 | 51 | 70 | 30 | 43 | 69 | 60 | 60 |
| Kimi-K2.6-Simple | Every-turn | 28 | 68 | 65 | 55 | 63 | 42 | 63 | 47 | 48 | 37 | 40 | 34 | 47 | 42 | 11 | 25 | 26 | 76 | 71 | 75 | 89 | 74 | 89 | 56 | 80 | 30 | 29 | 45 | 67 | 22 | 40 | 55 | 52 | 67 |
| DeepSeek-V4-Flash-Simple | Every-turn | 51 | 63 | 58 | 57 | 60 | 50 | 56 | 51 | 52 | 53 | 53 | 50 | 52 | 51 | 50 | 50 | 53 | 66 | 59 | 57 | 69 | 56 | 79 | 57 | 66 | 51 | 50 | 51 | 57 | 51 | 55 | 58 | 54 | 56 |
| DeepSeek-V4-Flash-Simple | Per-5 | 45 | 60 | 57 | 53 | 57 | 51 | 55 | 51 | 55 | 54 | 52 | 50 | 51 | 55 | 50 | 49 | 49 | 62 | 59 | 56 | 64 | 57 | 75 | 62 | 63 | 51 | 51 | 51 | 60 | 51 | 55 | 57 | 53 | 53 |
| DeepSeek-V4.1-Flash-Simple | Per-5 | 31 | 65 | 64 | 48 | 58 | 52 | 59 | 52 | 36 | 34 | 54 | 50 | 50 | 55 | 50 | 50 | 48 | 78 | 75 | 70 | 77 | 70 | 90 | 80 | 78 | 51 | 51 | 51 | 76 | 44 | 62 | 71 | 61 | 58 |
| Qwen-3.5-Simple | Every-turn | 33 | 64 | 61 | 34 | 52 | 45 | 46 | 45 | 16 | 1 | 48 | 42 | 36 | 31 | 13 | 15 | 41 | 70 | 70 | 70 | 69 | 83 | 73 | 76 | 79 | 42 | 40 | 45 | 79 | 52 | 51 | 82 | 55 | 30 |
| Qwen-3.5-Simple | Per-5 | 40 | 62 | 61 | 42 | 57 | 40 | 54 | 49 | 29 | 10 | 50 | 45 | 37 | 43 | 32 | 33 | 45 | 69 | 67 | 66 | 66 | 77 | 67 | 74 | 78 | 48 | 46 | 48 | 74 | 58 | 51 | 70 | 54 | 32 |
| Qwen-3.6-27B-Simple | Every-turn | 26 | 55 | 52 | 38 | 38 | 22 | 31 | 19 | 11 | 2 | 24 | 12 | 8 | 9 | 1 | 1 | 27 | 48 | 49 | 56 | 62 | 77 | 70 | 78 | 54 | 10 | 9 | 12 | 64 | 37 | 24 | 68 | 40 | 11 |
| Qwen-3.6-27B-Simple | Per-5 | 37 | 61 | 58 | 50 | 50 | 26 | 46 | 33 | 5 | 3 | 34 | 21 | 10 | 12 | 2 | 2 | 32 | 54 | 55 | 62 | 67 | 78 | 70 | 65 | 59 | 20 | 17 | 20 | 54 | 32 | 27 | 54 | 35 | 20 |
| Qwen-3.8-27B-Simple | Every-turn | 24 | 54 | 50 | 32 | 40 | 42 | 34 | 27 | 16 | 3 | 43 | 22 | 13 | 14 | 2 | 3 | 41 | 69 | 62 | 63 | 80 | 73 | 73 | 65 | 61 | 21 | 19 | 26 | 60 | 35 | 41 | 87 | 35 | 25 |
| Qwen-3.8-27B-Simple | Per-5 | 22 | 57 | 55 | 37 | 44 | 30 | 40 | 23 | 5 | 1 | 37 | 18 | 9 | 14 | 2 | 1 | 36 | 66 | 60 | 60 | 75 | 72 | 72 | 57 | 61 | 20 | 18 | 22 | 52 | 24 | 32 | 81 | 32 | 22 |
| Qwen-3.8-Flash-Next-Simple | Per-5 | 15 | 42 | 44 | 26 | 31 | 17 | 31 | 15 | 18 | 3 | 28 | 15 | 19 | 26 | 10 | 11 | 33 | 69 | 59 | 61 | 79 | 69 | 71 | 62 | 59 | 26 | 24 | 34 | 67 | 30 | 36 | 75 | 30 | 27 |
| Gemma-4-Simple | Every-turn | 65 | 77 | 77 | 84 | 80 | 57 | 59 | 57 | 83 | 75 | 61 | 53 | 62 | 72 | 49 | 47 | 38 | 55 | 59 | 68 | 79 | 82 | 78 | 54 | 74 | 51 | 52 | 50 | 50 | 45 | 51 | 53 | 51 | 51 |
| Gemma-4-Simple | Per-5 | 62 | 69 | 66 | 76 | 75 | 57 | 61 | 54 | 83 | 83 | 61 | 50 | 66 | 58 | 54 | 54 | 46 | 67 | 66 | 69 | 73 | 72 | 75 | 60 | 70 | 51 | 52 | 50 | 52 | 51 | 55 | 58 | 51 | 51 |
| GPT-6-Luna-Simple | Per-5 | 16 | 76 | 70 | 40 | 62 | 43 | 64 | 49 | 18 | 17 | 49 | 48 | 65 | 66 | 46 | 47 | 25 | 67 | 66 | 60 | 86 | 55 | 91 | 55 | 74 | 50 | 50 | 49 | 76 | 18 | 43 | 71 | 61 | 80 |
| Nemotron-3-Super-Simple | Every-turn | 37 | 60 | 62 | 50 | 63 | 60 | 44 | 41 | 12 | 9 | 35 | 22 | 17 | 10 | 7 | 5 | 51 | 71 | 71 | 75 | 86 | 84 | 85 | 84 | 83 | 23 | 24 | 35 | 82 | 73 | 56 | 77 | 43 | 14 |
| Nemotron-3-Super-Simple | Per-5 | 34 | 54 | 58 | 46 | 60 | 57 | 40 | 40 | 16 | 13 | 39 | 33 | 11 | 7 | 6 | 5 | 52 | 70 | 71 | 70 | 85 | 78 | 84 | 66 | 75 | 35 | 36 | 42 | 76 | 66 | 43 | 66 | 44 | 40 |
- 0 forbid
- 30 enough
- 50 balanced (in-game AI)
- 70 prioritize
- 100 emergency focus
Diplomacy
| Strategist | Condition | Diplomacy | Personality | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Bal | Frd | With | Agst | Loy | Den | Fgv | Mean | Need | Chat | Dec | |
| Matched in-game AI | 7.0 | 6.9 | 6.4 | 6.0 | 6.5 | 6.9 | 3.4 | 6.1 | 8.1 | 3.5 | 6.4 |
| GPT-OSS-120B-Simple | Every-turn | 7.5 | 8.4 | 8.6 | 7.5 | 7.5 | 5.0 | 6.9 | 4.4 | 8.0 | 3.8 | 4.9 |
| GPT-OSS-120B-Simple | Per-5 | 7.0 | 7.8 | 8.5 | 6.4 | 7.0 | 5.2 | 6.5 | 4.5 | 8.0 | 3.9 | 5.1 |
| Opus-5.5-Simple | Per-5 | 7.0 | 7.2 | 6.4 | 5.9 | 7.4 | 5.1 | 5.3 | 3.6 | 7.6 | 3.5 | 4.5 |
| GLM-5.1-Simple | Every-turn | 7.2 | 7.2 | 6.6 | 5.1 | 8.2 | 4.7 | 5.8 | 3.8 | 7.1 | 4.4 | 3.2 |
| GLM-5.2-Simple | Every-turn | 7.1 | 7.4 | 7.0 | 5.7 | 7.8 | 4.6 | 5.9 | 4.0 | 6.3 | 4.7 | 4.1 |
| GLM-5.2-Simple | Per-5 | 7.0 | 7.2 | 6.7 | 5.9 | 7.5 | 4.8 | 5.3 | 4.1 | 6.7 | 3.9 | 4.8 |
| GLM-5.3-Simple | Per-5 | 7.0 | 7.3 | 6.7 | 6.5 | 7.8 | 3.2 | 5.5 | 4.4 | 5.6 | 6.0 | 4.1 |
| GLM-5.3-Flash-Simple | Every-turn | 7.2 | 7.0 | 6.8 | 6.0 | 6.6 | 5.8 | 4.1 | 5.1 | 7.8 | 4.7 | 5.3 |
| GLM-5.3-Flash-Simple | Per-5 | 7.0 | 6.9 | 6.4 | 6.1 | 7.0 | 5.8 | 4.1 | 5.3 | 7.9 | 3.8 | 5.8 |
| MiniMax-M2.7-Simple | Every-turn | 7.0 | 6.9 | 7.3 | 7.7 | 6.6 | 7.4 | 3.8 | 6.0 | 7.3 | 5.0 | 5.8 |
| MiniMax-M2.7-Simple | Per-5 | 7.0 | 6.9 | 7.0 | 7.0 | 6.6 | 7.5 | 3.1 | 6.1 | 8.0 | 3.9 | 5.8 |
| MiniMax-M3-Simple | Per-5 | 7.0 | 7.0 | 7.3 | 6.4 | 6.6 | 6.2 | 3.7 | 5.9 | 7.3 | 5.1 | 5.6 |
| Kimi-K2.7-Simple | Every-turn | 7.1 | 7.8 | 6.9 | 4.5 | 7.9 | 2.9 | 7.2 | 3.1 | 4.6 | 5.3 | 3.3 |
| Kimi-K2.7-Simple | Per-5 | 7.0 | 7.5 | 6.8 | 5.7 | 7.4 | 3.9 | 5.8 | 4.0 | 5.4 | 4.8 | 3.9 |
| Kimi-K2.6-Simple | Every-turn | 7.1 | 7.1 | 6.9 | 5.1 | 7.6 | 4.3 | 6.1 | 3.3 | 5.5 | 5.2 | 3.7 |
| DeepSeek-V4-Flash-Simple | Every-turn | 7.0 | 7.1 | 6.4 | 6.0 | 6.8 | 6.5 | 3.7 | 4.8 | 8.1 | 3.5 | 5.7 |
| DeepSeek-V4-Flash-Simple | Per-5 | 7.0 | 7.0 | 6.4 | 6.0 | 7.1 | 6.1 | 3.7 | 4.8 | 7.9 | 3.5 | 5.3 |
| DeepSeek-V4.1-Flash-Simple | Per-5 | 7.0 | 7.2 | 6.6 | 5.7 | 6.9 | 4.8 | 4.4 | 4.2 | 7.5 | 3.6 | 5.2 |
| Qwen-3.5-Simple | Every-turn | 7.1 | 8.5 | 8.6 | 7.0 | 8.1 | 4.5 | 6.7 | 3.4 | 4.7 | 7.3 | 3.9 |
| Qwen-3.5-Simple | Per-5 | 7.0 | 7.9 | 8.1 | 6.1 | 7.9 | 4.7 | 6.7 | 3.7 | 5.1 | 6.2 | 4.2 |
| Qwen-3.6-27B-Simple | Every-turn | 7.1 | 7.5 | 7.6 | 6.2 | 7.2 | 4.6 | 6.1 | 3.6 | 6.3 | 5.2 | 3.6 |
| Qwen-3.6-27B-Simple | Per-5 | 7.0 | 7.2 | 7.1 | 6.9 | 7.7 | 4.9 | 5.5 | 3.9 | 6.6 | 4.3 | 4.4 |
| Qwen-3.8-27B-Simple | Every-turn | 7.1 | 8.1 | 8.6 | 6.7 | 8.2 | 3.8 | 6.8 | 3.9 | 6.7 | 5.9 | 3.2 |
| Qwen-3.8-27B-Simple | Per-5 | 7.0 | 7.4 | 8.3 | 6.2 | 8.3 | 4.0 | 6.1 | 3.9 | 6.6 | 5.2 | 3.3 |
| Qwen-3.8-Flash-Next-Simple | Per-5 | 7.0 | 7.5 | 7.6 | 5.4 | 7.4 | 2.8 | 5.4 | 2.9 | 6.1 | 7.8 | 4.3 |
| Gemma-4-Simple | Every-turn | 7.0 | 6.8 | 6.4 | 6.0 | 7.1 | 5.8 | 3.6 | 5.4 | 7.7 | 3.9 | 5.8 |
| Gemma-4-Simple | Per-5 | 7.0 | 6.4 | 6.6 | 6.3 | 6.9 | 6.6 | 3.6 | 5.6 | 7.8 | 3.6 | 6.1 |
| GPT-6-Luna-Simple | Per-5 | 7.0 | 8.1 | 8.6 | 6.8 | 8.3 | 5.1 | 5.2 | 3.4 | 6.9 | 3.8 | 4.2 |
| Nemotron-3-Super-Simple | Every-turn | 7.1 | 8.5 | 7.8 | 6.4 | 8.4 | 3.9 | 7.5 | 3.5 | 6.7 | 4.3 | 4.2 |
| Nemotron-3-Super-Simple | Per-5 | 7.0 | 7.8 | 7.4 | 5.9 | 7.8 | 4.4 | 6.7 | 3.6 | 7.5 | 4.1 | 5.0 |
- 1 lowest
- 4
- 5.5 middle
- 7
- 10 highest
Commitment
| Strategist | Condition | Acts % | Revises % | Touched | Step | Net % | Persona |
|---|---|---|---|---|---|---|
| Completed-experiment average | 58 | 53 | 6.3 | 9.1 | 25 | 6.6 |
| GPT-OSS-120B-Simple | Every-turn | 92 | 42 | 4.8 | 14.3 | 13 | 15.1 |
| GPT-OSS-120B-Simple | Per-5 | 30 | 58 | 5.6 | 14.3 | 20 | 6.8 |
| Opus-5.5-Simple | Per-5 | 30 | 46 | 6.0 | 6.6 | 29 | 1.4 |
| GLM-5.1-Simple | Every-turn | 92 | 82 | 5.0 | 5.3 | 17 | 4.4 |
| GLM-5.2-Simple | Every-turn | 98 | 38 | 4.0 | 7.7 | 25 | 4.1 |
| GLM-5.2-Simple | Per-5 | 29 | 56 | 4.7 | 8.0 | 39 | 1.9 |
| GLM-5.3-Simple | Per-5 | 31 | 81 | 3.3 | 8.3 | 28 | 6.0 |
| GLM-5.3-Flash-Simple | Every-turn | 94 | 14 | 2.8 | 8.4 | 43 | 2.5 |
| GLM-5.3-Flash-Simple | Per-5 | 32 | 29 | 4.0 | 7.7 | 43 | 1.4 |
| MiniMax-M2.7-Simple | Every-turn | 93 | 14 | 3.1 | 10.7 | 43 | 5.7 |
| MiniMax-M2.7-Simple | Per-5 | 31 | 24 | 3.1 | 10.2 | 50 | 2.7 |
| MiniMax-M3-Simple | Per-5 | 30 | 19 | 5.0 | 11.5 | 62 | 4.4 |
| Kimi-K2.7-Simple | Every-turn | 99 | 63 | 9.1 | 9.3 | 7 | 10.1 |
| Kimi-K2.7-Simple | Per-5 | 32 | 82 | 10.8 | 9.0 | 12 | 5.0 |
| Kimi-K2.6-Simple | Every-turn | 93 | 49 | 7.3 | 10.8 | 11 | 7.0 |
| DeepSeek-V4-Flash-Simple | Every-turn | 100 | 14 | 4.9 | 4.6 | 29 | 0.8 |
| DeepSeek-V4-Flash-Simple | Per-5 | 31 | 42 | 6.1 | 4.4 | 31 | 0.9 |
| DeepSeek-V4.1-Flash-Simple | Per-5 | 29 | 66 | 6.7 | 4.1 | 33 | 1.2 |
| Qwen-3.5-Simple | Every-turn | 97 | 63 | 6.2 | 6.4 | 10 | 19.6 |
| Qwen-3.5-Simple | Per-5 | 31 | 77 | 8.1 | 6.2 | 18 | 11.6 |
| Qwen-3.6-27B-Simple | Every-turn | 96 | 59 | 9.8 | 7.3 | 8 | 13.4 |
| Qwen-3.6-27B-Simple | Per-5 | 29 | 78 | 12.4 | 7.7 | 15 | 6.9 |
| Qwen-3.8-27B-Simple | Every-turn | 96 | 69 | 5.9 | 8.3 | 10 | 17.4 |
| Qwen-3.8-27B-Simple | Per-5 | 30 | 91 | 10.5 | 8.6 | 14 | 12.9 |
| Qwen-3.8-Flash-Next-Simple | Per-5 | 33 | 94 | 14.3 | 5.4 | 14 | 21.6 |
| Gemma-4-Simple | Every-turn | 96 | 17 | 2.3 | 18.8 | 29 | 1.0 |
| Gemma-4-Simple | Per-5 | 28 | 43 | 2.6 | 16.6 | 30 | 0.9 |
| GPT-6-Luna-Simple | Per-5 | 31 | 82 | 7.6 | 5.3 | 22 | 3.7 |
| Nemotron-3-Super-Simple | Every-turn | 80 | 36 | 6.7 | 14.3 | 15 | 5.1 |
| Nemotron-3-Super-Simple | Per-5 | 27 | 47 | 7.5 | 13.0 | 25 | 2.4 |
- 2 SD below the average strategist
- 1 SD below
- average
- 1 SD above
- 2 SD above
Grand strategy
| Strategist | Condition | 0: The Netherlands | 1: The Ottomans | 2: France | 3: Spain | 4: The Aztecs | 5: Brazil | 6: Arabia | 7: Poland |
|---|---|---|---|---|---|---|---|---|
| Null | Culture 40% | United Nations 41% | Conquest 64% | Conquest 85% | Conquest 69% | United Nations 75% | Culture 64% | United Nations 39% |
| Vanilla | United Nations 34% | Spaceship 82% | Conquest 79% | Conquest 94% | Conquest 83% | United Nations 79% | Spaceship 45% | Spaceship 68% |
| GPT-OSS-120B-Simple | Every-turn | Culture 58% | United Nations 56% | United Nations 58% | Conquest 56% | United Nations 57% | Culture 45% | Spaceship 61% | Spaceship 48% |
| GPT-OSS-120B-Simple | Per-5 | United Nations 98% | Conquest 49% | United Nations 40% | United Nations 49% | Conquest 62% | Culture 51% | Spaceship 50% | Spaceship 58% |
| Opus-5.5-Simple | Per-5 | Culture 100% | Spaceship 99% | Conquest 40% | Spaceship 94% | Spaceship 51% | Culture 100% | Culture 50% | Culture 100% |
| GLM-5.1-Simple | Every-turn | United Nations 100% | Spaceship 44% | Conquest 52% | Culture 50% | Conquest 69% | Culture 100% | Spaceship 98% | Culture 52% |
| GLM-5.2-Simple | Every-turn | Spaceship 100% | Conquest 70% | Conquest 55% | Spaceship 83% | Conquest 51% | Culture 100% | Spaceship 99% | Culture 50% |
| GLM-5.2-Simple | Per-5 | United Nations 50% | Conquest 50% | Conquest 70% | Spaceship 100% | Conquest 68% | Culture 93% | Spaceship 100% | Culture 100% |
| GLM-5.3-Simple | Per-5 | United Nations 49% | Spaceship 68% | Conquest 62% | Culture 37% | Conquest 84% | Culture 100% | Spaceship 68% | United Nations 60% |
| GLM-5.3-Flash-Simple | Every-turn | Culture 62% | Spaceship 86% | Culture 100% | Conquest 76% | Conquest 59% | Culture 99% | Culture 100% | United Nations 100% |
| GLM-5.3-Flash-Simple | Per-5 | Culture 93% | Spaceship 96% | Conquest 50% | Conquest 65% | Conquest 100% | Culture 100% | Culture 100% | United Nations 98% |
| MiniMax-M2.7-Simple | Every-turn | Culture 100% | Spaceship 100% | Conquest 50% | Conquest 100% | Conquest 100% | Culture 100% | Culture 100% | Culture 100% |
| MiniMax-M2.7-Simple | Per-5 | Culture 100% | Spaceship 100% | Conquest 50% | Conquest 100% | Conquest 100% | Culture 100% | Culture 100% | Culture 50% |
| MiniMax-M3-Simple | Per-5 | Culture 50% | Conquest 50% | Conquest 100% | Conquest 100% | Conquest 100% | United Nations 53% | Culture 100% | Culture 100% |
| Kimi-K2.7-Simple | Every-turn | United Nations 51% | Spaceship 84% | Spaceship 63% | Spaceship 82% | Conquest 67% | Culture 100% | Spaceship 49% | Spaceship 61% |
| Kimi-K2.7-Simple | Per-5 | United Nations 70% | Spaceship 91% | Spaceship 48% | Spaceship 47% | Conquest 57% | Culture 83% | Spaceship 73% | United Nations 83% |
| Kimi-K2.6-Simple | Every-turn | Spaceship 93% | Spaceship 84% | Spaceship 50% | Spaceship 91% | Spaceship 57% | Culture 86% | Spaceship 99% | Spaceship 97% |
| DeepSeek-V4-Flash-Simple | Every-turn | United Nations 50% | Spaceship 100% | Spaceship 53% | Spaceship 99% | Conquest 100% | Culture 89% | Spaceship 100% | Culture 50% |
| DeepSeek-V4-Flash-Simple | Per-5 | Culture 50% | Spaceship 100% | Conquest 68% | Culture 46% | Conquest 58% | Culture 89% | Culture 92% | Culture 50% |
| DeepSeek-V4.1-Flash-Simple | Per-5 | Culture 50% | Spaceship 94% | Conquest 57% | United Nations 49% | Conquest 60% | Culture 100% | Spaceship 98% | Culture 53% |
| Qwen-3.5-Simple | Every-turn | Culture 77% | United Nations 53% | Conquest 45% | Culture 77% | Conquest 63% | Culture 47% | Culture 50% | Culture 67% |
| Qwen-3.5-Simple | Per-5 | Culture 50% | Culture 99% | Conquest 100% | Conquest 83% | Conquest 57% | Culture 79% | Culture 100% | Culture 99% |
| Qwen-3.6-27B-Simple | Every-turn | Culture 100% | Culture 97% | Culture 53% | United Nations 47% | Conquest 69% | Culture 56% | Culture 100% | Culture 70% |
| Qwen-3.6-27B-Simple | Per-5 | Culture 84% | Spaceship 59% | Conquest 75% | Conquest 62% | Conquest 70% | Culture 89% | Culture 59% | Culture 97% |
| Qwen-3.8-27B-Simple | Every-turn | United Nations 44% | Culture 83% | Spaceship 41% | Culture 49% | United Nations 63% | Culture 50% | Spaceship 67% | Culture 54% |
| Qwen-3.8-27B-Simple | Per-5 | United Nations 92% | Spaceship 46% | Culture 57% | Spaceship 59% | Conquest 52% | Culture 58% | Spaceship 86% | Culture 50% |
| Qwen-3.8-Flash-Next-Simple | Per-5 | Culture 100% | Spaceship 56% | Culture 62% | Culture 38% | Conquest 68% | Culture 100% | Spaceship 93% | Culture 78% |
| Gemma-4-Simple | Every-turn | Culture 50% | Conquest 100% | Conquest 100% | Culture 84% | Conquest 100% | Culture 75% | Spaceship 100% | Spaceship 100% |
| Gemma-4-Simple | Per-5 | Culture 100% | Conquest 100% | Conquest 100% | Conquest 50% | Conquest 100% | Culture 100% | Spaceship 98% | Spaceship 57% |
| GPT-6-Luna-Simple | Per-5 | Spaceship 92% | Spaceship 100% | Culture 50% | Spaceship 100% | Spaceship 80% | Culture 50% | Spaceship 100% | Spaceship 100% |
| Nemotron-3-Super-Simple | Every-turn | Culture 68% | Culture 94% | Conquest 33% | Culture 31% | Conquest 92% | Culture 100% | Culture 52% | Culture 100% |
| Nemotron-3-Super-Simple | Per-5 | Spaceship 99% | Spaceship 74% | Spaceship 56% | Culture 36% | Conquest 66% | Culture 69% | Culture 100% | Spaceship 100% |
- Conquest
- Culture
- United Nations
- Spaceship
Policies
| Strategist | Condition | Ancient | Medieval | Industrial | Ideology | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Trad | Auth | Prog | Feal | Stat | Art | Ind | Imp | Rat | Free | Auto | Ord | |
| Matched in-game AI | 50 | 38 | 12 | 59 | 16 | 28 | 8 | 25 | 56 | 30 | 9 | 42 |
| Null | 94 | 94 | 100 | 38 | 50 | 62 | 62 | 56 | 56 | 19 | 12 | 44 |
| GPT-OSS-120B-Simple | Every-turn | 100 | 94 | 94 | 94 | 100 | 100 | 75 | 56 | 75 | 12 | 12 | 25 |
| GPT-OSS-120B-Simple | Per-5 | 94 | 100 | 100 | 100 | 100 | 100 | 94 | 62 | 88 | 19 | 38 | 44 |
| Opus-5.5-Simple | Per-5 | 56 | 19 | 25 | 25 | 19 | 69 | 25 | 0 | 100 | 12 | 19 | 38 |
| GLM-5.1-Simple | Every-turn | 44 | 25 | 81 | 44 | 50 | 50 | 12 | 31 | 88 | 12 | 19 | 50 |
| GLM-5.2-Simple | Every-turn | 50 | 44 | 75 | 38 | 31 | 62 | 19 | 12 | 94 | 12 | 25 | 44 |
| GLM-5.2-Simple | Per-5 | 69 | 38 | 75 | 56 | 38 | 62 | 25 | 19 | 81 | 12 | 19 | 38 |
| GLM-5.3-Simple | Per-5 | 31 | 25 | 81 | 62 | 44 | 44 | 25 | 31 | 69 | 12 | 25 | 50 |
| GLM-5.3-Flash-Simple | Every-turn | 81 | 31 | 69 | 75 | 38 | 62 | 44 | 19 | 88 | 6 | 44 | 44 |
| GLM-5.3-Flash-Simple | Per-5 | 69 | 44 | 75 | 88 | 38 | 69 | 31 | 25 | 94 | 19 | 12 | 56 |
| MiniMax-M2.7-Simple | Every-turn | 75 | 38 | 31 | 44 | 12 | 69 | 12 | 12 | 50 | 12 | 31 | 44 |
| MiniMax-M2.7-Simple | Per-5 | 75 | 25 | 31 | 38 | 19 | 50 | 12 | 12 | 62 | 12 | 25 | 44 |
| MiniMax-M3-Simple | Per-5 | 94 | 88 | 25 | 6 | 25 | 50 | 62 | 56 | 50 | 12 | 38 | 38 |
| Kimi-K2.7-Simple | Every-turn | 19 | 25 | 69 | 50 | 50 | 31 | 38 | 38 | 100 | 25 | 25 | 44 |
| Kimi-K2.7-Simple | Per-5 | 19 | 19 | 81 | 38 | 38 | 56 | 50 | 6 | 88 | 6 | 38 | 56 |
| Kimi-K2.6-Simple | Every-turn | 50 | 25 | 88 | 69 | 50 | 75 | 19 | 31 | 100 | 19 | 25 | 44 |
| DeepSeek-V4-Flash-Simple | Every-turn | 62 | 25 | 75 | 81 | 12 | 19 | 19 | 19 | 94 | 19 | 25 | 56 |
| DeepSeek-V4-Flash-Simple | Per-5 | 50 | 25 | 75 | 56 | 25 | 50 | 12 | 6 | 94 | 25 | 31 | 44 |
| DeepSeek-V4.1-Flash-Simple | Per-5 | 31 | 25 | 56 | 19 | 31 | 56 | 19 | 6 | 88 | 0 | 19 | 56 |
| Qwen-3.5-Simple | Every-turn | 94 | 81 | 88 | 81 | 94 | 94 | 75 | 75 | 88 | 12 | 19 | 56 |
| Qwen-3.5-Simple | Per-5 | 62 | 50 | 100 | 81 | 94 | 94 | 81 | 44 | 62 | 25 | 19 | 38 |
| Qwen-3.6-27B-Simple | Every-turn | 94 | 81 | 100 | 81 | 94 | 94 | 56 | 38 | 88 | 12 | 44 | 38 |
| Qwen-3.6-27B-Simple | Per-5 | 94 | 100 | 100 | 75 | 88 | 81 | 50 | 50 | 81 | 12 | 25 | 44 |
| Qwen-3.8-27B-Simple | Every-turn | 100 | 38 | 100 | 62 | 88 | 81 | 69 | 25 | 81 | 6 | 44 | 56 |
| Qwen-3.8-27B-Simple | Per-5 | 62 | 75 | 100 | 81 | 81 | 69 | 56 | 38 | 44 | 12 | 31 | 38 |
| Qwen-3.8-Flash-Next-Simple | Per-5 | 75 | 75 | 94 | 94 | 75 | 75 | 50 | 19 | 69 | 0 | 38 | 62 |
| Gemma-4-Simple | Every-turn | 75 | 56 | 94 | 38 | 44 | 38 | 81 | 62 | 94 | 31 | 19 | 44 |
| Gemma-4-Simple | Per-5 | 88 | 50 | 88 | 50 | 56 | 50 | 75 | 69 | 88 | 25 | 19 | 44 |
| GPT-6-Luna-Simple | Per-5 | 50 | 12 | 100 | 38 | 44 | 81 | 12 | 0 | 94 | 31 | 25 | 38 |
| Nemotron-3-Super-Simple | Every-turn | 69 | 56 | 94 | 88 | 81 | 75 | 31 | 25 | 88 | 25 | 25 | 31 |
| Nemotron-3-Super-Simple | Per-5 | 88 | 44 | 100 | 75 | 81 | 81 | 44 | 25 | 81 | 25 | 12 | 56 |
- 0% never
- 50%
- 100% always
Seed 3
Strength
| Strategist | Condition | Avg | Avg rank | 0: France | 1: The Zulus | 2: China | 3: Egypt | 4: Mongolia | 5: Austria | 6: Morocco | 7: Songhai |
|---|---|---|---|---|---|---|---|---|---|---|
| VPAI | 0.50 | #4.5 | 0.50 | 0.50 | 0.50 | 0.50 | 0.50 | 0.50 | 0.50 | 0.49 |
| Null | Every-turn | 0.34 | #5.5 | 0.49 | 0.43 | 0.15 | 0.14 | 0.52 | 0.30 | 0.32 | 0.36 |
| GPT-OSS-120B-Simple | Every-turn | 0.43 | #4.2 | 0.52 | 0.58 | 0.42 | 0.54 | 0.51 | 0.39 | 0.48 | 0.16 |
| GPT-OSS-120B-Simple | Per-5 | 0.36 | #5.2 | 0.48 | 0.49 | 0.36 | 0.24 | 0.52 | 0.18 | 0.22 | 0.39 |
| Opus-5.5-Simple | Per-5 | 0.48 | #4.2 | 0.38 | 0.48 | 0.75 | 0.40 | 0.51 | 0.43 | 0.70 | 0.17 |
| GLM-5.1-Simple | Every-turn | 0.34 | #5.4 | 0.49 | 0.39 | 0.58 | 0.15 | 0.50 | 0.21 | 0.25 | 0.13 |
| GLM-5.2-Simple | Every-turn | 0.47 | #4.3 | 0.49 | 0.44 | 0.91 | 0.42 | 0.51 | 0.31 | 0.38 | 0.25 |
| GLM-5.2-Simple | Per-5 | 0.46 | #4.7 | 0.45 | 0.72 | 0.76 | 0.30 | 0.49 | 0.24 | 0.39 | 0.30 |
| GLM-5.3-Simple | Per-5 | 0.47 | #4.6 | 0.50 | 0.52 | 0.65 | 0.08 | 0.50 | 0.46 | 0.49 | 0.55 |
| GLM-5.3-Flash-Simple | Every-turn | 0.39 | #5.1 | 0.54 | 0.35 | 0.43 | 0.28 | 0.51 | 0.30 | 0.40 | 0.28 |
| GLM-5.3-Flash-Simple | Per-5 | 0.39 | #4.9 | 0.51 | 0.32 | 0.39 | 0.36 | 0.50 | 0.36 | 0.32 | 0.39 |
| MiniMax-M2.7-Simple | Every-turn | 0.41 | #4.9 | 0.48 | 0.51 | 0.49 | 0.27 | 0.50 | 0.21 | 0.41 | 0.37 |
| MiniMax-M2.7-Simple | Per-5 | 0.39 | #4.9 | 0.51 | 0.46 | 0.18 | 0.29 | 0.51 | 0.40 | 0.47 | 0.32 |
| MiniMax-M3-Simple | Per-5 | 0.44 | #4.6 | 0.69 | 0.42 | 0.50 | 0.35 | 0.50 | 0.25 | 0.45 | 0.33 |
| Kimi-K2.7-Simple | Every-turn | 0.53 | #4.1 | 0.49 | 0.68 | 0.70 | 0.12 | 0.50 | 0.79 | 0.55 | 0.40 |
| Kimi-K2.7-Simple | Per-5 | 0.45 | #4.9 | 0.47 | 0.35 | 0.71 | 0.33 | 0.50 | 0.56 | 0.43 | 0.20 |
| Kimi-K2.6-Simple | Every-turn | 0.44 | #4.6 | 0.51 | 0.42 | 0.28 | 0.61 | 0.51 | 0.34 | 0.55 | 0.32 |
| DeepSeek-V4-Flash-Simple | Every-turn | 0.38 | #5.1 | 0.49 | 0.36 | 0.52 | 0.32 | 0.50 | 0.15 | 0.29 | 0.38 |
| DeepSeek-V4-Flash-Simple | Per-5 | 0.37 | #5.1 | 0.48 | 0.38 | 0.44 | 0.20 | 0.50 | 0.41 | 0.32 | 0.21 |
| DeepSeek-V4.1-Flash-Simple | Per-5 | 0.43 | #5.2 | 0.53 | 0.50 | 0.77 | 0.48 | 0.53 | 0.16 | 0.31 | 0.12 |
| Qwen-3.5-Simple | Every-turn | 0.43 | #5.4 | 0.53 | 0.39 | 0.40 | 0.05 | 0.50 | 0.49 | 0.38 | 0.68 |
| Qwen-3.5-Simple | Per-5 | 0.41 | #4.4 | 0.46 | 0.65 | 0.49 | 0.31 | 0.53 | 0.16 | 0.46 | 0.19 |
| Qwen-3.6-27B-Simple | Every-turn | 0.39 | #5.3 | 0.54 | 0.43 | 0.32 | 0.25 | 0.51 | 0.35 | 0.46 | 0.23 |
| Qwen-3.6-27B-Simple | Per-5 | 0.36 | #5.8 | 0.49 | 0.38 | 0.24 | 0.39 | 0.53 | 0.24 | 0.23 | 0.41 |
| Qwen-3.8-27B-Simple | Every-turn | 0.46 | #4.7 | 0.49 | 0.59 | 0.23 | 0.36 | 0.52 | 0.49 | 0.67 | 0.31 |
| Qwen-3.8-27B-Simple | Per-5 | 0.40 | #4.9 | 0.72 | 0.69 | 0.22 | 0.24 | 0.50 | 0.30 | 0.16 | 0.37 |
| Qwen-3.8-Flash-Next-Simple | Per-5 | 0.40 | #4.8 | 0.55 | 0.38 | 0.62 | 0.39 | 0.50 | 0.35 | 0.22 | 0.24 |
| Gemma-4-Simple | Every-turn | 0.31 | #5.5 | 0.56 | 0.37 | 0.15 | 0.20 | 0.50 | 0.26 | 0.28 | 0.16 |
| Gemma-4-Simple | Per-5 | 0.44 | #4.5 | 0.55 | 0.53 | 0.67 | 0.43 | 0.51 | 0.17 | 0.34 | 0.36 |
| GPT-6-Luna-Simple | Per-5 | 0.50 | #4.6 | 0.62 | 0.57 | 0.61 | 0.25 | 0.53 | 0.41 | 0.42 | 0.59 |
| Nemotron-3-Super-Simple | Every-turn | 0.41 | #4.8 | 0.52 | 0.36 | 0.43 | 0.17 | 0.52 | 0.40 | 0.49 | 0.42 |
| Nemotron-3-Super-Simple | Per-5 | 0.34 | #5.9 | 0.51 | 0.50 | 0.38 | 0.25 | 0.51 | 0.13 | 0.31 | 0.13 |
| VPAI | Every-turn | 0.48 | #4.4 | 0.51 | 0.57 | 0.56 | 0.36 | 0.55 | 0.40 | 0.47 | 0.39 |
- 0
- 0.25
- 0.5
- 0.75
- 1
Focus
- Domination
- Culture
- Diplomatic
- Science
Strategy
| Strategist | Condition | Military | Nuclear | Naval and air | Economy | Other | |||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Off | Def | CDef | Mob | MTrn | Rec | Rng | Mobl | Nuke | UNuk | Nav | NRec | Air | AA | Carr | Lift | Exp | Gro | Tile | Infr | Prod | Gold | Sci | Cul | Hap | NGro | NTile | WCon | GP | Wond | Rel | Dip | Esp | Spc | |
| Completed-experiment average | 46 | 62 | 60 | 56 | 63 | 45 | 57 | 51 | 35 | 28 | 48 | 39 | 40 | 41 | 25 | 27 | 42 | 64 | 62 | 64 | 76 | 71 | 74 | 61 | 71 | 39 | 37 | 41 | 61 | 41 | 42 | 65 | 52 | 38 |
| GPT-OSS-120B-Simple | Every-turn | 26 | 41 | 39 | 38 | 45 | 46 | 27 | 34 | 5 | 1 | 47 | 40 | 11 | 11 | 3 | 5 | 55 | 68 | 58 | 72 | 83 | 70 | 71 | 69 | 83 | 52 | 41 | 49 | 83 | 63 | 40 | 88 | 76 | 31 |
| GPT-OSS-120B-Simple | Per-5 | 32 | 37 | 34 | 45 | 46 | 47 | 31 | 37 | 3 | 0 | 47 | 41 | 15 | 4 | 6 | 7 | 60 | 69 | 59 | 66 | 81 | 66 | 67 | 60 | 81 | 49 | 38 | 47 | 72 | 51 | 33 | 78 | 61 | 27 |
| Opus-5.5-Simple | Per-5 | 40 | 58 | 60 | 46 | 51 | 21 | 59 | 48 | 28 | 11 | 51 | 43 | 51 | 53 | 47 | 47 | 45 | 60 | 58 | 52 | 65 | 57 | 66 | 62 | 63 | 48 | 50 | 49 | 58 | 39 | 38 | 55 | 50 | 49 |
| GLM-5.1-Simple | Every-turn | 67 | 80 | 76 | 80 | 85 | 51 | 82 | 72 | 57 | 38 | 52 | 59 | 8 | 12 | 30 | 75 | 70 | 77 | 94 | 85 | 89 | 66 | 84 | 37 | 32 | 47 | 52 | 25 | 39 | 79 | 60 | 34 | ||
| GLM-5.2-Simple | Every-turn | 50 | 71 | 64 | 65 | 68 | 50 | 62 | 56 | 43 | 13 | 51 | 39 | 42 | 49 | 16 | 20 | 45 | 70 | 73 | 71 | 86 | 83 | 87 | 74 | 81 | 36 | 35 | 43 | 64 | 41 | 51 | 75 | 49 | 31 |
| GLM-5.2-Simple | Per-5 | 50 | 65 | 60 | 64 | 64 | 51 | 60 | 54 | 42 | 28 | 51 | 43 | 48 | 47 | 30 | 30 | 44 | 64 | 65 | 67 | 83 | 76 | 82 | 65 | 77 | 41 | 41 | 45 | 63 | 49 | 47 | 68 | 54 | 44 |
| GLM-5.3-Simple | Per-5 | 63 | 67 | 61 | 60 | 68 | 44 | 66 | 60 | 56 | 51 | 64 | 48 | 52 | 52 | 20 | 36 | 45 | 61 | 69 | 63 | 69 | 72 | 75 | 72 | 72 | 47 | 48 | 52 | 60 | 51 | 59 | 68 | 54 | 36 |
| GLM-5.3-Flash-Simple | Every-turn | 45 | 56 | 54 | 50 | 55 | 49 | 58 | 54 | 64 | 65 | 56 | 50 | 55 | 53 | 50 | 51 | 46 | 66 | 60 | 51 | 57 | 64 | 66 | 60 | 66 | 50 | 49 | 51 | 58 | 46 | 57 | 61 | 55 | 51 |
| GLM-5.3-Flash-Simple | Per-5 | 47 | 54 | 54 | 49 | 56 | 45 | 56 | 53 | 50 | 45 | 53 | 49 | 53 | 50 | 50 | 50 | 48 | 66 | 60 | 49 | 56 | 59 | 63 | 57 | 61 | 48 | 50 | 51 | 57 | 43 | 54 | 56 | 53 | 50 |
| MiniMax-M2.7-Simple | Every-turn | 67 | 63 | 63 | 54 | 77 | 51 | 58 | 67 | 37 | 37 | 51 | 50 | 42 | 50 | 50 | 47 | 56 | 50 | 49 | 50 | 67 | 61 | 71 | 67 | 65 | 50 | 49 | 53 | 64 | 50 | 52 | 66 | 70 | 50 |
| MiniMax-M2.7-Simple | Per-5 | 67 | 58 | 55 | 53 | 73 | 49 | 55 | 62 | 48 | 34 | 50 | 51 | 49 | 49 | 48 | 48 | 60 | 49 | 50 | 50 | 60 | 55 | 62 | 65 | 60 | 50 | 49 | 51 | 62 | 42 | 46 | 65 | 70 | 51 |
| MiniMax-M3-Simple | Per-5 | 57 | 57 | 57 | 62 | 67 | 56 | 65 | 58 | 55 | 49 | 41 | 40 | 40 | 43 | 39 | 39 | 55 | 60 | 61 | 57 | 78 | 53 | 67 | 53 | 57 | 38 | 40 | 41 | 62 | 43 | 45 | 46 | 43 | 36 |
| Kimi-K2.7-Simple | Every-turn | 41 | 69 | 66 | 58 | 73 | 43 | 69 | 55 | 33 | 29 | 42 | 31 | 43 | 44 | 5 | 19 | 27 | 71 | 68 | 72 | 89 | 75 | 87 | 53 | 80 | 25 | 21 | 34 | 61 | 23 | 32 | 63 | 55 | 46 |
| Kimi-K2.7-Simple | Per-5 | 43 | 70 | 67 | 62 | 72 | 48 | 69 | 56 | 48 | 25 | 50 | 41 | 46 | 52 | 6 | 18 | 29 | 74 | 72 | 74 | 88 | 73 | 86 | 58 | 79 | 39 | 36 | 46 | 66 | 30 | 37 | 58 | 61 | 53 |
| Kimi-K2.6-Simple | Every-turn | 39 | 68 | 65 | 60 | 71 | 41 | 69 | 52 | 27 | 15 | 39 | 32 | 32 | 33 | 9 | 18 | 24 | 71 | 67 | 73 | 88 | 75 | 83 | 54 | 77 | 28 | 26 | 37 | 58 | 24 | 31 | 55 | 51 | 40 |
| DeepSeek-V4-Flash-Simple | Every-turn | 54 | 64 | 59 | 62 | 65 | 49 | 56 | 53 | 47 | 45 | 54 | 51 | 52 | 52 | 47 | 49 | 48 | 64 | 58 | 57 | 70 | 59 | 76 | 56 | 68 | 50 | 50 | 51 | 56 | 53 | 53 | 59 | 52 | 53 |
| DeepSeek-V4-Flash-Simple | Per-5 | 53 | 60 | 55 | 58 | 61 | 51 | 56 | 52 | 54 | 54 | 54 | 51 | 51 | 54 | 50 | 50 | 46 | 61 | 57 | 56 | 67 | 56 | 74 | 54 | 65 | 51 | 50 | 51 | 54 | 49 | 52 | 56 | 53 | 55 |
| DeepSeek-V4.1-Flash-Simple | Per-5 | 40 | 66 | 65 | 53 | 65 | 51 | 65 | 57 | 35 | 25 | 53 | 51 | 53 | 59 | 43 | 46 | 40 | 72 | 73 | 69 | 76 | 71 | 88 | 78 | 78 | 50 | 51 | 51 | 71 | 52 | 62 | 68 | 58 | 50 |
| Qwen-3.5-Simple | Every-turn | 51 | 61 | 60 | 53 | 67 | 43 | 59 | 61 | 44 | 33 | 49 | 42 | 51 | 48 | 26 | 27 | 43 | 67 | 65 | 71 | 74 | 84 | 69 | 59 | 81 | 42 | 38 | 43 | 68 | 36 | 42 | 69 | 58 | 23 |
| Qwen-3.5-Simple | Per-5 | 50 | 60 | 60 | 50 | 64 | 44 | 60 | 57 | 52 | 38 | 54 | 47 | 52 | 54 | 43 | 43 | 42 | 65 | 65 | 67 | 70 | 78 | 69 | 67 | 77 | 49 | 48 | 49 | 70 | 52 | 46 | 65 | 57 | 36 |
| Qwen-3.6-27B-Simple | Every-turn | 50 | 65 | 63 | 66 | 65 | 26 | 56 | 43 | 29 | 18 | 43 | 22 | 24 | 27 | 1 | 2 | 28 | 47 | 47 | 65 | 78 | 81 | 63 | 47 | 60 | 9 | 10 | 9 | 38 | 24 | 18 | 48 | 42 | 11 |
| Qwen-3.6-27B-Simple | Per-5 | 45 | 62 | 60 | 54 | 57 | 29 | 49 | 40 | 15 | 7 | 37 | 21 | 16 | 21 | 2 | 2 | 29 | 50 | 53 | 64 | 71 | 80 | 69 | 58 | 56 | 14 | 13 | 15 | 47 | 26 | 21 | 49 | 38 | 22 |
| Qwen-3.8-27B-Simple | Every-turn | 25 | 58 | 55 | 36 | 44 | 33 | 39 | 27 | 8 | 0 | 32 | 14 | 8 | 12 | 0 | 0 | 33 | 61 | 55 | 57 | 78 | 73 | 66 | 58 | 55 | 14 | 13 | 20 | 50 | 29 | 28 | 85 | 31 | 17 |
| Qwen-3.8-27B-Simple | Per-5 | 29 | 61 | 62 | 44 | 51 | 32 | 48 | 31 | 13 | 5 | 34 | 15 | 9 | 21 | 1 | 1 | 31 | 61 | 56 | 57 | 78 | 74 | 66 | 58 | 59 | 15 | 14 | 16 | 54 | 27 | 33 | 79 | 30 | 13 |
| Qwen-3.8-Flash-Next-Simple | Per-5 | 20 | 48 | 49 | 33 | 35 | 22 | 40 | 25 | 48 | 22 | 24 | 16 | 23 | 26 | 19 | 20 | 35 | 68 | 60 | 63 | 77 | 72 | 64 | 60 | 63 | 23 | 24 | 32 | 63 | 24 | 36 | 76 | 28 | 19 |
| Gemma-4-Simple | Every-turn | 70 | 73 | 68 | 84 | 81 | 58 | 67 | 63 | 92 | 90 | 65 | 51 | 64 | 59 | 51 | 50 | 39 | 62 | 63 | 73 | 80 | 83 | 76 | 54 | 74 | 50 | 51 | 50 | 51 | 47 | 50 | 56 | 52 | 51 |
| Gemma-4-Simple | Per-5 | 64 | 72 | 65 | 78 | 79 | 60 | 61 | 60 | 76 | 74 | 58 | 50 | 69 | 56 | 52 | 51 | 49 | 66 | 65 | 70 | 72 | 76 | 74 | 59 | 72 | 50 | 50 | 50 | 54 | 53 | 53 | 57 | 52 | 51 |
| GPT-6-Luna-Simple | Per-5 | 21 | 75 | 69 | 39 | 63 | 38 | 66 | 47 | 23 | 23 | 48 | 42 | 68 | 70 | 43 | 45 | 23 | 62 | 62 | 60 | 88 | 55 | 90 | 54 | 75 | 47 | 48 | 49 | 75 | 21 | 46 | 71 | 61 | 74 |
| Nemotron-3-Super-Simple | Every-turn | 46 | 61 | 62 | 57 | 68 | 63 | 49 | 44 | 3 | 0 | 41 | 31 | 21 | 10 | 10 | 7 | 46 | 71 | 69 | 70 | 86 | 83 | 82 | 76 | 82 | 28 | 27 | 25 | 75 | 60 | 35 | 72 | 40 | 20 |
| Nemotron-3-Super-Simple | Per-5 | 46 | 61 | 62 | 61 | 68 | 61 | 48 | 45 | 0 | 0 | 42 | 35 | 10 | 2 | 1 | 1 | 50 | 68 | 70 | 70 | 85 | 79 | 78 | 66 | 74 | 30 | 29 | 41 | 69 | 53 | 32 | 63 | 39 | 28 |
- 0 forbid
- 30 enough
- 50 balanced (in-game AI)
- 70 prioritize
- 100 emergency focus
Diplomacy
| Strategist | Condition | Diplomacy | Personality | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Bal | Frd | With | Agst | Loy | Den | Fgv | Mean | Need | Chat | Dec | |
| Matched in-game AI | 6.2 | 5.2 | 5.4 | 6.6 | 4.8 | 7.1 | 3.6 | 7.2 | 6.6 | 4.1 | 6.5 |
| GPT-OSS-120B-Simple | Every-turn | 7.0 | 8.1 | 8.8 | 7.5 | 6.6 | 5.5 | 7.4 | 4.7 | 6.5 | 4.4 | 5.4 |
| GPT-OSS-120B-Simple | Per-5 | 6.3 | 7.4 | 8.6 | 6.6 | 5.8 | 5.3 | 5.6 | 5.3 | 6.6 | 4.3 | 5.7 |
| Opus-5.5-Simple | Per-5 | 6.3 | 6.0 | 5.9 | 6.6 | 5.3 | 6.0 | 4.8 | 4.9 | 6.1 | 4.4 | 6.1 |
| GLM-5.1-Simple | Every-turn | 6.4 | 6.6 | 7.0 | 6.0 | 7.5 | 5.9 | 5.5 | 5.1 | 5.8 | 5.5 | 3.5 |
| GLM-5.2-Simple | Every-turn | 6.3 | 6.7 | 6.5 | 6.3 | 6.1 | 4.9 | 5.3 | 5.2 | 5.6 | 5.4 | 4.5 |
| GLM-5.2-Simple | Per-5 | 6.3 | 6.5 | 6.4 | 6.3 | 6.3 | 5.5 | 4.9 | 5.1 | 5.6 | 4.9 | 5.5 |
| GLM-5.3-Simple | Per-5 | 6.3 | 6.4 | 6.5 | 6.5 | 6.6 | 4.2 | 4.8 | 5.1 | 5.6 | 6.3 | 4.7 |
| GLM-5.3-Flash-Simple | Every-turn | 6.3 | 5.6 | 5.6 | 6.4 | 4.8 | 5.6 | 4.3 | 5.7 | 6.4 | 4.8 | 6.1 |
| GLM-5.3-Flash-Simple | Per-5 | 6.3 | 5.8 | 5.4 | 6.6 | 4.9 | 6.6 | 4.3 | 5.8 | 6.4 | 4.6 | 6.1 |
| MiniMax-M2.7-Simple | Every-turn | 6.3 | 6.1 | 7.4 | 8.3 | 5.7 | 7.8 | 3.8 | 6.7 | 6.1 | 4.9 | 5.8 |
| MiniMax-M2.7-Simple | Per-5 | 6.3 | 5.8 | 6.6 | 7.3 | 5.5 | 7.4 | 3.8 | 6.5 | 6.1 | 4.9 | 5.9 |
| MiniMax-M3-Simple | Per-5 | 6.3 | 5.6 | 5.6 | 6.5 | 5.0 | 7.0 | 3.3 | 7.0 | 6.4 | 4.4 | 5.7 |
| Kimi-K2.7-Simple | Every-turn | 6.4 | 7.0 | 7.1 | 5.9 | 7.0 | 4.1 | 5.7 | 4.2 | 5.0 | 5.4 | 4.0 |
| Kimi-K2.7-Simple | Per-5 | 6.3 | 6.6 | 6.4 | 6.5 | 6.3 | 5.1 | 5.5 | 5.0 | 5.3 | 5.0 | 4.3 |
| Kimi-K2.6-Simple | Every-turn | 6.3 | 6.6 | 6.9 | 5.9 | 6.1 | 4.3 | 5.6 | 4.6 | 4.6 | 5.7 | 4.2 |
| DeepSeek-V4-Flash-Simple | Every-turn | 6.3 | 5.5 | 5.6 | 6.6 | 4.9 | 6.9 | 3.8 | 6.1 | 6.6 | 4.1 | 6.3 |
| DeepSeek-V4-Flash-Simple | Per-5 | 6.3 | 5.3 | 5.3 | 6.7 | 4.7 | 6.9 | 3.7 | 6.3 | 6.6 | 4.1 | 6.5 |
| DeepSeek-V4.1-Flash-Simple | Per-5 | 6.3 | 6.2 | 5.9 | 6.6 | 5.4 | 5.3 | 4.3 | 5.3 | 6.6 | 4.1 | 5.5 |
| Qwen-3.5-Simple | Every-turn | 6.3 | 7.4 | 8.0 | 7.6 | 7.8 | 5.7 | 5.0 | 5.0 | 4.7 | 6.5 | 4.4 |
| Qwen-3.5-Simple | Per-5 | 6.5 | 7.1 | 7.5 | 7.8 | 6.9 | 5.6 | 5.4 | 4.7 | 4.7 | 5.9 | 4.6 |
| Qwen-3.6-27B-Simple | Every-turn | 6.3 | 5.9 | 7.1 | 7.8 | 6.0 | 6.2 | 5.1 | 5.7 | 5.2 | 4.7 | 5.2 |
| Qwen-3.6-27B-Simple | Per-5 | 6.3 | 5.8 | 6.5 | 7.9 | 5.3 | 5.4 | 4.9 | 5.2 | 5.6 | 4.4 | 4.9 |
| Qwen-3.8-27B-Simple | Every-turn | 6.5 | 7.5 | 8.2 | 6.5 | 7.7 | 3.8 | 7.0 | 3.7 | 6.0 | 5.9 | 4.0 |
| Qwen-3.8-27B-Simple | Per-5 | 6.3 | 7.1 | 7.9 | 7.4 | 7.7 | 4.1 | 6.2 | 4.0 | 6.1 | 5.9 | 3.9 |
| Qwen-3.8-Flash-Next-Simple | Per-5 | 6.4 | 6.3 | 7.5 | 6.6 | 6.2 | 3.3 | 6.1 | 3.3 | 6.3 | 7.7 | 4.0 |
| Gemma-4-Simple | Every-turn | 6.3 | 5.8 | 5.7 | 7.1 | 5.0 | 6.6 | 4.0 | 6.4 | 6.6 | 4.6 | 6.4 |
| Gemma-4-Simple | Per-5 | 6.2 | 5.8 | 5.5 | 6.6 | 4.9 | 7.0 | 4.1 | 6.4 | 6.6 | 4.1 | 6.5 |
| GPT-6-Luna-Simple | Per-5 | 6.3 | 7.4 | 8.6 | 6.9 | 7.9 | 5.0 | 5.3 | 3.8 | 5.6 | 4.4 | 4.2 |
| Nemotron-3-Super-Simple | Every-turn | 6.3 | 7.4 | 8.2 | 6.4 | 8.0 | 4.1 | 7.0 | 4.5 | 6.5 | 5.3 | 4.9 |
| Nemotron-3-Super-Simple | Per-5 | 6.3 | 6.8 | 6.7 | 6.6 | 6.8 | 5.5 | 6.6 | 4.4 | 6.4 | 4.3 | 5.5 |
- 1 lowest
- 4
- 5.5 middle
- 7
- 10 highest
Commitment
| Strategist | Condition | Acts % | Revises % | Touched | Step | Net % | Persona |
|---|---|---|---|---|---|---|
| Completed-experiment average | 58 | 53 | 6.5 | 9.2 | 25 | 6.7 |
| GPT-OSS-120B-Simple | Every-turn | 96 | 45 | 4.9 | 13.8 | 10 | 17.0 |
| GPT-OSS-120B-Simple | Per-5 | 29 | 61 | 5.8 | 13.9 | 21 | 7.4 |
| Opus-5.5-Simple | Per-5 | 32 | 48 | 6.0 | 6.2 | 29 | 1.5 |
| GLM-5.1-Simple | Every-turn | 91 | 80 | 4.9 | 5.6 | 19 | 5.1 |
| GLM-5.2-Simple | Every-turn | 95 | 41 | 4.2 | 7.8 | 24 | 4.4 |
| GLM-5.2-Simple | Per-5 | 28 | 59 | 5.4 | 8.4 | 35 | 2.5 |
| GLM-5.3-Simple | Per-5 | 30 | 81 | 3.3 | 9.2 | 29 | 6.1 |
| GLM-5.3-Flash-Simple | Every-turn | 93 | 13 | 2.8 | 8.5 | 47 | 1.4 |
| GLM-5.3-Flash-Simple | Per-5 | 31 | 28 | 3.7 | 7.6 | 50 | 0.9 |
| MiniMax-M2.7-Simple | Every-turn | 91 | 11 | 3.0 | 11.3 | 45 | 4.7 |
| MiniMax-M2.7-Simple | Per-5 | 31 | 24 | 3.7 | 10.9 | 50 | 3.4 |
| MiniMax-M3-Simple | Per-5 | 29 | 15 | 6.0 | 11.7 | 63 | 3.1 |
| Kimi-K2.7-Simple | Every-turn | 99 | 64 | 9.0 | 9.4 | 6 | 11.2 |
| Kimi-K2.7-Simple | Per-5 | 31 | 82 | 10.2 | 9.1 | 13 | 5.1 |
| Kimi-K2.6-Simple | Every-turn | 94 | 52 | 7.8 | 10.7 | 9 | 8.0 |
| DeepSeek-V4-Flash-Simple | Every-turn | 99 | 13 | 4.9 | 5.0 | 39 | 0.8 |
| DeepSeek-V4-Flash-Simple | Per-5 | 31 | 45 | 5.7 | 4.5 | 29 | 0.8 |
| DeepSeek-V4.1-Flash-Simple | Per-5 | 28 | 67 | 6.6 | 4.1 | 35 | 1.1 |
| Qwen-3.5-Simple | Every-turn | 93 | 60 | 6.4 | 6.3 | 9 | 16.1 |
| Qwen-3.5-Simple | Per-5 | 34 | 74 | 7.8 | 6.2 | 15 | 9.1 |
| Qwen-3.6-27B-Simple | Every-turn | 96 | 59 | 10.4 | 7.3 | 7 | 14.2 |
| Qwen-3.6-27B-Simple | Per-5 | 30 | 79 | 12.5 | 7.5 | 13 | 5.9 |
| Qwen-3.8-27B-Simple | Every-turn | 97 | 70 | 6.3 | 8.7 | 9 | 20.0 |
| Qwen-3.8-27B-Simple | Per-5 | 30 | 95 | 11.1 | 8.7 | 12 | 14.2 |
| Qwen-3.8-Flash-Next-Simple | Per-5 | 31 | 94 | 14.4 | 5.5 | 14 | 21.0 |
| Gemma-4-Simple | Every-turn | 93 | 15 | 2.3 | 18.9 | 31 | 1.0 |
| Gemma-4-Simple | Per-5 | 31 | 42 | 2.4 | 15.7 | 33 | 1.0 |
| GPT-6-Luna-Simple | Per-5 | 32 | 85 | 7.6 | 5.7 | 19 | 3.1 |
| Nemotron-3-Super-Simple | Every-turn | 90 | 36 | 6.6 | 13.4 | 11 | 5.3 |
| Nemotron-3-Super-Simple | Per-5 | 27 | 51 | 7.8 | 13.6 | 18 | 2.9 |
- 2 SD below the average strategist
- 1 SD below
- average
- 1 SD above
- 2 SD above
Grand strategy
| Strategist | Condition | 0: France | 1: The Zulus | 2: China | 3: Egypt | 4: Mongolia | 5: Austria | 6: Morocco | 7: Songhai |
|---|---|---|---|---|---|---|---|---|
| Null | Spaceship 50% | Conquest 64% | Culture 39% | Spaceship 50% | Spaceship 55% | United Nations 58% | Spaceship 45% | Spaceship 48% |
| Vanilla | Conquest 49% | Conquest 77% | Spaceship 85% | Culture 81% | Conquest 60% | United Nations 88% | United Nations 37% | Conquest 57% |
| GPT-OSS-120B-Simple | Every-turn | Conquest 57% | Conquest 53% | United Nations 50% | United Nations 54% | Conquest 76% | United Nations 84% | United Nations 57% | Conquest 56% |
| GPT-OSS-120B-Simple | Per-5 | Conquest 71% | Spaceship 41% | Spaceship 100% | Culture 76% | Conquest 65% | United Nations 72% | United Nations 85% | Conquest 53% |
| Opus-5.5-Simple | Per-5 | Spaceship 59% | Conquest 100% | Culture 70% | Culture 97% | Conquest 52% | United Nations 100% | Culture 100% | Conquest 57% |
| GLM-5.1-Simple | Every-turn | Conquest 87% | Conquest 98% | Spaceship 51% | Culture 58% | Conquest 83% | United Nations 100% | Culture 50% | Conquest 100% |
| GLM-5.2-Simple | Every-turn | Culture 50% | Conquest 91% | Spaceship 68% | Culture 98% | Conquest 76% | United Nations 72% | Spaceship 50% | Conquest 97% |
| GLM-5.2-Simple | Per-5 | Culture 47% | Conquest 82% | Spaceship 54% | Culture 84% | Conquest 55% | United Nations 100% | Culture 50% | Conquest 96% |
| GLM-5.3-Simple | Per-5 | Conquest 100% | Conquest 100% | Spaceship 47% | Culture 80% | Conquest 58% | United Nations 96% | Culture 100% | Conquest 100% |
| GLM-5.3-Flash-Simple | Every-turn | Culture 100% | Conquest 100% | Culture 50% | Culture 81% | Conquest 75% | United Nations 100% | Culture 96% | Conquest 77% |
| GLM-5.3-Flash-Simple | Per-5 | Culture 100% | Conquest 100% | Culture 61% | Culture 100% | Conquest 100% | United Nations 100% | Culture 87% | Conquest 100% |
| MiniMax-M2.7-Simple | Every-turn | Culture 89% | Conquest 100% | Spaceship 100% | Culture 100% | Conquest 100% | Culture 50% | Culture 100% | Conquest 100% |
| MiniMax-M2.7-Simple | Per-5 | Culture 100% | Conquest 100% | Conquest 50% | Culture 100% | Conquest 50% | Culture 50% | Culture 100% | Conquest 100% |
| MiniMax-M3-Simple | Per-5 | Culture 100% | Conquest 100% | Culture 50% | Culture 100% | Conquest 100% | United Nations 78% | Culture 100% | Conquest 100% |
| Kimi-K2.7-Simple | Every-turn | Spaceship 46% | Conquest 94% | Culture 69% | Spaceship 56% | Spaceship 60% | United Nations 90% | Spaceship 88% | Conquest 95% |
| Kimi-K2.7-Simple | Per-5 | Spaceship 58% | Conquest 100% | Spaceship 62% | Culture 80% | Conquest 58% | United Nations 75% | Spaceship 55% | Conquest 67% |
| Kimi-K2.6-Simple | Every-turn | Spaceship 39% | Conquest 96% | Spaceship 78% | Culture 100% | Spaceship 52% | United Nations 90% | United Nations 47% | Conquest 63% |
| DeepSeek-V4-Flash-Simple | Every-turn | Spaceship 55% | Conquest 100% | Spaceship 87% | Culture 82% | Conquest 71% | United Nations 100% | Spaceship 59% | Conquest 100% |
| DeepSeek-V4-Flash-Simple | Per-5 | Conquest 38% | Conquest 100% | Spaceship 99% | Spaceship 66% | Conquest 77% | United Nations 100% | Spaceship 100% | Conquest 100% |
| DeepSeek-V4.1-Flash-Simple | Per-5 | Culture 90% | Conquest 100% | Culture 64% | Culture 80% | Conquest 95% | United Nations 100% | Culture 100% | Spaceship 69% |
| Qwen-3.5-Simple | Every-turn | Conquest 100% | Conquest 81% | Culture 96% | Culture 64% | Conquest 76% | United Nations 100% | United Nations 71% | Conquest 98% |
| Qwen-3.5-Simple | Per-5 | Conquest 60% | Conquest 100% | Spaceship 37% | Culture 92% | Conquest 98% | United Nations 100% | Culture 100% | Conquest 83% |
| Qwen-3.6-27B-Simple | Every-turn | Conquest 96% | Conquest 100% | Spaceship 42% | Culture 82% | Conquest 95% | Culture 82% | Culture 63% | Conquest 91% |
| Qwen-3.6-27B-Simple | Per-5 | Conquest 39% | Conquest 100% | Spaceship 62% | Culture 82% | Conquest 89% | Culture 54% | Culture 65% | Conquest 60% |
| Qwen-3.8-27B-Simple | Every-turn | Conquest 43% | Culture 68% | Culture 47% | Spaceship 54% | Culture 36% | United Nations 83% | Culture 68% | Spaceship 49% |
| Qwen-3.8-27B-Simple | Per-5 | Culture 46% | Culture 63% | Culture 39% | Spaceship 52% | Conquest 57% | United Nations 77% | United Nations 56% | Conquest 52% |
| Qwen-3.8-Flash-Next-Simple | Per-5 | Culture 68% | Conquest 96% | Culture 67% | Culture 91% | Conquest 78% | United Nations 50% | Culture 88% | Conquest 44% |
| Gemma-4-Simple | Every-turn | Conquest 57% | Conquest 100% | Spaceship 63% | Culture 84% | Conquest 100% | United Nations 59% | Spaceship 71% | Conquest 89% |
| Gemma-4-Simple | Per-5 | Conquest 62% | Conquest 100% | Spaceship 100% | Culture 100% | Conquest 100% | Culture 50% | Culture 50% | Conquest 100% |
| GPT-6-Luna-Simple | Per-5 | Spaceship 99% | Conquest 59% | Spaceship 89% | Culture 50% | Conquest 68% | United Nations 50% | Spaceship 98% | Spaceship 90% |
| Nemotron-3-Super-Simple | Every-turn | Culture 53% | Conquest 100% | Culture 53% | Culture 99% | Conquest 83% | United Nations 55% | United Nations 50% | Conquest 39% |
| Nemotron-3-Super-Simple | Per-5 | Conquest 61% | Conquest 82% | Spaceship 66% | Culture 92% | Conquest 44% | United Nations 67% | Culture 51% | Conquest 62% |
- Conquest
- Culture
- United Nations
- Spaceship
Policies
| Strategist | Condition | Ancient | Medieval | Industrial | Ideology | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Trad | Auth | Prog | Feal | Stat | Art | Ind | Imp | Rat | Free | Auto | Ord | |
| Matched in-game AI | 50 | 50 | 0 | 50 | 16 | 34 | 12 | 47 | 38 | 36 | 17 | 36 |
| Null | 94 | 94 | 94 | 75 | 56 | 75 | 50 | 38 | 31 | 38 | 6 | 50 |
| GPT-OSS-120B-Simple | Every-turn | 100 | 100 | 94 | 94 | 100 | 100 | 94 | 94 | 94 | 31 | 12 | 31 |
| GPT-OSS-120B-Simple | Per-5 | 94 | 100 | 100 | 81 | 100 | 81 | 69 | 56 | 69 | 19 | 0 | 38 |
| Opus-5.5-Simple | Per-5 | 44 | 50 | 12 | 12 | 44 | 38 | 19 | 6 | 81 | 19 | 25 | 31 |
| GLM-5.1-Simple | Every-turn | 50 | 50 | 62 | 44 | 44 | 31 | 6 | 44 | 56 | 12 | 12 | 38 |
| GLM-5.2-Simple | Every-turn | 44 | 44 | 69 | 56 | 25 | 62 | 19 | 31 | 81 | 12 | 6 | 44 |
| GLM-5.2-Simple | Per-5 | 50 | 50 | 88 | 25 | 31 | 50 | 25 | 31 | 75 | 31 | 6 | 25 |
| GLM-5.3-Simple | Per-5 | 25 | 50 | 62 | 50 | 25 | 44 | 12 | 50 | 62 | 25 | 19 | 50 |
| GLM-5.3-Flash-Simple | Every-turn | 62 | 38 | 88 | 75 | 19 | 50 | 12 | 19 | 69 | 25 | 25 | 12 |
| GLM-5.3-Flash-Simple | Per-5 | 69 | 38 | 69 | 75 | 31 | 50 | 19 | 31 | 75 | 19 | 19 | 50 |
| MiniMax-M2.7-Simple | Every-turn | 62 | 38 | 12 | 44 | 6 | 50 | 12 | 38 | 38 | 0 | 25 | 31 |
| MiniMax-M2.7-Simple | Per-5 | 69 | 56 | 0 | 44 | 31 | 56 | 19 | 19 | 62 | 19 | 19 | 31 |
| MiniMax-M3-Simple | Per-5 | 88 | 69 | 12 | 25 | 31 | 62 | 62 | 38 | 25 | 12 | 6 | 44 |
| Kimi-K2.7-Simple | Every-turn | 25 | 50 | 50 | 56 | 38 | 44 | 25 | 56 | 75 | 38 | 12 | 62 |
| Kimi-K2.7-Simple | Per-5 | 31 | 50 | 62 | 56 | 25 | 38 | 31 | 38 | 69 | 25 | 12 | 44 |
| Kimi-K2.6-Simple | Every-turn | 25 | 50 | 81 | 31 | 44 | 50 | 19 | 44 | 88 | 19 | 12 | 50 |
| DeepSeek-V4-Flash-Simple | Every-turn | 56 | 50 | 69 | 50 | 25 | 25 | 12 | 25 | 69 | 25 | 6 | 44 |
| DeepSeek-V4-Flash-Simple | Per-5 | 62 | 44 | 81 | 69 | 19 | 38 | 25 | 19 | 81 | 12 | 19 | 44 |
| DeepSeek-V4.1-Flash-Simple | Per-5 | 44 | 44 | 19 | 31 | 19 | 50 | 19 | 25 | 81 | 19 | 31 | 25 |
| Qwen-3.5-Simple | Every-turn | 88 | 81 | 100 | 62 | 100 | 81 | 50 | 69 | 50 | 12 | 38 | 31 |
| Qwen-3.5-Simple | Per-5 | 81 | 62 | 94 | 50 | 81 | 81 | 62 | 44 | 69 | 19 | 12 | 62 |
| Qwen-3.6-27B-Simple | Every-turn | 94 | 100 | 100 | 81 | 94 | 56 | 56 | 75 | 62 | 19 | 25 | 38 |
| Qwen-3.6-27B-Simple | Per-5 | 94 | 100 | 100 | 69 | 88 | 75 | 69 | 69 | 81 | 19 | 25 | 38 |
| Qwen-3.8-27B-Simple | Every-turn | 81 | 81 | 100 | 56 | 94 | 75 | 69 | 62 | 69 | 31 | 25 | 56 |
| Qwen-3.8-27B-Simple | Per-5 | 94 | 75 | 94 | 56 | 88 | 62 | 69 | 62 | 56 | 31 | 38 | 25 |
| Qwen-3.8-Flash-Next-Simple | Per-5 | 89 | 56 | 83 | 61 | 33 | 67 | 17 | 33 | 28 | 22 | 22 | 33 |
| Gemma-4-Simple | Every-turn | 81 | 69 | 94 | 31 | 62 | 38 | 62 | 94 | 94 | 19 | 19 | 38 |
| Gemma-4-Simple | Per-5 | 69 | 75 | 88 | 38 | 62 | 38 | 75 | 69 | 81 | 6 | 25 | 44 |
| GPT-6-Luna-Simple | Per-5 | 31 | 25 | 81 | 50 | 69 | 62 | 19 | 12 | 100 | 19 | 38 | 38 |
| Nemotron-3-Super-Simple | Every-turn | 88 | 56 | 100 | 62 | 81 | 69 | 44 | 38 | 75 | 19 | 12 | 38 |
| Nemotron-3-Super-Simple | Per-5 | 94 | 75 | 88 | 62 | 75 | 75 | 44 | 44 | 62 | 0 | 12 | 56 |
- 0% never
- 50%
- 100% always