Back to Benchmarks
GPT-4o (Aug '24) vs GPT-4.1 nano
GPT-4o (Aug '24)
OpenAI
vs
GPT-4.1 nano
OpenAI
GPT-4.1 nano wins 7 of 11
Index Scores
18.6
+5.6
Intelligence
13.0
16.6
+5.4
Coding
11.2
0.0
Math
+24.0
24.0
Benchmarks
0.0
MMLU Pro
+65.7
65.7
52.1
+0.9
GPQA
51.2
2.9
HLE
+1.0
3.9
31.7
LiveCode
+0.9
32.6
33.1
+7.2
SciCode
25.9
79.5
MATH-500
+5.3
84.8
11.7
AIME
+12.0
23.7
Speed
14
TPS
+21
35
Shared
Winning delta
crafted by
bart stefanski