Back to Benchmarks

Gemma 4 31B (Reasoning) vs GPT-4o (Aug '24)

Gemma 4 31B (Reasoning)

Googlevia DeepInfra

vs

GPT-4o (Aug '24)

OpenAI

Gemma 4 31B (Reasoning)(DeepInfra) wins 6 of 11

Index Scores

39.2
+20.6
Intelligence
18.6
38.7
+22.1
Coding
16.6
0.0
Math
0.0

Benchmarks

0.0
MMLU Pro
0.0
85.7
+33.6
GPQA
52.1
22.7
+19.8
HLE
2.9
0.0
LiveCode
+31.7
31.7
43.4
+10.3
SciCode
33.1
0.0
MATH-500
+79.5
79.5
0.0
AIME
+11.7
11.7

Speed

32
+18
TPS
14
Shared
Winning delta

crafted by bart stefanski