Back to Benchmarks

GPT-4o (Aug '24) vs Llama 4 Scout

GPT-4o (Aug '24)

OpenAI

vs

Llama 4 Scout

Metavia Groq

Llama 4 Scout(Groq) wins 7 of 11

Index Scores

18.6
+5.1
Intelligence
13.5
16.6
+9.9
Coding
6.7
0.0
Math
+14.0
14.0

Benchmarks

0.0
MMLU Pro
+75.2
75.2
52.1
GPQA
+6.6
58.7
2.9
HLE
+1.4
4.3
31.7
+1.8
LiveCode
29.9
33.1
+16.1
SciCode
17.0
79.5
MATH-500
+4.9
84.4
11.7
AIME
+16.6
28.3

Speed

14
TPS
+86
100
Shared
Winning delta

crafted by bart stefanski