Back to Benchmarks

Qwen3.5 397B A17B (Reasoning) vs GPT-4o (Aug '24)

Qwen3.5 397B A17B (Reasoning)

Alibaba

vs

GPT-4o (Aug '24)

OpenAI

Qwen3.5 397B A17B (Reasoning) wins 6 of 11

Index Scores

45.0
+26.4
Intelligence
18.6
41.3
+24.7
Coding
16.6
0.0
Math
0.0

Benchmarks

0.0
MMLU Pro
0.0
89.3
+37.2
GPQA
52.1
27.3
+24.4
HLE
2.9
0.0
LiveCode
+31.7
31.7
42.0
+8.9
SciCode
33.1
0.0
MATH-500
+79.5
79.5
0.0
AIME
+11.7
11.7

Speed

53
+39
TPS
14
Shared
Winning delta

crafted by bart stefanski