GPT-4o (Aug '24) vs Gemini 2.0 Flash-Lite (Feb '25) | grube.ai

Back to Benchmarks

GPT-4o (Aug '24)

OpenAI

vs

Gemini 2.0 Flash-Lite (Feb '25)

Google

Gemini 2.0 Flash-Lite (Feb '25) wins 6 of 11

Index Scores

18.6

+3.9

Intelligence

14.7

16.6

+16.6

Coding

0.0

0.0

Math

0.0

Benchmarks

0.0

MMLU Pro

+72.4

72.4

52.1

GPQA

+1.4

53.5

2.9

HLE

+0.7

3.6

31.7

+13.2

LiveCode

18.5

33.1

+8.1

SciCode

25.0

79.5

MATH-500

+7.8

87.3

11.7

AIME

+16.0

27.7

Speed

14

TPS

+8

22

Shared

Winning delta

crafted by bart stefanski