Model Comparison Leaderboard
Category
Google
Imagen 4.0 Ultra
OpenAI
ChatGPT 4o
Google
Nano Banana (2.5 Flash)
Google
Imagen 3.0
Ideogram
Ideogram V2
Reve
Reve Image (Halfmoon)
Black Forest Labs
FLUX.1 Kontext Max
Black Forest Labs
Flux 1.1 Pro Ultra
Recraft
Recraft V3
Bytedance
Seedream 3.0
Ideogram
Ideogram 3.0 (Quality)
Midjourney
Midjourney V6.1
Minimax
MiniMax Image-01
Midjourney
Midjourney v7
OpenAI
DALL-E 3
XAI
Grok 2 Image
Overall Score
(100 examples)
Avg: 8.79 / 10
Avg: 8.47 / 10
Refusals: 11
Avg: 8.45 / 10
Avg: 8.42 / 10
Refusals: 3
Avg: 7.61 / 10
Avg: 7.61 / 10
Avg: 7.61 / 10
Refusals: 6
Avg: 7.60 / 10
Refusals: 1
Avg: 7.58 / 10
Avg: 7.30 / 10
Avg: 7.30 / 10
Avg: 7.16 / 10
Refusals: 2
Avg: 7.15 / 10
Avg: 6.87 / 10
Refusals: 2
Avg: 6.84 / 10
Avg: 5.54 / 10
Refusals: 1
(10 examples)
Avg Score: 7.84
Avg Score: 7.84
9.40 / 10
7.75 / 10
Refusals: 2
8.90 / 10
8.40 / 10
8.50 / 10
7.30 / 10
8.30 / 10
7.80 / 10
6.90 / 10
8.50 / 10
7.30 / 10
8.10 / 10
7.40 / 10
7.30 / 10
8.40 / 10
5.20 / 10
(10 examples)
Avg Score: 8.57
Avg Score: 8.57
9.60 / 10
9.57 / 10
Refusals: 3
9.40 / 10
8.90 / 10
8.90 / 10
8.70 / 10
8.30 / 10
8.10 / 10
8.60 / 10
8.30 / 10
8.60 / 10
8.70 / 10
8.70 / 10
8.70 / 10
8.40 / 10
6.00 / 10
(10 examples)
Avg Score: 7.32
Avg Score: 7.32
9.00 / 10
8.00 / 10
Refusals: 1
8.30 / 10
9.38 / 10
Refusals: 2
8.30 / 10
7.80 / 10
8.22 / 10
Refusals: 1
7.67 / 10
Refusals: 1
6.30 / 10
6.70 / 10
6.20 / 10
7.50 / 10
7.10 / 10
7.10 / 10
5.10 / 10
4.78 / 10
Refusals: 1
(10 examples)
Avg Score: 7.93
Avg Score: 7.93
8.90 / 10
9.57 / 10
Refusals: 3
9.20 / 10
9.50 / 10
7.20 / 10
7.50 / 10
8.62 / 10
Refusals: 2
7.80 / 10
7.50 / 10
9.30 / 10
6.80 / 10
7.12 / 10
Refusals: 2
7.70 / 10
8.12 / 10
Refusals: 2
7.00 / 10
5.50 / 10
(10 examples)
Avg Score: 7.07
Avg Score: 7.07
8.50 / 10
8.30 / 10
8.20 / 10
6.40 / 10
7.40 / 10
8.50 / 10
7.60 / 10
7.30 / 10
8.40 / 10
5.70 / 10
6.30 / 10
5.40 / 10
5.70 / 10
6.50 / 10
7.60 / 10
5.30 / 10
(10 examples)
Avg Score: 7.76
Avg Score: 7.76
9.00 / 10
8.20 / 10
8.60 / 10
9.20 / 10
7.90 / 10
7.80 / 10
7.60 / 10
8.80 / 10
8.00 / 10
6.50 / 10
7.20 / 10
7.90 / 10
7.30 / 10
8.80 / 10
5.80 / 10
5.50 / 10
(10 examples)
Avg Score: 7.66
Avg Score: 7.66
7.80 / 10
9.00 / 10
Refusals: 1
8.80 / 10
9.33 / 10
Refusals: 1
7.60 / 10
7.30 / 10
6.70 / 10
7.70 / 10
8.50 / 10
8.20 / 10
8.00 / 10
7.10 / 10
7.60 / 10
7.40 / 10
5.30 / 10
6.60 / 10
(10 examples)
Avg Score: 7.78
Avg Score: 7.78
9.00 / 10
8.80 / 10
8.30 / 10
8.70 / 10
7.10 / 10
6.30 / 10
8.10 / 10
7.70 / 10
7.10 / 10
8.70 / 10
7.90 / 10
8.00 / 10
7.10 / 10
7.10 / 10
9.00 / 10
5.50 / 10
(10 examples)
Avg Score: 7.61
Avg Score: 7.61
9.20 / 10
9.60 / 10
8.50 / 10
8.00 / 10
8.30 / 10
8.30 / 10
6.00 / 10
7.80 / 10
8.40 / 10
6.30 / 10
9.00 / 10
7.60 / 10
7.70 / 10
3.70 / 10
6.50 / 10
6.80 / 10
(10 examples)
Avg Score: 5.58
Avg Score: 5.58
7.50 / 10
6.22 / 10
Refusals: 1
6.30 / 10
6.70 / 10
4.90 / 10
6.60 / 10
6.57 / 10
Refusals: 3
5.30 / 10
6.10 / 10
4.80 / 10
5.70 / 10
4.20 / 10
5.20 / 10
4.20 / 10
5.30 / 10
4.10 / 10