This benchmark ranks text-to-image models using human comparisons of images generated from the same prompt. We curated 1,514 prompts across 25 categories, focusing on commercial applicability and ensuring reproducibility of the results. The rankings are updated continuously from 7,844,896 responses across 1,569,555 pairwise human-preference matches. All data and judgments are public; see the methodology for details on evaluation and scoring.
Table 1. Overall standings, General Image benchmark. Scores from a Bradley–Terry fit rescaled to Elo; intervals are 95% Wald intervals. Click any row to view sample outputs in Figure 1.
Figure 2. Overall Elo of each model against its list price per image, on a logarithmic axis. Prices are recorded manually from the providers’ published rates. Error bars are 95% confidence intervals of the score. Models ringed in teal and joined by the step line form the Pareto frontier: no other model has both a lower cost and a higher score. The remaining models are faded. 3 models without a cost in USD per image are not shown.
We use crowd intelligence to deliver real, diverse human feedback at scale for model evaluation and post-training.