HumanEval.org

Models

Everything we list: arena contestants with their latest official HumanEval ratings, plus models tracked only through external benchmarks — flagged “not yet evaluated” until they collect blind human votes.

ModelTypeProviderHumanEval ratingsLicenseIn / Out $/MtokContextReleased
CastleFlow v1.0not yet evaluatedText to speechAsync AIproprietary /
Claude Fable 5not yet evaluatedLLMAnthropicproprietary$10.00 / $50.002026-06-09
Claude Fable 5.1LLMAnthropicunratedproprietary$10.00 / $50.001,000,0002026-09-01
Claude Opus 4.7not yet evaluatedLLMAnthropicproprietary$5.00 / $25.002026-04-16
Claude Opus 4.8not yet evaluatedLLMAnthropicproprietary$5.00 / $25.002026-05-28
Claude Opus 5LLMAnthropicunratedproprietary$5.00 / $25.001,000,0002026-07-24
Claude Sonnet 5LLMAnthropicunratedproprietary$2.00 / $10.001,000,0002026-06-30
DeepSeek V4 Pro (0813)openLLMDeepSeekunratedMIT$0.66 / $1.981,048,5762026-08-13
Dreamina Seedance 2.0 (720p)not yet evaluatedVideo generationByteDanceproprietary /
Gemini 3.1 Flash Image (Nano Banana 2)not yet evaluatedImage generationGoogleproprietary /
Gemini 3.1 Pro Previewnot yet evaluatedLLMGoogleproprietary$1.00 / $6.002026-02-19
Gemini 3.8 FlashLLMGoogleunratedproprietary$0.75 / $3.751,048,5762026-09-02
Gemini Omni Flashnot yet evaluatedVideo generationGoogleproprietary /
GLM-5.3not yet evaluatedLLMZ.aiMIT (per LMArena listing; Epoch AI records API access only — open-weights status unconfirmed)$1.40 / $4.402026-08-14
GPT-5.4not yet evaluatedLLMOpenAIproprietary$2.50 / $15.002026-03-05
GPT-5.6 LunaLLMOpenAIunratedproprietary$0.20 / $1.201,050,0002026-07-09
GPT-5.6 Solnot yet evaluatedLLMOpenAIproprietary$4.00 / $20.002026-07-09
GPT-5.6 TerraLLMOpenAIunratedproprietary$2.00 / $12.001,050,0002026-07-09
GPT-6 AstraLLMOpenAIunratedproprietary$10.00 / $50.001,050,0002026-09-03
GPT Image 2not yet evaluatedImage generationOpenAIproprietary /
Grok 4.6LLMSpaceXAIunratedproprietary$2.00 / $6.00500,0002026-08-12
HappyHorse 1.0not yet evaluatedVideo generationAlibaba-ATHproprietary /
Hume Octavenot yet evaluatedText to speechHume AIproprietary /
Inworld TTSnot yet evaluatedText to speechInworldproprietary /
Inworld TTS MAXnot yet evaluatedText to speechInworldproprietary /
Kimi K3openLLMMoonshot AIunratedKimi K3 License (custom, open weights)$3.00 / $15.001,048,5762026-07-16
Llama 4 MaverickopenLLMMetaunratedLlama 4 Community License$0.20 / $0.701,048,5762025-04-05
MAI-Image-2.6not yet evaluatedImage generationMicrosoft AIproprietary /
MiniMax H3opennot yet evaluatedVideo generationMiniMaxMiniMax H3 Community License Agreement (per LMArena listing) /
Muse Imagenot yet evaluatedImage generationMetaproprietary /
Papla P1not yet evaluatedText to speechPaplaproprietary /
Qwen3.8 Max (0902)LLMAlibaba Qwenunratedproprietary$2.00 / $6.001,000,0002026-09-02
Reve 2.1not yet evaluatedImage generationReveproprietary /
Sora 2 Pronot yet evaluatedVideo generationOpenAIproprietary /

* provisional rating