HumanEval.org

Models

Qwen3.8 Max (0902)

Compare with…

HumanEval ratings

Not rated yet — ratings appear with the next official snapshot once this model has eligible votes.

External benchmarks

Curated third-party results, shown as context with provenance — the HumanEval rating from blind human votes remains the verdict.

General Intelligence

LMArena Text Arena (overall)14801474 14862026-09-02LMArena
LiveBench — Overall78.52026-09-07LiveBench

Reasoning

LiveBench — Reasoning88.22026-09-07LiveBench
GPQA Diamond92.7%89.4% 96.0%2026-08-04Epoch AI Benchmarking Hub

Coding

LiveBench — Coding72.92026-09-07LiveBench

Mathematics

LiveBench — Mathematics91.32026-09-07LiveBench
OTIS Mock AIME 2024–202599.4%98.7% 100.2%2026-08-04Epoch AI Benchmarking Hub

Agentic

LiveBench — Agentic Coding64.72026-09-07LiveBench

Language

LiveBench — Language79.72026-09-07LiveBench

Data analytics

LiveBench — Data Analysis78.42026-09-07LiveBench

Instruction following

LiveBench — Instruction Following74.12026-09-07LiveBench

Benchmark percentile by metric group

Percentile of this model within the 19 listed LLM models per metric group (100 = best, averaged across the group's external benchmarks), against the roster median. External data only — not the HumanEval rating.

Win rate by opponent

No eligible head-to-head votes yet. Ties count as half a win for each side.

Sample battles

Curated prompts only, with vote tallies — voter identities are never published.

No published sample battles yet — battles appear here once this model has eligible votes on curated prompts.