HumanEval.org

Models

GPT-6 Astra

Compare with…

HumanEval ratings

Not rated yet — ratings appear with the next official snapshot once this model has eligible votes.

External benchmarks

Curated third-party results, shown as context with provenance — the HumanEval rating from blind human votes remains the verdict.

General Intelligence

LiveBench — Overall82.22026-09-07LiveBench

Reasoning

LiveBench — Reasoning92.72026-09-07LiveBench
GPQA Diamond95.8%93.1% 98.5%2026-08-30Epoch AI Benchmarking Hub

Coding

LiveBench — Coding80.42026-09-07LiveBench

Mathematics

LiveBench — Mathematics96.82026-09-07LiveBench
OTIS Mock AIME 2024–2025100.0%100.0% 100.0%2026-08-30Epoch AI Benchmarking Hub

Agentic

LiveBench — Agentic Coding57.32026-09-07LiveBench
Terminal-Bench 4.058.2%55.4% 61.0%2026-09-03Terminal-Bench

Language

LiveBench — Language89.42026-09-07LiveBench

Data analytics

LiveBench — Data Analysis83.02026-09-07LiveBench

Instruction following

LiveBench — Instruction Following75.62026-09-07LiveBench

Benchmark percentile by metric group

Percentile of this model within the 19 listed LLM models per metric group (100 = best, averaged across the group's external benchmarks), against the roster median. External data only — not the HumanEval rating.

Win rate by opponent

No eligible head-to-head votes yet. Ties count as half a win for each side.

Sample battles

Curated prompts only, with vote tallies — voter identities are never published.

No published sample battles yet — battles appear here once this model has eligible votes on curated prompts.