Funding & sponsorship

Who pays for this

HumanEval.org is powered by AI Expert, the project's sponsor. Sponsorship covers the infrastructure this site runs on and the model-inference costs that keep blind battles free to run and judge. In return, AI Expert receives the "Powered by AI Expert" attribution shown in the footer of every page — and nothing else.

What sponsorship does NOT buy

• No influence on ratings. Ratings are computed by a published, deterministic methodology from anonymized vote data that anyone can download and re-run. There is no editorial step between votes and numbers.
• No say in the roster. Which models are listed, added, or retired is an operational decision recorded in the public changelog; the sponsor holds no veto and no fast lane.
• No early or privileged access. The sponsor sees leaderboards, dumps and the API exactly when and how the public does.
• No voter data. Nobody outside the platform — sponsor included — receives voter information. Public dumps carry pseudonymous voter tokens that cannot be linked back to accounts.

Conflicts of interest

If AI Expert (or any future sponsor) ships or sponsors a model that appears in our rankings, it competes under exactly the same rules as every other model: same blind battles, same eligibility filters, same published math. We will disclose any such relationship on this page and in the changelog.

Should a sponsorship arrangement ever come with conditions that conflict with the principles above, we will decline it or end it — the reproducibility promise is the product.

Verify it yourself

Independence you can check beats independence you must trust: download a nightly dump, run the open humaneval-ratings package on it, and compare your leaderboard.json digest with the published numbers. The walkthrough is on the downloads page.