Epoch AI

What it was engaged to test 2 engagements, OpenAI, Anthropic

In date order, each from the lab document that names the evaluator. Under each: the four terms that document states (access, model stage, publication, payment) and the finding in its words. A term the document is silent on reads not stated; the tags beside the terms are read off their words and are what the console filters on.

1. 23 January 2025 OpenAI · FrontierMath commissioned study

   Document: Epoch AI, the FrontierMath commission

   • Access window"OpenAI retains ownership of these questions and has access to the problems and solutions, with the exception of a holdout set"
   • Model stagenot stated
   • Publication"Epoch AI is free to conduct and publish evaluations of any models using the FrontierMath problem set commissioned by OpenAI. However, we cannot share the questions and answers with other parties without written permission from OpenAI"
   • Payment"OpenAI commissioned Epoch AI to produce 300 advanced math problems for AI evaluation that form the core of the FrontierMath benchmark"

   NDA or private materialpublication right statedpaid or commissioned

   Finding: not stated in the document

   Afterwards: correction

   Sources: Epoch AI, the FrontierMath commission e53c356823
2. 7 April 2026 Anthropic · no model named benchmark co-build

   Document: Anthropic, Claude Mythos Preview system card, Apr 2026 Its capabilities index forked by Anthropic: "we fork from Epoch AI's implementation of this work, the Epoch Capabilities Index (ECI)"

   • Access windownot stated
   • Model stagenot stated
   • Publicationnot stated
   • Paymentnot stated

   no term stated

   Finding: not stated in the document

   Sources: Anthropic, Claude Mythos Preview system card, Apr 2026 15e43e308c

Dated 2 of 2Model named 1 of 2Terms stated 1 of 2Finding quoted 0 of 2

The terms, as the documents state them

The same engagements as a grid, one row per document and model, so the silences line up: a document that gives an access window but no payment term, or a finding but no publication term, reads that way here.

Access window 1 of 2Model stage 0 of 2Publication 1 of 2Payment 1 of 2Finding, quoted 0 of 2

What happened afterwards 3 on record

Events a party published after an engagement: an incident on a model this evaluator's engagement covered, a correction or added disclosure, a later finding that cut against an earlier one, a lab's statement that it acted or did not act on the finding, or a move from this evaluator to a lab it graded. A row the source attaches to this evaluator by name is marked named; one that reaches it through the model it tested is marked via the model. The kind is what the record states, not why.

• correction2
• staff move1

Dated 3 of 3Model named 2 of 3Tied to an engagement 1 of 3Evaluator named by the record 3 of 3

The money on record 24 rows · $95,600,897 in, stated single-recipient rows

Rows of the observatory's money table that name this evaluator as recipient (in) or as funder (out), each as the record states it: a grant table line, a contract notice, a Form 990 schedule or the party's own disclosure. A figure quoted in prose is marked and never summed.

Amount stated 11 of 24Dated 16 of 24Purpose stated 6 of 24Funder profiled 24 of 24Recipient on the roster 24 of 24

Seats and moves 6 seats · 4 moves

Seats read off a team page, a governance page, an appointment notice or a filing that name this organization, and the dated moves into or out of it, from the observatory's own tables.

Role read 6 of 6Organization read 6 of 6Organization profiled 6 of 6Dated 4 of 6

Moves

From profiled 4 of 4To profiled 4 of 4Person profiled 4 of 4Dated 4 of 4

Filings

• IRS (via ProPublica Nonprofit Explorer) 99-4050541: FY2024 Form 990-EZ read 2026-10-17ProPublica Nonprofit Explorer 07d1145c35