Evaluator Observatory

Who tested whose model as of 2026-10-17

One engagement is one lab document naming one evaluator for one model: a system card that says the evaluator tested it, red-teamed it, built a test it ran, or was commissioned for a study. The cell counts them. Click a cell for the documents.

Who pays whom as of 2026-10-17

One row is one amount as the record states it: a line in a funder's grant table, a contract notice, a Form 990 or 990-PF schedule, or the recipient's own disclosure. The ranked bars sum only rows that lead with a figure and name one funder and one recipient, in US dollars; sterling and euro contracts are totalled separately. A figure quoted inside prose (a valuation, a pledge, a fund's size) stays in the row's text and is never summed.

Who sits where, and who moved as of 2026-10-17

A seat is one role at one organization, read off a team page, a governance page, an appointment notice or a filing, and sorted by which side of the arrangement it is on: evaluator, lab, government, funder. People are ranked by how many sides they hold at once. Click a name to see only that person's seats.

• Adam Gleave 6
• Geoffrey Irving 5
• Jacob Steinhardt 5
• Omer Nevo 4
• Paul Christiano 7
• Zico Kolter 7
• Dan Hendrycks 6
• Beth Barnes 5
• Buck Shlegeris 5
• Chris Painter 5
• Holden Karnofsky 5
• Jade Leung 5
• Kevin Esvelt 5
• Marius Hobbhahn 5
• Rumman Chowdhury 5
• Dan Guido 4
• Dan Lahav 4
• Jeffrey Ladish 4
• Helen Toner 3
• Ian Hogarth 3
• Ajeya Cotra 7
• Rajiv Dattani 6
• Ryan Kidd 5
• Ryan Greenblatt 4

Moves 32 rows, as of 2026-10-17

The instruments building the market as of 2026-10-17

The statutes, orders, tenders and standards that create demand for third-party evaluation, each with the status its record states and the dated milestones the pages carry. The next milestone is marked against today's date; a page that has nothing left ahead says so.

• California · statute chaptered

  California SB 813 (Chapter 179, Statutes of 2026)

  1. 20 April 2026AVERI's own legislative survey of 20 April 2026 lists SB 813 as "Create a voluntary Independent Verificatio
  2. 9 September 2026California SB 813 (Chapter 179, Statutes of 2026), sponsored by Fathom and chaptered 9 September 2026, has the Government Operations Agency designate independent
  3. 23 September 2026California: AVERI advisor Gillian Hadfield was named on 23 September 2026 to the Governor's group of experts advising on recommendati
  4. 1 January 2028nstitution, nonprofit or corporation) the agency finds to have demonstrated expertise, by 1 January 2028.

  SB 813 · Senate Judiciary · Assembly Privacy 509fd0c7c3

• California · statute chaptered

  California AB 1405 (Chapter 178)

  1. 1 January 2029the companion AB 1405 (Chapter 178) creates an AI Auditor Registry with annual fees from 1 January 2029.

  AB 1405 8331059249

• California · executive order issued

  California Executive Order N-9-26

  1. 18 September 2026Executive Order N-9-26 of 18 September 2026 moves the criteria deadline to 1 May 2027.
  2. 1 May 2027Executive Order N-9-26 of 18 September 2026 moves the criteria deadline to 1 May 2027.

  Executive Order N-9-26 6a0705dca8

• California · statute chaptered

  California SB 53

  1. 8 July 2025The Assembly Privacy committee's analysis of SB 53 (as amended 8 July 2025) says the bill "seeks to implement the recommendations of t

  SB 53 · Assembly Privacy analysis c6bdbf807e

• Illinois · statute enacted

  Illinois SB 315 (Public Act 104-0538)

  1. January 2025ILGA lists SB 315 as filed in January 2025 as a technical amendment to the Predatory Loan Prevention A
  2. 6 July 20265/SB 3261) that it describes as the predecessor of SB 315, which the Governor approved on 6 July 2026, mandating annual independent third-party audits.
  3. January 1, 2027What the enrolled Illinois text requires. Public Act 104-0538 says "This Act takes effect January 1, 2027" but starts the audit later: "Beginning on January 1, 2028
  4. January 1, 202838 says "This Act takes effect January 1, 2027" but starts the audit later: "Beginning on January 1, 2028 or 90 days after a developer first qualifies as a large fro

  Illinois General Assembly · Public Act 104-0538, as enrolled · ILGA, HB 4705 · ILGA, SB 3261 b5369198d4

• Illinois · bill endorsed

  Illinois HB 4705 / SB 3261

  1. July 2025IRS exemption issued July 2025 . - 15 January 2026. Launches with the flagship paper, "coa
  2. 15 January 2026IRS exemption issued July 2025 . - 15 January 2026. Launches with the flagship paper, "coauthored with dozens
  3. 27 March 2026Didech's (HB 4705, re-referred to Rules under Rule 19(a) on 27 March 2026) and Sen.
  4. 19 May 2026nt to the Predatory Loan Prevention Act and rewritten by Senate floor amendment on 11 and 19 May 2026, and lists HB 4705 and SB 3261, the bills AVERI endorsed, a
  5. 22 May 2026Edly-Allen's (SB 3261, re-referred to Assignments under Rule 3-9(a) on 22 May 2026).

  Illinois General Assembly · ILGA, HB 4705 · ILGA, SB 3261 040a245db3

• European Union · tender signed

  EU AI Office tender EC-CNECT/2025/OP/0032

  1. 15 December 2025a group of EquiStamp, METR and Epoch AI for EUR 1,167,484 over 36 months, contract signed 15 December 2025.

  TED 864574-2025 3c8074e038

• AI Evaluator Forum · standard published

  AEF-1, Minimum Operating Conditions for Independent Third Party AI Evaluations

  1. No dated milestone on the pages.

  AEF-1 · AI Evaluator Forum, members · AEF-1 · AI Evaluator Forum, letter fea91b8fa3

Filings on record as of 2026-10-18

For each evaluator whose profile carries an EIN: the registry, the latest return the profile has read, and the date it was read. The filings watcher asks the registry weekly whether a newer return exists; what it finds waits in a review queue until someone has read the return.

The evaluators 38 organizations, as of 2026-10-18

15 nonprofit · 17 for-profit · 3 government · 2 academic · 1 unstated. Type is read from the roster's own money column and the profile's status line; a registry id appears only where a cited page prints it.