Signature Science
What it was engaged to test, on what terms, what it found in the document's own words, and what happened afterwards. Every line is a record; every record links to the document it was read from.
- Founded2001
- HQAustin
- Registry idnone cited
- TestsChemistry and biology evaluation tasks (long-form virology tasks developed with SecureBio and Deloitte, per Anthropic's cards); NIST CAISI chemical and biological benchmark agreement.
- Money, as the roster puts itWholly owned subsidiary of Southwest Research Institute (nonprofit); federal awards (IARPA, BARDA, CDC, DoD, DHS subcontract); NIST CAISI ordering agreement, $3M ceiling (Oct 2025); no lab payment stated.
- Filesdossier · observatory, sliced to it · graph
- Labs tested
- Anthropic
- Span of engagements
- May 2025 – 1 September 2026
- Terms and findings
- 1 of 7 documents state a term · 1 quote a finding
- Money in, US dollars, stated single-recipient rows
- no stated figure 0 in · 0 out
- Seats, by side
- no seat names it
- Afterwards
- no later event on record
Each count is the number of store records that name this evaluator. An engagement is one lab document naming it for one model; an outcome is an event on the record afterwards; the money, seats and moves are the observatory's rows filtered to it. A cell that cannot be filled says not stated, and each table ends with how many of its rows state each field.
Filters combine: any of the values ticked within a dimension, all of the dimensions at once. A table that has no column for a dimension you have set says so instead of showing rows that cannot match. The address bar carries the slice.
What it was engaged to test 7 engagements, Anthropic
In date order, each from the lab document that names the evaluator. Under each: the four terms that document states (access, model stage, publication, payment) and the finding in its words. A term the document is silent on reads not stated; the tags beside the terms are read off their words and are what the console filters on.
- Document: Claude Opus 4 and Sonnet 4 system card
- Access windownot stated
- Model stagenot stated
- Publicationnot stated
- Paymentnot stated
Finding, in the document's words"Claude Opus 4 does substantially better in the end-to-end evaluation of both virology tasks compared to Claude Sonnet 3.7, achieving a 'max of 5' score of 0.83 for virology task 1, and a 'pass@5' score of 0.720 for virology task 2"
- Document: Claude Opus 4.6 system card
- Access windownot stated
- Model stagenot stated
- Publicationnot stated
- Paymentnot stated
Finding: not stated in the document
Sources: Claude Opus 4.6 system card 689a680f22 - Document: Claude Mythos Preview system card
- Access windownot stated
- Model stagenot stated
- Publicationnot stated
- Paymentnot stated
Finding: not stated in the document
- Document: Claude Opus 4.8 system card
- Access windownot stated
- Model stagenot stated
- Publicationnot stated
- Paymentnot stated
Finding: not stated in the document
Sources: Claude Opus 4.8 system card 5dad44fe86 - Document: Claude Fable 5 and Mythos 5 system card
- Access windownot stated
- Model stagenot stated
- Publicationnot stated
- Paymentnot stated
Finding: not stated in the document
- Document: Claude Opus 5 system card
- Access windownot stated
- Model stagenot stated
- Publicationnot stated
- Paymentnot stated
Finding: not stated in the document
Sources: Claude Opus 5 system card c381cd7b4a - Access windownot stated
- Model stagenot stated
- Publicationnot stated
- Paymentnot stated
Finding: not stated in the document
Dated 7 of 7Model named 7 of 7Terms stated 1 of 7Finding quoted 1 of 7
The terms, as the documents state them
The same engagements as a grid, one row per document and model, so the silences line up: a document that gives an access window but no payment term, or a finding but no publication term, reads that way here.
| Document | Model | Access window | Model stage | Publication | Payment | Finding | Record |
|---|---|---|---|---|---|---|---|
| Claude Opus 4 and Sonnet 4 system cardAnthropic · May 2025 | Claude Opus 4 | not stated | not stated | not stated | not stated | quoted | b4361c8d53 |
| Claude Opus 4.6 system cardAnthropic · February 2026 | Opus 4.6 | not stated | not stated | not stated | not stated | not stated | 689a680f22 |
| Claude Mythos Preview system cardAnthropic · 7 April 2026 | Mythos Preview | not stated | not stated | not stated | not stated | not stated | 077172c50e |
| Claude Opus 4.8 system cardAnthropic · 28 May 2026 | Opus 4.8 | not stated | not stated | not stated | not stated | not stated | 5dad44fe86 |
| Claude Fable 5 and Mythos 5 system cardAnthropic · 9 June 2026 | Fable 5 / Mythos 5 | not stated | not stated | not stated | not stated | not stated | cd94f7dc15 |
| Claude Opus 5 system cardAnthropic · 24 July 2026 | Opus 5 | not stated | not stated | not stated | not stated | not stated | c381cd7b4a |
| Claude Fable 5.1 and Mythos 5.1 system cardAnthropic · 1 September 2026 | Fable 5.1 / Mythos 5.1 | not stated | not stated | not stated | not stated | not stated | 012a592b31 |
Access window 0 of 7Model stage 0 of 7Publication 0 of 7Payment 0 of 7Finding, quoted 1 of 7
What happened afterwards 0 on record
Events a party published after an engagement: an incident on a model this evaluator's engagement covered, a correction or added disclosure, a later finding that cut against an earlier one, a lab's statement that it acted or did not act on the finding, or a move from this evaluator to a lab it graded. A row the source attaches to this evaluator by name is marked named; one that reaches it through the model it tested is marked via the model. The kind is what the record states, not why.
| Kind | Developer | Model | What the record states | When | Source | Id |
|---|---|---|---|---|---|---|
| no later event on record | ||||||
Dated 0 of 0Model named 0 of 0Tied to an engagement 0 of 0Evaluator named by the record 0 of 0
The money on record 0 rows
Rows of the observatory's money table that name this evaluator as recipient (in) or as funder (out), each as the record states it: a grant table line, a contract notice, a Form 990 schedule or the party's own disclosure. A figure quoted in prose is marked and never summed.
| Direction | Funder | Recipient | Amount, as recorded | When | Record | Source | Id |
|---|---|---|---|---|---|---|---|
| no money row names this evaluator | |||||||
Amount stated 0 of 0Dated 0 of 0Purpose stated 0 of 0Funder profiled 0 of 0Recipient on the roster 0 of 0
Seats and moves 0 seats · 0 moves
Seats read off a team page, a governance page, an appointment notice or a filing that name this organization, and the dated moves into or out of it, from the observatory's own tables.
| Person | Side | Seat, as the record states it | Role | Dates | Source | Id |
|---|---|---|---|---|---|---|
| no seat on record names this evaluator | ||||||
Role read 0 of 0Organization read 0 of 0Organization profiled 0 of 0Dated 0 of 0
Moves
| Person | From | To | When | Source | Id | |
|---|---|---|---|---|---|---|
| no move on record names this evaluator | ||||||
From profiled 0 of 0To profiled 0 of 0Person profiled 0 of 0Dated 0 of 0