Trail of Bits
What it was engaged to test, on what terms, what it found in the document's own words, and what happened afterwards. Every line is a record; every record links to the document it was read from.
- Founded2012
- HQNew York City
- Registry idnone cited (company)
- TestsSecurity audits; "AI/ML evaluation".
- Money, as the roster puts itClient-funded; in acquisition talks with OpenAI.
- Filesdossier · observatory, sliced to it · graph
- Labs tested
- no lab document names it
- Models
- no model named
- Span of engagements
- none dated
- Terms and findings
- 0 of 0 documents state a term · 0 quote a finding
- Money in, US dollars, stated single-recipient rows
- no stated figure 2 in · 0 outfrom UK DSIT
- Seats, by side
- evaluator 1 1 person: Dan Guido
- Afterwards
- no later event on record
Each count is the number of store records that name this evaluator. An engagement is one lab document naming it for one model; an outcome is an event on the record afterwards; the money, seats and moves are the observatory's rows filtered to it. A cell that cannot be filled says not stated, and each table ends with how many of its rows state each field.
Filters combine: any of the values ticked within a dimension, all of the dimensions at once. A table that has no column for a dimension you have set says so instead of showing rows that cannot match. The address bar carries the slice.
What it was engaged to test 0 engagements
In date order, each from the lab document that names the evaluator. Under each: the four terms that document states (access, model stage, publication, payment) and the finding in its words. A term the document is silent on reads not stated; the tags beside the terms are read off their words and are what the console filters on.
No lab document on record names this evaluator for a model.
Dated 0 of 0Model named 0 of 0Terms stated 0 of 0Finding quoted 0 of 0
The terms, as the documents state them
The same engagements as a grid, one row per document and model, so the silences line up: a document that gives an access window but no payment term, or a finding but no publication term, reads that way here.
| Document | Model | Access window | Model stage | Publication | Payment | Finding | Record |
|---|---|---|---|---|---|---|---|
| no engagement on record | |||||||
Access window 0 of 0Model stage 0 of 0Publication 0 of 0Payment 0 of 0Finding, quoted 0 of 0
What happened afterwards 0 on record
Events a party published after an engagement: an incident on a model this evaluator's engagement covered, a correction or added disclosure, a later finding that cut against an earlier one, a lab's statement that it acted or did not act on the finding, or a move from this evaluator to a lab it graded. A row the source attaches to this evaluator by name is marked named; one that reaches it through the model it tested is marked via the model. The kind is what the record states, not why.
| Kind | Developer | Model | What the record states | When | Source | Id |
|---|---|---|---|---|---|---|
| no later event on record | ||||||
Dated 0 of 0Model named 0 of 0Tied to an engagement 0 of 0Evaluator named by the record 0 of 0
The money on record 2 rows
Rows of the observatory's money table that name this evaluator as recipient (in) or as funder (out), each as the record states it: a grant table line, a contract notice, a Form 990 schedule or the party's own disclosure. A figure quoted in prose is marked and never summed.
| Direction | Funder | Recipient | Amount, as recorded | When | Record | Source | Id |
|---|---|---|---|---|---|---|---|
| in | UK DSIT | Trail of Bits | £255,600£255,600 | not dated | contract notice | Find a Tender; Find a Tender; Contracts Finder; Contracts Finder; Contracts Finder; Find a Tender, variation | 7f7837322d |
| in | UK DSIT | Trail of Bits | £255,600£255,600"AI Safety Guardrails Evaluation"; "The services can only be supplied by Trail of Bits, Inc. owing to technical reasons." | January 2024 | contract notice | Find a Tender | bb82cdb61a |
Amount stated 2 of 2Dated 1 of 2Purpose stated 1 of 2Funder profiled 0 of 2Recipient on the roster 2 of 2
Seats and moves 1 seats · 0 moves
Seats read off a team page, a governance page, an appointment notice or a filing that name this organization, and the dated moves into or out of it, from the observatory's own tables.
| Person | Side | Seat, as the record states it | Role | Dates | Source | Id |
|---|---|---|---|---|---|---|
| Dan Guidoslice | evaluator | CEO and co-founder, Trail of Bits | CEO and co-founder | dates not stated | Trail of Bits | 0ba770089f |
Role read 1 of 1Organization read 1 of 1Organization profiled 1 of 1Dated 0 of 1
Moves
| Person | From | To | When | Source | Id | |
|---|---|---|---|---|---|---|
| no move on record names this evaluator | ||||||
From profiled 0 of 0To profiled 0 of 0Person profiled 0 of 0Dated 0 of 0