evilrobots.lol / tech / evaluator record

Artificial Analysis

What it was engaged to test, on what terms, what it found in the document's own words, and what happened afterwards. Every line is a record; every record links to the document it was read from.

▣ THE RECORD for-profit Commercial benchmark and certification firms STORE 2026-10-18
  • Foundednot stated
  • HQSan Francisco
  • Registry idnone cited (company)
  • TestsModel intelligence, speed and price benchmarking (Intelligence Index, Cyber Index, AA-AgentPerf for chips).
  • Money, as the roster puts itVenture-backed company; investors listed by name without amounts; enterprise subscription and private benchmarking for AI companies, "no one pays to be on the website".
  • Filesdossier · observatory, sliced to it · graph
Labs tested
Mistral AI
Models
Mistral Large 4 (preview)
Span of engagements
6 October 2026 – 6 October 2026
Terms and findings
0 of 1 documents state a term · 0 quote a finding
Money in, US dollars, stated single-recipient rows
no stated figure 6 in · 0 outfrom Nat Friedman
Seats, by side
no seat names it
Afterwards
no later event on record

Each count is the number of store records that name this evaluator. An engagement is one lab document naming it for one model; an outcome is an event on the record afterwards; the money, seats and moves are the observatory's rows filtered to it. A cell that cannot be filled says not stated, and each table ends with how many of its rows state each field.

▣ SLICE 7 / 7 records
Lab
Model
Engagement
Terms
Funder
year, month or day

Filters combine: any of the values ticked within a dimension, all of the dimensions at once. A table that has no column for a dimension you have set says so instead of showing rows that cannot match. The address bar carries the slice.

What it was engaged to test 1 engagements, Mistral AI

In date order, each from the lab document that names the evaluator. Under each: the four terms that document states (access, model stage, publication, payment) and the finding in its words. A term the document is silent on reads not stated; the tags beside the terms are read off their words and are what the console filters on.

    • Access windownot stated
    • Model stagenot stated
    • Publicationnot stated
    • Paymentnot stated

    Finding: not stated in the document

Dated 1 of 1Model named 1 of 1Terms stated 0 of 1Finding quoted 0 of 1

The terms, as the documents state them

The same engagements as a grid, one row per document and model, so the silences line up: a document that gives an access window but no payment term, or a finding but no publication term, reads that way here.

DocumentModelAccess windowModel stagePublicationPaymentFindingRecord
Introducing Mistral Large 4Mistral AI · 6 October 2026Mistral Large 4 (preview)not statednot statednot statednot statednot stated4a21c61117

Access window 0 of 1Model stage 0 of 1Publication 0 of 1Payment 0 of 1Finding, quoted 0 of 1

What happened afterwards 0 on record

Events a party published after an engagement: an incident on a model this evaluator's engagement covered, a correction or added disclosure, a later finding that cut against an earlier one, a lab's statement that it acted or did not act on the finding, or a move from this evaluator to a lab it graded. A row the source attaches to this evaluator by name is marked named; one that reaches it through the model it tested is marked via the model. The kind is what the record states, not why.

KindDeveloperModelWhat the record statesWhenSourceId
no later event on record

Dated 0 of 0Model named 0 of 0Tied to an engagement 0 of 0Evaluator named by the record 0 of 0

The money on record 6 rows

Rows of the observatory's money table that name this evaluator as recipient (in) or as funder (out), each as the record states it: a grant table line, a contract notice, a Form 990 schedule or the party's own disclosure. A figure quoted in prose is marked and never summed.

DirectionFunderRecipientAmount, as recordedWhenRecordSourceId
inNat FriedmanEpoch AI; MECHANIZE; Artificial Analysisno amount publishedFunded a pilot of FrontierMathnot datedparty's own pageEpoch AI; Mechanize; Artificial Analysis; AIUC, Series A; Fortune, Oct 8 2025; Meta memo via CNBC16a5ebe3a8
inNat FriedmanEpoch AI; MECHANIZE; Artificial Analysisno amount publishedfirst-named backer of Mechanizenot datedparty's own pageEpoch AI; Mechanize; Artificial Analysis; AIUC, Series A; Fortune, Oct 8 2025; Meta memo via CNBCcf9b872cbf
inNat FriedmanEpoch AI; MECHANIZE; Artificial Analysisno amount publishedfirst-named of the eight backers on Artificial Analysis's About page, no amount statednot datedparty's own pageEpoch AI; Mechanize; Artificial Analysis; AIUC, Series A; Fortune, Oct 8 2025; Meta memo via CNBC5e85e6667c
inNat FriedmanEpoch AI; MECHANIZE; Artificial Analysis$55,000,000named on AIUC's team page among its $55 million investors, and AIUC's Series A post counts "our $15 million seed round from NFDG"investors, and AIUC's Series A post counts "our $15 million seed round from NFDG"not datedparty's own pageEpoch AI; Mechanize; Artificial Analysis; AIUC, Series A; Fortune, Oct 8 2025; Meta memo via CNBC4aef243df2
inNat FriedmanEpoch AI; MECHANIZE; Artificial Analysisno amount publishedFortune names him among the seeders of Situational Awareness LPnot datedparty's own pageEpoch AI; Mechanize; Artificial Analysis; AIUC, Series A; Fortune, Oct 8 2025; Meta memo via CNBC0291b6507f
inNat FriedmanEpoch AI; MECHANIZE; Artificial Analysisno amount publishedsince June 2025 co-lead of Meta Superintelligence Labs for AI products and applied research, per Meta's 30 June 2025 memoJune 2025party's own pageEpoch AI; Mechanize; Artificial Analysis; AIUC, Series A; Fortune, Oct 8 2025; Meta memo via CNBC835d93c2fa

Amount stated 1 of 6Dated 1 of 6Purpose stated 1 of 6Funder profiled 6 of 6Recipient on the roster 6 of 6

Seats and moves 0 seats · 0 moves

Seats read off a team page, a governance page, an appointment notice or a filing that name this organization, and the dated moves into or out of it, from the observatory's own tables.

PersonSideSeat, as the record states itRoleDatesSourceId
no seat on record names this evaluator

Role read 0 of 0Organization read 0 of 0Organization profiled 0 of 0Dated 0 of 0

Moves

PersonFromToWhenSourceId
no move on record names this evaluator

From profiled 0 of 0To profiled 0 of 0Person profiled 0 of 0Dated 0 of 0