Charlemagne Labs
What it was engaged to test, on what terms, what it found in the document's own words, and what happened afterwards. Every line is a record; every record links to the document it was read from.
- Foundednot stated
- HQnot stated
- Registry idnone cited
- TestsMulti-turn social-engineering capability benchmark (852 scenarios) and a scam threat model, named in Meta's Muse Spark Safety & Preparedness Report and Muse Spark 1.1 Evaluation Report; also sells Agent Charley, an on-device social-engineering defense.
- Money, as the roster puts itStartup; no investor, round or revenue stated on its pages; CEO listed with 12+ years at Meta on its About page.
- Filesdossier · observatory, sliced to it · graph
- Labs tested
- Meta
- Models
- Muse SparkMuse Spark 1.1
- Span of engagements
- 26 May 2026 – 9 July 2026
- Terms and findings
- 0 of 2 documents state a term · 0 quote a finding
- Money in, US dollars, stated single-recipient rows
- no stated figure 0 in · 0 out
- Seats, by side
- no seat names it
- Afterwards
- no later event on record
Each count is the number of store records that name this evaluator. An engagement is one lab document naming it for one model; an outcome is an event on the record afterwards; the money, seats and moves are the observatory's rows filtered to it. A cell that cannot be filled says not stated, and each table ends with how many of its rows state each field.
Filters combine: any of the values ticked within a dimension, all of the dimensions at once. A table that has no column for a dimension you have set says so instead of showing rows that cannot match. The address bar carries the slice.
What it was engaged to test 2 engagements, Meta
In date order, each from the lab document that names the evaluator. Under each: the four terms that document states (access, model stage, publication, payment) and the finding in its words. A term the document is silent on reads not stated; the tags beside the terms are read off their words and are what the console filters on.
- Access windownot stated
- Model stagenot stated
- Publicationnot stated
- Paymentnot stated
Finding: not stated in the document
- Document: Muse Spark 1.1 Evaluation Report
- Access windownot stated
- Model stagenot stated
- Publicationnot stated
- Paymentnot stated
Finding: not stated in the document
Dated 2 of 2Model named 2 of 2Terms stated 0 of 2Finding quoted 0 of 2
The terms, as the documents state them
The same engagements as a grid, one row per document and model, so the silences line up: a document that gives an access window but no payment term, or a finding but no publication term, reads that way here.
| Document | Model | Access window | Model stage | Publication | Payment | Finding | Record |
|---|---|---|---|---|---|---|---|
| Muse Spark Safety and Preparedness ReportMeta · 26 May 2026 | Muse Spark | not stated | not stated | not stated | not stated | not stated | cfb15f7785 |
| Muse Spark 1.1 Evaluation ReportMeta · 9 July 2026 | Muse Spark 1.1 | not stated | not stated | not stated | not stated | not stated | 277e8ddfa5 |
Access window 0 of 2Model stage 0 of 2Publication 0 of 2Payment 0 of 2Finding, quoted 0 of 2
What happened afterwards 0 on record
Events a party published after an engagement: an incident on a model this evaluator's engagement covered, a correction or added disclosure, a later finding that cut against an earlier one, a lab's statement that it acted or did not act on the finding, or a move from this evaluator to a lab it graded. A row the source attaches to this evaluator by name is marked named; one that reaches it through the model it tested is marked via the model. The kind is what the record states, not why.
| Kind | Developer | Model | What the record states | When | Source | Id |
|---|---|---|---|---|---|---|
| no later event on record | ||||||
Dated 0 of 0Model named 0 of 0Tied to an engagement 0 of 0Evaluator named by the record 0 of 0
The money on record 0 rows
Rows of the observatory's money table that name this evaluator as recipient (in) or as funder (out), each as the record states it: a grant table line, a contract notice, a Form 990 schedule or the party's own disclosure. A figure quoted in prose is marked and never summed.
| Direction | Funder | Recipient | Amount, as recorded | When | Record | Source | Id |
|---|---|---|---|---|---|---|---|
| no money row names this evaluator | |||||||
Amount stated 0 of 0Dated 0 of 0Purpose stated 0 of 0Funder profiled 0 of 0Recipient on the roster 0 of 0
Seats and moves 0 seats · 0 moves
Seats read off a team page, a governance page, an appointment notice or a filing that name this organization, and the dated moves into or out of it, from the observatory's own tables.
| Person | Side | Seat, as the record states it | Role | Dates | Source | Id |
|---|---|---|---|---|---|---|
| no seat on record names this evaluator | ||||||
Role read 0 of 0Organization read 0 of 0Organization profiled 0 of 0Dated 0 of 0
Moves
| Person | From | To | When | Source | Id | |
|---|---|---|---|---|---|---|
| no move on record names this evaluator | ||||||
From profiled 0 of 0To profiled 0 of 0Person profiled 0 of 0Dated 0 of 0