Research: The Trust & Safety Pipelines — Who Runs Platform Moderation, and Where They Came From
The four routes into platform trust-and-safety leadership, measured against the record: prosecutors and federal lawyers first, the volunteer moderator last. Plus the democracy-promotion money that fed the disinformation labs, what Reddit and Discord did to their own moderators, and which of the popular links are documented and which are not. Current to October 2026.
Contents
Companion pages: Watching the Watchers (the same question asked of the AI labs), The Twitter Files, AI Moderation, Deplatforming and the Revolving Door.
The question. Who runs platform moderation, and how did they get the job? The popular answer is a pipeline from volunteer “power moderators” on Reddit and Discord up into platform staff. This page tests that answer, and three related claims, against the record, and keeps a strict line between what is documented and what is only observed or asserted. Moving between government, law firms, academia and platforms is lawful and common; the finding is the pattern.
1. Four routes into trust-and-safety leadership
The record shows four routes, and the volunteer-moderator route is the smallest.
| Route | Documented examples | What it means |
|---|---|---|
| Federal prosecutors and law enforcement | Monika Bickert: an Assistant US Attorney “for 11 years in Washington, DC, and Chicago,” then Facebook’s lead security counsel (2012) and Meta’s Vice President for Content Policy (Harvard Law School). James Baker: FBI general counsel, then Twitter’s deputy general counsel until Elon Musk fired him in December 2022 (Fox News, Dec 7 2022). Del Harvey: by her own account an anti-child-exploitation law-enforcement liaison before leading Twitter’s trust and safety; now TSPA board chair (TSPA). | The largest source. Policy teams are built by people who know DOJ, FBI and CISA practice from the inside. |
| Government counsel and corporate law | Joel Kaplan (Bush White House deputy chief of staff, then Meta’s policy chief) and Kent Walker (former DOJ, then Google) (Watching the Watchers). | Platforms staff policy with legal-shaped teams, not moderator-shaped ones. |
| Academic research and NGOs | Renée DiResta: “an undergraduate internship with the CIA,” seven years as a derivatives trader at Jane Street, then the Stanford Internet Observatory and Georgetown (DiResta, About). Yoel Roth: a PhD from Penn’s Annenberg School, more than seven years at Twitter ending as Head of Trust & Safety, now Senior Vice President of Trust & Safety at Match Group and a Carnegie scholar (Berkman Klein Center; TechCrunch, Mar 11 2024). Savannah Badalich: Twitter trust and safety, before that “human rights advocacy, anti-violence organizing, and civic tech development,” now Discord’s Senior Director, Policy (FOSI). | Supplies the frameworks and the research. |
| Volunteer moderators | No leadership-level case is documented. Roth, often given as the textbook example, does not fit his own bios: his route was a doctorate, then the company. The clearest volunteer-to-paid cases are at the Wikimedia Foundation, where editors Maggie Dennis and Jan Eissfeldt rose to run trust and safety (Watching the Watchers). Discord advertises for “community moderators,” but those transitions land at staff level. | The smallest route. “Powermod to C-suite” is overstated. |
The implication runs against the popular story. The flagging machine is not run by culture-war moderators who climbed into staff jobs. It is run mostly by a prosecutor-and-counsel class that understands federal legal frameworks, with academics supplying the research. Volunteer moderators matter for execution at the bottom of the stack, not for executive decisions.
2. The democracy-promotion money
The ecosystem was built long before “disinformation.” Through the 1990s and 2000s the United States funded a mature democracy-and-media apparatus: the CEPPS consortium (IFES, IRI and NDI, 1995), NED’s Center for International Media Assistance (2006), Freedom House, IREX, Internews (founded 1982) and others (GAO-18-136; CRS R44858).
It was shrinking before it pivoted. State and USAID spending on “media freedom and freedom of information” programs “dropped 43.5 percent in the past five years–from $135 million in Fiscal Year 2008 to approximately $76.3 million in FY 2012,” mostly because of the Iraq and Afghanistan drawdowns (CIMA, U.S. Government Funding for Media, Jan 2015).
The vocabulary changed after 2014. The Ukraine crisis moved the same organizations from “independent media” and “civil society capacity” toward “media literacy” and “counter-disinformation.” By February 2021 USAID had its own Disinformation Primer (InterAction). The pipes were not built for counter-disinformation work; an existing apparatus re-labelled and re-prioritized what it did.
Internews’ federal money. USAspending records federal awards to Internews Network of $396.3 million from USAID and $57.9 million from State across fiscal 2008-2025 (USAspending, recipient “Internews Network”). The widely repeated $472.6 million is a WikiLeaks all-agency total published in February 2025, not a USAID-only figure.
2025: the orbit was shut off.
- Secretary Rubio announced on July 1, 2025 that “as of July 1st, USAID will officially cease to implement foreign assistance”; the Congressional Research Service: “The Trump Administration has ended USAID’s role in administering foreign assistance and has transferred some of USAID’s former functions to the Department of State” (CRS IF10261).
- NED said on February 25, 2025 that it was “unable to access its Congressionally appropriated funds” and had been “forced to suspend support for nearly 2,000 partners worldwide,” adding that “Ninety-five percent of NED’s funding is directly appropriated by Congress and is not considered foreign assistance” (NED).
- The State Department’s Global Engagement Center lost its statutory authority on December 23, 2024; CISA suspended election-security support to states in March 2025; the Stanford Internet Observatory wound down in 2024 (all sourced on Watching the Watchers).
3. The grant-to-takedown chain: what is documented and what is not
The popular claim is a single chain: USAID funds Internews, Internews funds the academic disinformation labs, the labs publish flagging frameworks, platforms act on them. Taken link by link:
| Link | Status |
|---|---|
| USAID funds Internews | Documented: USAspending, above. |
| Internews funds the Stanford Internet Observatory or other academic labs for disinformation research | Not documented. No award record or tax-filing entry found; on X the claim circulates only as assertion. |
| The labs publish flagging frameworks | Documented: the Election Integrity Partnership’s The Long Fuse (March 2021) (EIP). |
| The labs routed flagged posts to platforms | Documented: EIP’s ticket system; the House Judiciary Committee majority’s staff report calls it censorship, the researchers say platforms “made their own determinations,” and Murthy v. Missouri decided standing, not the merits (House Judiciary staff report, Nov 2023; full treatment on Watching the Watchers). |
So the chain is real at both ends and unproven in the middle. The money reached Internews; the labs did route posts to platforms. The specific grant that would connect the two has not turned up.
4. What the platforms did to their own moderators
Reddit. In 2023 its API pricing (about $0.24 per 1,000 calls) killed third-party moderation tools; thousands of subreddits went dark on June 12 in protest (Irish News, Jun 13 2023), and Reddit warned moderators who kept communities closed that they could lose their positions. On September 30, 2024, after its IPO, Reddit began requiring admin approval before a subreddit switches between public and private or between safe-for-work and NSFW, with requests reviewed within 24 hours and small or new communities approved automatically; Reddit said the aim was preventing disruption, “not to stop users from protesting” (TechCrunch, Sep 30 2024). The effect is to remove the moderators’ main collective lever, the blackout, while keeping their unpaid labor. Exactly two years later, on September 30, 2026, Reddit said it will end RSS feeds on November 13, 2026 and close its remaining public API by March 2027, blaming scraping bots, though it licenses its own content to AI companies (Decrypt). Discord. Before 2017 moderation was the server owner’s job. After the Charlottesville rally, organized partly on Discord, it took down the altright.com server on August 14, 2017. Its own figures to the Senate Judiciary Committee: 22 full-time trust-and-safety employees in 2019, 90 by 2023, cut to 74 in 2024 after layoffs, with a growing contract workforce (NBC News, 2024). It acquired the anti-harassment AI company Sentropy in July 2021.
5. Open questions
These circulate widely and may be true. None is documented yet, so none is asserted here.
- Coordinated takedowns by “power moderators.” A small number of accounts moderate many of Reddit’s largest communities, and removals around flashpoint events can be fast. Whether specific removals were coordinated, and by whom, is not on the record: the accounts are pseudonymous, and no study ties them to legal names or to outside direction.
- Gamergate as the template. The claim that the Stanford Internet Observatory’s early disinformation work, and later domestic-extremism doctrine, was modeled on the 2014-15 Gamergate harassment campaign. No SIO publication or official document saying so has been found.
- The Internews-to-labs grant, above.
- Journalist coverage driving subreddit moderation after Gamergate. Plausible, unmeasured.
Verdict
The pipeline exists, but not where the popular story puts it. The people who run platform moderation came mostly from federal prosecution, government counsel and academic research, not from volunteer moderation. The money that built the counter-disinformation field came through a democracy-promotion apparatus that predated “disinformation” by decades and was largely dismantled in 2025. Two links people treat as settled, the Internews-to-SIO grant and the Gamergate template, are not documented. The platforms, meanwhile, moved to take collective power away from their volunteer moderators while keeping their work.
Related
- The Censorship-Industrial Complex — the organizations, the money, the court record and the defense
- Watching the Watchers · The Twitter Files · AI Moderation · Deplatforming
- The Funding Ratchet · Nation-State Ratchets
- Revolving Door