Case file 04

The crowd you're arguing with
isn't real.

In 2024, automated traffic passed human traffic on the web for the first time. Facebook removes billions of fake accounts a year and billions more take their place. And research keeps landing on the same uncomfortable number: it takes only a few fake voices to convince everyone else that the room has made up its mind. This page is about the manufactured crowd — and why "open discussion" was never going to survive on a platform that sells outrage by the minute.

51%
Share of all web traffic that was automated in 2024 — the first time in a decade of measurement that bots passed humans.
Imperva Bad Bot Report, 2025 [1]
3.5B
Fake accounts Facebook removed in 2025 alone — equal to roughly 43% of the population of Earth.
Meta transparency data, VAB analysis [2]
2–4%
Share of a discussion that needs to be bots to flip the perceived majority opinion — in two out of three simulations.
Ross et al., 2019 [3]
18M
Of the 22 million public comments the FCC received on net neutrality, the number that turned out to be fake.
NY Attorney General, 2021 [4]

The census

Nobody knows how many bots there are. The counts we have are staggering.

Start with the web itself. In 2024, automated traffic reached 51 percent of everything moving online — bots overtook people for the first time since measurement began. "Bad bots" — scrapers, fraud tools, fake-account software — alone made up 37 percent of all traffic, a share that has risen six years straight. The report's explanation for the surge: AI has made bots cheap to build and hard to spot.[1]

On Facebook, the removal numbers tell their own story. The platform took down about 3.5 billion fake accounts in 2025 — and that is a routine year, not a purge. In several years Facebook has banned more fake accounts than it had monthly active users; the ratio peaked at 2.7 to 1 in 2019.[2] Meta's last public estimate put fake accounts at roughly 5 percent of monthly active users — and it has since stopped disclosing Facebook's monthly active users at all, which makes the comparison impossible to update.[2][5]

And removals only count the bots that got caught. On Twitter — now X — the company's filings long insisted fewer than 5 percent of accounts were fake, while independent researchers estimated 9 to 15 percent.[6] Detection is an arms race, and the referee works for one of the teams.

Honest caveat: every bot count on this page is an estimate. Detection tools disagree with each other, platforms guard the data needed to check them, and Meta shut down CrowdTangle — the main tool researchers and journalists used to watch viral manipulation on Facebook — in August 2024, over the public objections of researchers and US senators.[7] The uncertainty cuts both ways. It is not a reason for comfort.

The mechanism

How a few fake voices move real opinion

You don't learn what other people think from surveys. You learn it from the room — and for most of us, the room is now a feed. That is the vulnerability bots exploit. They don't need to persuade you of anything. They only need to change your sense of what everyone else believes, and normal human social instincts do the rest.

2018 — Nature Communications

Six percent of the accounts, a third of the junk

Researchers analyzed 14 million Twitter messages spreading 400,000 articles. Accounts likely to be bots were just 6% of the sample — but they spread 31% of all tweets linking to low-credibility content, and a third of the most prolific "super-spreader" accounts were bots. The bots' strategy was surgical: amplify an article in the first seconds of its life to seed virality, and tag influential humans with big followings to get it carried further.[8]

The study's bleakest finding was about us, not them: humans retweeted bots posting junk almost exactly as often as they retweeted other humans. We can't tell the difference.[8]

2019 — European Journal of Information Systems

The 2–4% tipping point

A team modeling opinion dynamics under spiral-of-silence theory — people who think they hold a minority view go quiet — found that bots making up just 2 to 4 percent of a network's participants were enough to tip the perceived opinion climate in two out of three runs. The arithmetic of silence does the work: a small fake chorus speaks loudly, real dissenters conclude they're outnumbered and say nothing, and their silence reads as agreement. The manufactured majority becomes a real one.[3]

Put those two findings together and the threat comes into focus. It has never been necessary to fake half a platform. A few percent, placed early and aimed at the right people, is enough to bend what an entire network believes the consensus is.

Manufactured grassroots

Fake crowds, real consequences

This isn't theoretical. Manufactured consensus has been deployed — against elections, against regulators, against you — and documented each time only after the damage was done.

2015–2017 — Facebook

470 accounts reach 126 million Americans

Russia's Internet Research Agency ran roughly 470 fake accounts and pages that reached an estimated 126 million Americans on Facebook — even organizing dueling real-world protests in Houston, both sides summoned by Russian fronts. The full record is in the Facebook case file.[9]

2017 — the FCC docket

18 million fake comments, bought by the industry

When the FCC opened public comment on repealing net neutrality, it received more than 22 million submissions. The New York Attorney General later found nearly 18 million were fake — 8.5 million filed under real people's stolen identities — and that the nation's largest broadband companies had funded the campaign through commercial lead-generation firms. The same investigation surfaced half a million fake letters to Congress and 3.5 million fake digital signatures sent to legislators in other campaigns. The public record of "what Americans think" was, in the great majority, manufactured.[4]

2023 — Meta's own takedown

Spamouflage: 7,704 accounts, 50+ platforms

In August 2023, Meta removed 7,704 Facebook accounts and 954 pages belonging to "Spamouflage," an operation it linked to individuals associated with Chinese law enforcement and active on more than fifty platforms.[10]

"The largest known cross-platform covert influence operation in the world."
Meta's own description of the Spamouflage network it removed, August 2023[10]

None of this is a rogue-actor story anymore. It's an industry. Oxford's Internet Institute found organized social-media manipulation campaigns in all 81 countries it surveyed in 2020 — up from 70 the year before — with bot accounts deployed in 57 of them, and governments in 48 countries hiring private "strategic communications" firms that have collected some $60 million for the work. The report's lead author put it flatly: misinformation "is now produced on an industrial scale."[11] Meta itself reports removing more than 200 covert influence networks, originating in 68 countries, between 2017 and 2022.[12] Two hundred that were caught.

2024–2026

The bots got a brain

Everything above describes the cheap, dumb generation of bots — copy-paste accounts that a careful reader could spot. Large language models removed that ceiling. A bot can now hold a conversation, argue in your dialect, and joke its way out of being accused of botting. And the price of a thousand convincing voices has collapsed.

Facebook's algorithm does the distribution. Stanford and Georgetown researchers tracking AI-generated spam pages on Facebook — the "Shrimp Jesus" wave — found hundreds of pages whose synthetic images racked up hundreds of millions of interactions, pushed by Facebook's own recommendation engine into the feeds of people who never followed them. Many users showed no sign of knowing the content was fake. The pages then funneled their audiences to ad farms and scams.[13]

Influence is now a subscription service. In 2025, Anthropic disclosed a commercial "influence-as-a-service" operation that used its AI model, Claude, to run more than one hundred fake political personas on Facebook and X. The model itself decided when each persona should comment, like, or share, and wrote the replies in the target audience's language. The operation served multiple clients across four campaigns and engaged tens of thousands of real accounts. When users accused the personas of being bots, they answered with sarcasm — and kept going.[14]

Whole conversations can be synthetic. OpenAI reported disrupting ten covert operations in a single three-month stretch of 2025. One China-linked network, "Sneer Review," generated comments across TikTok, X, Reddit, and Facebook — and then generated the replies to its own posts, staging entire threads of fake people agreeing with each other for a human audience of onlookers.[15]

Honest caveat: the AI operations caught so far often earned little authentic engagement. OpenAI's lead investigator noted that "better tools don't necessarily mean better outcomes" — being caught is, after all, how these ended up in a report.[15] What no one can tell you is how many weren't caught, on platforms that have been shutting down the tools used to look.[7]

The real problem

Why "open discussion" can't happen on an outrage engine

The bots are only the third act of the problem. Walk through what a Facebook conversation actually is, and the idea of the feed as a "public square" comes apart piece by piece.

First, the referee is biased toward anger. The feed is not ordered by merit or by time; it is ordered by predicted engagement, and moral outrage is the most engaging thing humans produce. Across 27 studies and 4.8 million posts, each added moral-emotional word in a post increased its spread by about 13 percent — the original study measured 20.[16] Facebook didn't just observe this; it weighted the angry reaction five times a like. The mechanics are on The Machine.

Second, the "public" was never the public. The most active quarter of American adults on Twitter produced 97 percent of the tweets.[17] During the 2020 election, 2,107 people — a third of one percent of a 660,000-voter panel — spread 80 percent of the fake news, by hand, no automation required.[18] What reads as "everyone is saying" is a tiny, unrepresentative, self-selected sliver — pre-sorted by an algorithm that favors its angriest members.

Third, the crowd is spiked. Onto that distorted sample, add everything documented above: bots that amplify junk in its first seconds, personas that argue back in fluent idiom, fake threads agreeing with themselves, and an influence industry operating in 81 countries. Every signal you might use to gauge what people actually think — likes, shares, comment sections, trending topics — is for sale.

And the house takes a cut either way. Engagement is revenue no matter who generates it. Internal documents reported by Reuters in late 2025 showed Meta projecting that scam ads, schemes, and banned goods would account for roughly 10 percent of its 2024 revenue — about $16 billion — while its platforms showed users some 15 million high-risk scam ads a day. Meta's internal policy: ban an advertiser only when its systems are at least 95 percent certain of fraud. Below that threshold, the penalty for probably being a scammer was a higher ad rate.[19] A company that charges fraud a premium instead of showing it the door is not going to wage genuine war on fake engagement — fake engagement inflates the very numbers it sells.

The conclusion is uncomfortable but simple. A feed ranked by outrage, filled by its loudest 3 percent, seeded by purchasable crowds, and owned by a company paid per minute of attention is not a place where open discussion happens. It is a place where the appearance of public opinion is manufactured, at scale, for money. You cannot win an argument against a crowd that isn't there. But you can stop mistaking the feed for the public — and stop letting it tell you what everyone else thinks.

Sources

  1. Imperva (a Thales company), "2025 Bad Bot Report" (April 2025) — 51% of web traffic automated in 2024; bad bots 37%, up from 32% — https://www.imperva.com/resources/resource-library/reports/2025-bad-bot-report/
  2. Video Advertising Bureau, "Friend or Frenemy?" analysis of Meta Transparency Center data (July 2026) — 3.5 billion fake accounts removed in 2025; 2.7:1 fake-to-MAU ratio in 2019; Meta's discontinued MAU reporting — via PPC Land, https://ppc.land/facebook-banned-3-5-billion-fake-accounts-in-2025-vab-analysis-finds/
  3. Ross, B., Pilz, L., Cabrera, B., Brachten, F., Neubaum, G. & Stieglitz, S., "Are social bots a real threat? An agent-based model of the spiral of silence to analyse the impact of manipulative actors in social networks," European Journal of Information Systems 28(4), 394–412 (2019) — https://www.tandfonline.com/doi/full/10.1080/0960085X.2018.1560920
  4. New York Attorney General, "Fake Comments: How U.S. Companies & Partisans Hack Democracy" (May 6, 2021) — https://ag.ny.gov/sites/default/files/reports/oag-fakecommentsreport.pdf
  5. Facebook transparency disclosures (May 2019): ~5% of monthly active accounts estimated fake; 3 billion accounts removed Oct 2018–Mar 2019 — reported by Fortune, https://fortune.com/2019/05/23/facebook-fake-accounts-transparency-report
  6. Varol, O., Ferrara, E., Davis, C., Menczer, F. & Flammini, A., "Online Human-Bot Interactions: Detection, Estimation, and Characterization," ICWSM (2017) — 9–15% of active Twitter accounts estimated automated — https://arxiv.org/abs/1703.03107 ; on detection-method disagreement: Martini et al., Big Data & Society (2021).
  7. Columbia Journalism Review, "Meta Is Getting Rid of CrowdTangle" (2024); Sens. Coons & Cassidy statement on the August 14, 2024 shutdown — https://www.cjr.org/tow_center/meta-is-getting-rid-of-crowdtangle.php
  8. Shao, C., Ciampaglia, G.L., Varol, O., Yang, K., Flammini, A. & Menczer, F., "The spread of low-credibility content by social bots," Nature Communications 9, 4787 (2018) — https://www.nature.com/articles/s41467-018-06930-7
  9. U.S. Senate Intelligence Committee reports on Russian interference (2019); see also the Facebook case file sources on this site.
  10. Meta, Adversarial Threat Report, Q2 2023 (August 2023) — Spamouflage takedown: 7,704 accounts, 954 pages, 50+ platforms, links to Chinese law enforcement — coverage: https://time.com/6310040/chinese-influence-operation-meta/
  11. Oxford Internet Institute, "Industrialized Disinformation: 2020 Global Inventory of Organized Social Media Manipulation" (January 2021) — 81 countries; bots in 57; private firms in 48, ~$60M — https://demtech.oii.ox.ac.uk/research/posts/industrialized-disinformation/
  12. Meta, "Recapping Our 2022 Coordinated Inauthentic Behavior Enforcements" (December 2022) — 200+ covert influence networks from 68 countries removed since 2017 — https://about.fb.com/news/2022/12/metas-2022-coordinated-inauthentic-behavior-enforcements/
  13. DiResta, R. & Goldstein, J.A. (Stanford Internet Observatory / Georgetown CSET), research on AI-generated image spam on Facebook (March 2024); reporting: 404 Media, "Facebook's Algorithm Is Boosting AI Spam" — https://www.404media.co/facebooks-algorithm-is-boosting-ai-spam-that-links-to-ai-generated-ad-laden-click-farms/
  14. Anthropic, "Detecting and Countering Malicious Uses of Claude" (April 2025) — influence-as-a-service operation orchestrating 100+ personas on Facebook and X — https://www.anthropic.com/news/detecting-and-countering-malicious-uses-of-claude-march-2025
  15. OpenAI, "Disrupting Malicious Uses of AI" threat report (June 2025) — 10 operations in three months; "Sneer Review" self-replying network; Ben Nimmo quotes — coverage: NPR, https://www.npr.org/2025/06/05/nx-s1-5423607/openai-china-influence-operations
  16. Brady, W.J., Wills, J.A., Jost, J.T., Tucker, J.A. & Van Bavel, J.J., "Emotion shapes the diffusion of moralized content in social networks," PNAS 114(28) (2017) — ~20% per moral-emotional word; replication and meta-analysis (27 studies, N=4,821,006, pooled 13%): PNAS Nexus 4(11) (2025) — https://academic.oup.com/pnasnexus/article/4/11/pgaf327/8285703
  17. Pew Research Center, "The Behaviors and Attitudes of U.S. Adults on Twitter" (November 15, 2021) — the most active 25% of U.S. adult users produced 97% of tweets — https://www.pewresearch.org/internet/2021/11/15/the-behaviors-and-attitudes-of-u-s-adults-on-twitter/
  18. Baribi-Bartov, S., Swire-Thompson, B. & Grinberg, N., "Supersharers of fake news on Twitter," Science 384, 979–982 (2024) — 2,107 supersharers (0.32% of a 664,391-voter panel) spread 80% of fake news — https://www.science.org/doi/10.1126/science.adl4435
  19. Reuters investigation of internal Meta documents (November 2025) — ~10% of 2024 revenue (~$16B) projected from scam/fraud/banned-goods ads; ~15M high-risk scam ads daily; 95%-certainty ban threshold — coverage: CNBC, https://www.cnbc.com/2025/11/06/meta-reportedly-projected-10percent-of-2024-sales-came-from-scam-fraud-ads.html

Stop arguing with the machine

You can't out-shout a crowd that isn't there — but you can walk out of the theater. Starve the algorithm in five minutes, or leave for places where nobody profits from the shouting.