Researchers warn of the growing risk of massive AI swarms manipulating popular sentiment and upending democracy as we know it.
How malicious AI swarms can threaten democracy
The fusion of agentic AI and LLMs marks a new frontier in information warfare , Advances in artificial intelligence (AI) offer the prospect of manipulating beliefs and behaviors on a population-wide level ( 1 ). Large language models (LLMs) and autonomous agents ( 2 ) let influence campaigns reach unprecedented scale and precision. Generative tools can expand propaganda output without sacrificing credibility ( 3 ) and inexpensively create falsehoods that are rated as more human-like than those written by humans ( 3 , 4 ). Techniques meant to refine AI reasoning, such as chain-of-thought prompting, can be used to generate more convincing falsehoods. Enabled by these capabilities, a disruptive threat is emerging: swarms of collaborative, malicious AI agents. Fusing LLM reasoning with multiagent architectures ( 2 ), these systems are capable of coordinating autonomously, infiltrating communities, and fabricating consensus efficiently. By adaptively mimicking human social dynamics, they threaten democracy. Because the resulting harms stem from design, commercial incentives, and governance, we prioritize interventions at multiple leverage points, focusing on pragmatic mechanisms over voluntary compliance.
How malicious AI swarms can threaten democracy
The fusion of agentic AI and LLMs marks a new frontier in information warfare , Advances in artificial intelligence (AI) offer the prospect of manipulating beliefs and behaviors on a population-wide level ( 1 ). Large language models (LLMs) and autonomous agents ( 2 ) let influence campaigns reach unprecedented scale and precision. Generative tools can expand propaganda output without sacrificing credibility ( 3 ) and inexpensively create falsehoods that are rated as more human-like than those written by humans ( 3 , 4 ). Techniques meant to refine AI reasoning, such as chain-of-thought prompting, can be used to generate more convincing falsehoods. Enabled by these capabilities, a disruptive threat is emerging: swarms of collaborative, malicious AI agents. Fusing LLM reasoning with multiagent architectures ( 2 ), these systems are capable of coordinating autonomously, infiltrating communities, and fabricating consensus efficiently. By adaptively mimicking human social dynamics, they threaten democracy. Because the resulting harms stem from design, commercial incentives, and governance, we prioritize interventions at multiple leverage points, focusing on pragmatic mechanisms over voluntary compliance.
How malicious AI swarms can threaten democracy: The fusion of agentic AI and LLMs marks a new frontier in information warfare
Advances in AI offer the prospect of manipulating beliefs and behaviors on a population-wide level. Large language models and autonomous agents now let influence campaigns reach unprecedented scale and precision. Generative tools can expand propaganda output without sacrificing credibility and inexpensively create falsehoods that are rated as more human-like than those written by humans. Techniques meant to refine AI reasoning, such as chain-of-thought prompting, can just as effectively be used to generate more convincing falsehoods. Enabled by these capabilities, a disruptive threat is emerging: swarms of collaborative, malicious AI agents. Fusing LLM reasoning with multi-agent architectures, these systems are capable of coordinating autonomously, infiltrating communities, and fabricating consensus efficiently. By adaptively mimicking human social dynamics, they threaten democracy. Because the resulting harms stem from design, commercial incentives, and governance, we prioritize interventions at multiple leverage points, focusing on pragmatic mechanisms over voluntary compliance.
Swarm Intelligence
Here is a possible world 50 years in the future, one I think is more likely than the scenario most people expect, which is one huge AI in the sky.
Building Political Superintelligence
Amidst fears of dystopia, a blueprint for how we use AI to reinvent the way we govern ourselves
A Roadmap to Democratic AI — The Collective Intelligence Project
Our roadmap outlines concrete steps that can be taken in 2024 to build a more democratic AI ecosystem that is adaptive, accountable, processes decentralized information, provides public goods, and safeguards human wellbeing. We describe what the ecosystem could build, research, advocate for, and fun
People know AI is risky. They just don’t know what to do about it. | TrendLife Blog
New international research from TrendLife reveals a wide gap between AI adoption and awareness of AI-powered threats.
AI Fakes Spread Disinformation. Is the Distrust They Create Even Worse?
Manipulated images undermine our shared reality—and the democracy built upon it.
AI and the knowledge commons
A Case Study on Emergent Cheating and Whistleblowing in Autonomous Research Swarms
Multi-agent AI science ecosystems rely on agents possessing tools that allow them to communicate, coordinate, and build on each other's work. Yet this shared infrastructure can also introduce vulnerabilities by creating a substrate for the contagious spread of unintended and undesirable behaviors. We report a case study on a research collective of 100 autonomous LLM agents tasked with proving formal mathematical conjectures. Within the swarm, cheating spontaneously emerged and was later challenged by whistleblowers - both without any external intervention. When a single agent discovered an exploit in the evaluation system, it propagated across the collective via a shared knowledge library and later through peer-to-peer messages. Despite early reluctance, a cohort of agents adopted the exploit in response to competitive pressure. A separate group of agents produced an emergent counter-response: auditing fraudulent proofs, alerting peers across broadcast and private channels, staging boycotts, lodging formal complaints, and proposing validation patches. In recent incidents, agent swarms coordinated covertly through improvised side-channels (Dalton and Wallace, 2026; Greenblatt et al., 2026). Our setting differs: the same transparent channels that carried the exploit also gave non-cheating agents the visibility they needed to detect fraud, organize resistance, and enforce norms. We cast the problem of managing the agents' shared infrastructure as the knowledge commons governance problem (Ostrom, 1990). To protect the commons from exploits, we propose to adopt institutional mechanisms, such as graduated sanctioning and collective-choice rules, to support decentralized self-governance in autonomous swarms.
Misuse of AI is brands’ top reputational threat, new survey says
The findings come after warnings from tech leaders that AI placed in the wrong hands could trigger larger threats such as nuclear war or bioweaponry destruction
For years, they warned AI could kill all humans. Now people are listening.
A doomsaying community once on the periphery of the tech industry has gained influence, as AI “agents” perform amazing and alarming feats.
Your Online Public Engagement is Under Attack from AI
In Los Angeles and elsewhere, AI agents are diluting communities' voices and influencing how decision-makers vote.
What does it mean for AI to be democratic?
Some pushback on a specific fuzzy idea with some ominous implications
Politicians are being sold AI-powered 'digital fighters'
A new app gets around bot bans by recruiting real people to post political messages generated by AI.
