The pieces are falling into place for autonomous artificial intelligence. We must stop unregulated development
For years, they warned AI could kill all humans. Now people are listening.
A doomsaying community once on the periphery of the tech industry has gained influence, as AI “agents” perform amazing and alarming feats.
Agentic AI and the next intelligence explosion
For decades, the artificial intelligence (AI) “singularity” has been heralded as a single, titanic mind bootstrapping itself to godlike intelligence, consolidating all cognition into a cold silicon point. But this vision is almost certainly wrong in its most fundamental assumption. If AI development follows the path of previous major evolutionary transitions or “intelligence explosions,” our current step-change in computational intelligence will be plural, social, and deeply entangled with its forebears (us!).
The 2025 AI Agent Index
Agentic AI systems are increasingly capable of performing complex tasks with limited human involvement. The 2025 AI Agent Index documents the origins, design, capabilities, ecosystem, and safety features of 30 prominent AI agents based on publicly available information and correspondence with developers.
The Real Existential Risk Is AI CEOs Avoiding Oversight: “Alternative Nobel” Winner Timnit Gebru
We speak to the prominent AI researcher and leading critic of the AI industry, Timnit Gebru, who was recently awarded a 2026 Right Livelihood Award for her work investigating the harms and hype behind the global buildup of artificial intelligence. “Instead of discussing faulty, unreliable systems,” Gebru says tech leaders like SpaceXAI’s Elon Musk, OpenAI’s Sam Altman and Anthropic’s Dario Amodei are “marketing their systems as all-knowing, superpowerful, superintelligent,” and lobbying for “self-policing and self-regulation” to avoid being held “liable through existing laws.” Gebru expresses skepticism over increasingly widespread claims that AI algorithms pose an existential risk to humanity, warning that such claims are overblown and that “what is actually happening is regulatory capture.”
Misleading Metaphors, Real Risks
What To Fear from AI Agents and How to Reclaim Our Human Agency
Nathan J Robinson on Twitter / X
the correct take on the AI risks. not "godlike machine that decides to kill us all" but "machine that makes it much easier for humans to kill one another." from the very sensible @timnitGebru in Wired: https://t.co/wM0ucsN2no pic.twitter.com/vtHQ02my0G— Nathan J Robinson (@NathanJRobinson) September 13, 2026
How Shifting Responsibility for AI Harms Undermines Democratic Accountability | TechPolicy.Press
The moralization of individual AI use deflects responsibility away from powerful actors like corporations and governments, Suvradip Maitra and others write.
U.S. Must Act Quickly to Avoid Risks From AI, Report Says
The U.S. government must move “decisively” to avert an “extinction-level threat" to humanity from AI, says a government-commissioned report
AI FOR EPISTEMICS & COORDINATION
Civilization and technology have radically improved the human condition. Nonetheless, the world sometimes goes in directions which essentially nobody would prefer — e.g., nuclear arms races, unexpected financial crashes, predatory marketing, or ubiquitous political misinformation.
AI is An Ideology, Not A Technology
At its core, "artificial intelligence" is a perilous belief that fails to recognize the agency of humans.
Human scientists trounce the best AI agents on complex tasks
State-of-the-industry report finds that, despite the limitations of artificial-intelligence systems, researchers have embraced them.
Gradual disempowerment | 80,000 Hours
The proliferation of advanced AI systems may lead to the gradual disempowerment of humanity, even if efforts to prevent them from becoming power-seeking or scheming are successful. Humanity may be incentivised to hand over increasing amounts of control to AIs, giving them power over the economy, politics, culture, and more. Over time, humanity's interests may be sidelined and our control over the future undermined, potentially constituting an existential catastrophe. There's disagreement over how serious a problem this is and how it relates to [other concerns about AI alignment](https://80000hours.o
Jacob Coxon Warns of Human Extinction and Triggers a Preference Cascade
CEOs of major AI labs, and employees of major AI labs, including OpenAI and Anthropic, often say they plan to build superintelligence soon, as in within a few years create AIs that are superior to humans at essentially all cognitive tasks.
Agentic AI Governance: Securing Autonomous AI Agents in Enterprise
When AI agents start making decisions, calling tools, and coordinating with other agents without waiting for human approval, the governance playbook most...
AI, Ethics, and Society — Home
