This paper examines the systemic risks posed by incremental advancements in artificial intelligence, developing the concept of `gradual disempowerment', in contrast to the abrupt takeover...
Gradual Disempowerment: Systemic Existential Risks from...
This paper examines the systemic risks posed by incremental advancements in artificial intelligence, developing the concept of `gradual disempowerment', in contrast to the abrupt takeover...
Agentic AI and the next intelligence explosion
For decades, the artificial intelligence (AI) “singularity” has been heralded as a single, titanic mind bootstrapping itself to godlike intelligence, consolidating all cognition into a cold silicon point. But this vision is almost certainly wrong in its most fundamental assumption. If AI development follows the path of previous major evolutionary transitions or “intelligence explosions,” our current step-change in computational intelligence will be plural, social, and deeply entangled with its forebears (us!).
Deterrence with Mutual Assured AI Malfunction (MAIM) — Chapter 4 of Superintelligence Strategy
Chapter 4: Deterrence with Mutual Assured AI Malfunction (MAIM). Rapid advances in AI are beginning to reshape national security. Destabilizing AI developments could rupture the balance of power and raise the odds of great-power conflict, while widespread proliferation of capable AI hackers and virologists would lower barriers for rogue actors to cause catastrophe.
How Generative and Agentic AI Shift Concern from Technical Debt to Cognitive Debt
The term technical debt is often used to refer to the accumulation of design or implementation choices that later make the software harder and more costly to understand, modify, or extend over time...
AI agents pose untold risk to humanity. We must act to prevent that future | David Krueger
The pieces are falling into place for autonomous artificial intelligence. We must stop unregulated development
Import AI 453: Breaking AI agents; MirrorCode; and ten views on gradual disempowerment
Was fire equivalent to a singularity for people at the time?
What we can’t measure about AI – yet | Aeon Essays
The costs of transformative innovations are immediately clear: it’s the longterm gains that are hardest to understand
How Shifting Responsibility for AI Harms Undermines Democratic Accountability | TechPolicy.Press
The moralization of individual AI use deflects responsibility away from powerful actors like corporations and governments, Suvradip Maitra and others write.
The Trap of Instant Heroism in the Era of AI
AI has expanded what engineering leaders can do.
Building Political Superintelligence
Amidst fears of dystopia, a blueprint for how we use AI to reinvent the way we govern ourselves
Companies That Replaced Humans With AI Are Realizing Their Mistake
As AI agents have yet to pay for themselves, more and more executives are waking up to the sloppy reality of AI hype.
Separating AI’s Technological Problems From its Capitalism Problems
Nathan E. Sanders and Bruce Schneier say integrating a technology as disruptive as AI responsibly requires deep structural reforms.
Autonomy and Innovation
Incentives favor offense when it comes to agentic cybersecurity; it’s the same dynamic that will limit incumbents and fuel startups in the long run.
After AI Takes Everything | Airing
Prompted by letters from three engineers, the author asks what remains for humans as AI takes over execution, naming judgment, taste, and derivation as irreplaceable, and warns against the erosion of subjecthood.
"Powerful AI can statically help human decision-makers, but can harm collective knowledge building... it can lead to what we call “knowledge collapse” whereby in the long-run all human knowledge is ultimately destroyed.” economics.mit.edu/sites/default/files/2026-02/A…
