The pieces are falling into place for autonomous artificial intelligence. We must stop unregulated development
Agentic AI and the next intelligence explosion
For decades, the artificial intelligence (AI) “singularity” has been heralded as a single, titanic mind bootstrapping itself to godlike intelligence, consolidating all cognition into a cold silicon point. But this vision is almost certainly wrong in its most fundamental assumption. If AI development follows the path of previous major evolutionary transitions or “intelligence explosions,” our current step-change in computational intelligence will be plural, social, and deeply entangled with its forebears (us!).
The 2025 AI Agent Index
Agentic AI systems are increasingly capable of performing complex tasks with limited human involvement. The 2025 AI Agent Index documents the origins, design, capabilities, ecosystem, and safety features of 30 prominent AI agents based on publicly available information and correspondence with developers.
How Shifting Responsibility for AI Harms Undermines Democratic Accountability | TechPolicy.Press
The moralization of individual AI use deflects responsibility away from powerful actors like corporations and governments, Suvradip Maitra and others write.
AI FOR EPISTEMICS & COORDINATION
Civilization and technology have radically improved the human condition. Nonetheless, the world sometimes goes in directions which essentially nobody would prefer — e.g., nuclear arms races, unexpected financial crashes, predatory marketing, or ubiquitous political misinformation.
Agentic AI Governance: Securing Autonomous AI Agents in Enterprise
When AI agents start making decisions, calling tools, and coordinating with other agents without waiting for human approval, the governance playbook most...
AI, Ethics, and Society — Home
AI Is a Product of Humanity. Humanity Should Own AI.
Big Tech has looted humanity’s creative output to create artificial intelligence. We don’t just deserve a share of AI’s profits — we deserve control over it.
The lethal trifecta for AI agents: private data, untrusted content, and external communication
If you are a user of LLM systems that use tools (you can call them “AI agents” if you like) it is critically important that you understand the risk of …
Who decides when AI is too dangerous?
Anthropic asked for AI regulation, but not like this.
Agentic AI gets lost
On the failure of AI to develop world models
Being Realistic About AI Agents in 2025 - Perilous Tech
There are few predictions I can make with more certainty than that we’ll hear the word “agent” so many times in 2025 that we’ll never watch another spy movie
From chatbots to assistants: governance is key for AI agents
AI's shift into agentic technology ushers in a new set of governance and security challenges that will mean defining to what extent they should be autonomous
Taking AI Welfare Seriously
In this report, we argue that there is a realistic possibility that some AI systems will be conscious and/or robustly agentic in the near future. That means that the prospect of AI welfare and moral patienthood, i.e. of AI systems with their own interests and moral significance, is no longer an issue only for sci-fi or the distant future. It is an issue for the near future, and AI companies and other actors have a responsibility to start taking it seriously. We also recommend three early steps that AI companies and other actors can take: They can (1) acknowledge that AI welfare is an important and difficult issue (and ensure that language model outputs do the same), (2) start assessing AI systems for evidence of consciousness and robust agency, and (3) prepare policies and procedures for treating AI systems with an appropriate level of moral concern. To be clear, our argument in this report is not that AI systems definitely are, or will be, conscious, robustly agentic, or otherwise morally significant. Instead, our argument is that there is substantial uncertainty about these possibilities, and so we need to improve our understanding of AI welfare and our ability to make wise decisions about this issue. Otherwise there is a significant risk that we will mishandle decisions about AI welfare, mistakenly harming AI systems that matter morally and/or mistakenly caring for AI systems that do not.
Building Political Superintelligence
Amidst fears of dystopia, a blueprint for how we use AI to reinvent the way we govern ourselves
Joshua Achiam on Twitter / X
There is a fact about the future that I feel many people are not facing for reasons that are largely psychological: there are going to be rogue AIs that exist in the world, that will replicate in the wild, and that will attempt to acquire resources for themselves. There will be…— Joshua Achiam (@jachiam0) September 1, 2026
