Reliably controlling AI systems much smarter than we are is an unsolved technical problem. And while it is a solvable problem, things could very easily go off the rails during a rapid intelligence explosion. Managing this will be extremely tense; failure could easily be catastrophic. The old sorcererHas finally gone away!Now the spirits he controlsShall
Study: Sycophantic AI can undermine human judgment
Subjects who interacted with AI tools were more likely to think they were right, less likely to resolve conflicts.
II. From AGI to Superintelligence: the Intelligence Explosion - SITUATIONAL AWARENESS
AI progress won’t stop at human-level. Hundreds of millions of AGIs could automate AI research, compressing a decade of algorithmic progress (5+ OOMs) into ≤1 year. We would rapidly go from human-level to vastly superhuman AI systems. The power—and the peril—of superintelligence would be dramatic. Let an ultraintelligent machine be defined as a machine that
A more interesting upside of AI
Does AI provide anything to look forward to, if “super-intelligence” sounds boring?
A more interesting upside of AI
Does AI provide anything to look forward to, if “super-intelligence” sounds boring?
An Alien Mind
Jakub Pachocki reflects on increasingly capable AI and the challenge of keeping it aligned. He calls for stronger safeguards and international coordination.
Building Political Superintelligence
Amidst fears of dystopia, a blueprint for how we use AI to reinvent the way we govern ourselves
Daron Acemoglu on Twitter / X
First question on AI.Is the problem superintelligence or distorted intelligence?This is a question I tried to address in this piece. I can add the following additional comment here.I believe the debate is being obfuscated by equating goal-driven, autonomous behavior with… https://t.co/pgoZ6tMaQ7— Daron Acemoglu (@DAcemogluMIT) September 29, 2026
We're Not Ready for Superintelligence
Could AI become conscious? Well, maybe…
A recent article in Nature laid out three arguments for why current Artificial Intelligence systems are not conscious and why future AI sys...
Michael I. Jordan on AI: “Superintelligence is science fiction”
Debates over AI consciousness are a trap
If AI systems are viewed as too advanced to control, the companies that build them can’t held liable for the harms they cause.
AI May Be Atrophying Our Brains, Professor Warns
AI may soon ruin our ability to make decisions for ourselves — an outcome that would be, one expert warns, "catastrophic."
