







Superintelligence: Paths, Dangers, Strategies is a 2014 book by the philosopher Nick Bostrom. It explores how superintelligence could be created and what its features and motivations might be. It argues that superintelligence, if created, would be difficult to control, and that it could take over the world in order to accomplish its goals. The book also presents strategies to help make superintelligences whose goals benefit humanity. It was particularly influential for raising concerns about existential risk from artificial intelligence.
Personal Superintelligence
Explore Meta's vision of personal superintelligence, where AI empowers individuals to achieve their goals, create, connect, and lead fulfilling lives. Insights from Mark Zuckerberg on the future of AI and human empowerment.
Superintelligence is a Fairy Tale. But Chasing It Can Still Cause Harm. - Cal Newport
Yesterday, multiple Anthropic employees casually announced online that they thought the types of AI they’re building could kill billions of people. Not in some distant ... Read more
Building Political Superintelligence
Amidst fears of dystopia, a blueprint for how we use AI to reinvent the way we govern ourselves

Michael I. Jordan on AI: “Superintelligence is science fiction”
Pioneering Scientific Superintelligence
Pioneering Scientific Superintelligence to solve humankind’s greatest challenges.

Superintelligence is a dragon
What Mark Zuckerberg misunderstands about powerful AI

Jacob Coxon Warns of Human Extinction and Triggers a Preference Cascade
CEOs of major AI labs, and employees of major AI labs, including OpenAI and Anthropic, often say they plan to build superintelligence soon, as in within a few years create AIs that are superior to humans at essentially all cognitive tasks.

AI 2040: Plan A
A detailed forecast and recommendation for how the US, China and the rest of the world should navigate superintelligence.

AI 2040: Plan A
A detailed forecast and recommendation for how the US, China and the rest of the world should navigate superintelligence.

We're Not Ready for Superintelligence
Mathematical methods and human thought in the age of AI
Artificial intelligence (AI) is the name popularly given to a broad spectrum of computer tools designed to perform increasingly complex cognitive tasks, including many that used to solely be the province of humans. As these tools become exponentially sophisticated and pervasive, the justifications for their rapid development and integration into society are frequently called into question, particularly as they consume finite resources and pose existential risks to the livelihoods of those skilled individuals they appear to replace. In this paper, we consider the rapidly evolving impact of AI to the traditional questions of philosophy with an emphasis on its application in mathematics and on the broader real-world outcomes of its more general use. We assert that artificial intelligence is a natural evolution of human tools developed throughout history to facilitate the creation, organization, and dissemination of ideas, and argue that it is paramount that the development and application of AI remain fundamentally human-centered. With an eye toward innovating solutions to meet human needs, enhancing the human quality of life and expanding the capacity for human thought and understanding, we propose a pathway to integrating AI into our most challenging and intellectually rigorous fields to the benefit of all humankind.

More Questions About AI Dangers, With Pointers From Gary Marcus
Following up on my previous post, I want to point your attention...

Flower: Advance Collaborative Superintelligence
Flower is a full-stack AI neolab with a mission to advance collaborative superintelligence by building open-source frontier models, agents, and infrastructure.

Import AI 447: The AGI economy; testing AIs with generated games; and agent ecologies
What might a superintelligence arcology be like?

As an AI-adjacent network neuroscience person who has also studied bits of media structure and political economy, I strongly agree with @karlbode.com: The biggest threat, by far, isn’t “superintelligence will soon kill us all!” but instead “information control by oligarchs will crush our society”
Karl Bode
one recurring theme in the coverage of this AI Anthropic doomsday newscycle is nobody actually has any REAL ideas of what to do just a lot of ambiguous hand-waving in a country that's too corrupt to have working regulators, by a press that doesn't realize that's a central pillar of the conversation