One of the most prominent intellectual attempts to grapple with human extinction in recent decades is existential risk studies.
Humanity’s Endgame
A new history of societal collapse by an expert in existential risk argues that our globalized society is edging toward the precipice.
From risk to flourishing: Seeds for responding to a complex world
Flourishing is the actualization of all beings toward their good -- not only individually but collectively, answering the question of `how do we live well with and for each other?'. In science as in society, the tendency to reduce, segregate, specialize, and settle has precluded embracing the concept of flourishing as a guiding principle. We aim to identify an approach to risk science research that promotes the flourishing of socio-ecological-technological systems (SETS). We discuss the normative role of an orientation toward flourishing for the field of risk science. We explore the possibility that (risk) science could be done in a way that is capable of pointing society toward a different future, one more resilient and more capable of flourishing. Our exploration mirrors the conversational nature of flourishing itself: examine ideologies traditionally believed to be rigidly in opposition and consider what emerges in the space(s) and conversation between them. We call this a dialectical approach. Within this paradigm grounded in conversation, pluralism, and pragmatism, we revisit three longstanding tensions in risk science: physical$|$social, determinism$|$uncertainty, contextuality$|$generality. Although these tensions are not new, revisiting them together through the lens of complexity science, and with explicit attention to the normative commitments that shape risk research, reveals underexplored possibilities for the field. Examining them in conversation with the other allows us to explore the provisional seeds for what might be termed complex risk science: interdependence, responsivity, participation, pluralism, openness, and ongoingness. Enacting the dialectical paradigm towards a risk science for a flourishing world will depend on creating collectives toward complex risk science, supporting them with skillfully governed commons, and centering care in our research.
Calamity Theory
What are the implications of how we talk about apocalypse? A new philosophical field has emerged. “Existential risk” studies any real or hypothetical hum...
The Extinction Risk Preference Cascade: Quotes
These are quotes from OpenAI, Anthropic and Google employees, in the wake of Jacob Coxon’s warnings, in which the employees confirm that they think AI might soon kill everyone.
A world in turmoil: governing risk, establishing order in humanitarian crises
This special issue of Disasters on humanitarian governance focuses on risk and order. Its contributions show the tensions between humanitarian normative ideals and practical consequences, as many of ...
Effective Altruism Funded the “AI Existential Risk” Ecosystem with Half a Billion Dollars
The “AI Existential Safety” field did not arise organically. Effective Altruism invested $500 million in its growth and expansion.
Effective Altruism: doing transhumanism better
Effective Altruism (EA) is a Trojan horse for transhumanism, through which EA movement leaders and funders aim to naturalize transhumanism as the logical extension of the existing global aid and development sector. This paper traces transhumanism's mainstreaming, first via its rebranding as a humanitarian effort to save lives, protect vulnerable populations, and ensure global flourishing (what I term transhumanitarianism), and later by embedding transhumanitarianism in EA (now under the rubric of longtermism). A key component of this strategy was inverting transhumanism's techno-optimism to instead focus on safety and preventing existential risks ( x-risk ) from emerging technologies like AI and biotechnology, while simultaneously advocating for the creation of these same technologies. The paper focuses on some components of this strategy: the use of inoculation, speculative ethics, anticipatory governance, and the mobilization of apocalyptic discourse as means for producing material outcomes in the form of policy and research agendas.
The shock of the anthropocene: the earth, history and us
Dissecting the new theoretical buzzword of the "Anthrop…
Leave Tyrants in the Ground
By unhooking ourselves from fossil fuels, we release ourselves from a world of harm.
Haitian Immigrant’s Tragic Death Shines a Light on the Human Cost of Ending Temporary Protected Status – The Root
The AI safety vibe shift
Once a fringe obsession of Bay Area rationalists, existential risk is suddenly all anyone is talking about
How May the ‘Anthropocene’ Enable and Constrain Cybersystemic Governance? The ‘Anthropocene Problematique’
A growing awareness of the need for cybernetics and systems thinking (cybersystemic) in praxes of governance to improve human-biosphere relationships in the Anthropocene has become apparent. Nonetheless, mainstream governance informed by linear-causality seems to perpetuate an increasingly inadequate paradigm of dominant first-order/systematic thinking in governing complex interactions between humans and their natural environments. This conundrum is explored through the second-order lens of a systemic inquiry, using an integrative literature review. We discuss limitations of the Anthropocene metaphor and make the case for a reframing of our situation (humans’ co-evolutionary dynamic with the biosphere) as the ‘Anthropocene problematique’. This reframing as a systemic-duality offers more conducive affordances for trajectory-shifting cybersystemic governance to emerge. Aligning with a body of literature evidencing the influence of language on human cognition, we argue that by joining up the strengths of both ideas, ‘Anthropocene problematique’ may form a conceptual device amenable to changing worldviews and guiding practical action in governing human-biosphere relationships. We suggest a conceptual framework for practitioners to design and enact purposeful systems of cybersystemic governance with potential to improve situated Anthropocene problematiques. This framing and theoretical proposal are motivated by a need for shifts towards a social purpose of healing human-biosphere relationships in current governance systems in the Anthropocene-world.
Behind the AI ‘Extinction’ Power Bid: Soaring Costs Could Hit 10% of World GDP
AI firms are invoking unproven extinction warnings to justify restrictions on developments by their smaller rivals whilst seeking greater influence over regulation
A.I., Mars and Immortality: Are We Dreaming Big Enough? | Interesting Times with Ross Douthat
AI existential risk probabilities are too unreliable to inform policy
How speculation gets laundered through pseudo-quantification
