Gradual disempowerment | 80,000 Hours

Gradual Disempowerment: Systemic Existential Risks from...

This paper examines the systemic risks posed by incremental advancements in artificial intelligence, developing the concept of `gradual disempowerment', in contrast to the abrupt takeover...

Gradual Disempowerment: Systemic Existential Risks from...

This paper examines the systemic risks posed by incremental advancements in artificial intelligence, developing the concept of `gradual disempowerment', in contrast to the abrupt takeover...

The Scaling Era: An Oral History of AI, 2019–2025

An inside view of the AI revolution, from the people an…

AI agents pose untold risk to humanity. We must act to prevent that future | David Krueger

The pieces are falling into place for autonomous artificial intelligence. We must stop unregulated development

The Scaling Era: An Oral History of AI, 2019–2025

An inside view of the AI revolution, from the people and companies making it happen.

AI FOR EPISTEMICS & COORDINATION

Civilization and technology have radically improved the human condition. Nonetheless, the world sometimes goes in directions which essentially nobody would prefer — e.g., nuclear arms races, unexpected financial crashes, predatory marketing, or ubiquitous political misinformation.

Agentic AI and the next intelligence explosion

For decades, the artificial intelligence (AI) “singularity” has been heralded as a single, titanic mind bootstrapping itself to godlike intelligence, consolidating all cognition into a cold silicon point. But this vision is almost certainly wrong in its most fundamental assumption. If AI development follows the path of previous major evolutionary transitions or “intelligence explosions,” our current step-change in computational intelligence will be plural, social, and deeply entangled with its forebears (us!).

Building Political Superintelligence

Amidst fears of dystopia, a blueprint for how we use AI to reinvent the way we govern ourselves

The Impact of Artificial Intelligence on Human Thought

This research paper examines, from a multidimensional perspective (cognitive, social, ethical, and philosophical), how AI is transforming human thought. It highlights a cognitive offloading effect: the externalization of mental functions to AI can reduce intellectual engagement and weaken critical thinking. On the social level, algorithmic personalization creates filter bubbles that limit the diversity of opinions and can lead to the homogenization of thought and polarization. This research also describes the mechanisms of algorithmic manipulation (exploitation of cognitive biases, automated disinformation, etc.) that amplify AI's power of influence. Finally, the question of potential artificial consciousness is discussed, along with its ethical implications. The report as a whole underscores the risks that AI poses to human intellectual autonomy and creativity, while proposing avenues (education, transparency, governance) to align AI development with the interests of humanity.

What Does 'Human-Centred AI' Mean?

While it seems sensible that human-centred artificial intelligence (AI) means centring "human behaviour and experience," it cannot be any other way. AI, I argue, is usefully seen as a relationship between technology and humans where it appears that artifacts can perform, to a greater or lesser extent, human cognitive labour. This is evinced using examples that juxtapose technology with cognition, inter alia: abacus versus mental arithmetic; alarm clock versus knocker-upper; camera versus vision; and sweatshop versus tailor. Using novel definitions and analyses, sociotechnical relationships can be analysed into varying types of: displacement (harmful), enhancement (beneficial), and/or replacement (neutral) of human cognitive labour. Ultimately, all AI implicates human cognition; no matter what. Obfuscation of cognition in the AI context -- from clocks to artificial neural networks -- results in distortion, in slowing critical engagement, perverting cognitive science, and indeed in limiting our ability to truly centre humans and humanity in the engineering of AI systems. To even begin to de-fetishise AI, we must look the human-in-the-loop in the eyes.

What Does 'Human-Centred AI' Mean?

While it seems sensible that human-centred artificial intelligence (AI) means centring "human behaviour and experience," it cannot be any other way. AI, I argue, is usefully seen as a relationship between technology and humans where it appears that artifacts can perform, to a greater or lesser extent, human cognitive labour. This is evinced using examples that juxtapose technology with cognition, inter alia: abacus versus mental arithmetic; alarm clock versus knocker-upper; camera versus vision; and sweatshop versus tailor. Using novel definitions and analyses, sociotechnical relationships can be analysed into varying types of: displacement (harmful), enhancement (beneficial), and/or replacement (neutral) of human cognitive labour. Ultimately, all AI implicates human cognition; no matter what. Obfuscation of cognition in the AI context -- from clocks to artificial neural networks -- results in distortion, in slowing critical engagement, perverting cognitive science, and indeed in limiting our ability to truly centre humans and humanity in the engineering of AI systems. To even begin to de-fetishise AI, we must look the human-in-the-loop in the eyes.

AI, Decomputing and the Interregnum

This paper treats AI as diagnostic for the deeper changes taking place in the existing order of things. It uses AI's alignment with both the political economy and with the dualisms that underpin it, including race, gender and anthropocentrism, to highlight the nihilistic character of the current restructuring. AI's scaling and accelerationism are taken as examples of the wider tactics being invoked by hegemonic power to maintain control under changing conditions. From this perspective, the massive build-out of data centres isn't simply a seizure of energy resources but a manifestation of an aggressive and misogynist technopolitics. The paper argues that a liberal push for digital sovereignty doesn't interrupt these dynamics but plays into the hands of emerging technofascism. It proposes instead the prefigurative tactic of 'decomputing', which draws on degrowth, deautomatisation and a convivial approach to technology. It explores decomputing as a means to mitigate both material and relational harms and as a decisive turn towards infrastructuring the common good. The paper concludes that AI is the contradiction that reveals many others, not least the gap between claims to legitimacy and the actuality of destructive violence, and proposes an alternative technopolitics of reciprocity that prioritises care and sustainability.

AI, Decomputing and the Interregnum

This paper treats AI as diagnostic for the deeper changes taking place in the existing order of things. It uses AI's alignment with both the political economy and with the dualisms that underpin it, including race, gender and anthropocentrism, to highlight the nihilistic character of the current restructuring. AI's scaling and accelerationism are taken as examples of the wider tactics being invoked by hegemonic power to maintain control under changing conditions. From this perspective, the massive build-out of data centres isn't simply a seizure of energy resources but a manifestation of an aggressive and misogynist technopolitics. The paper argues that a liberal push for digital sovereignty doesn't interrupt these dynamics but plays into the hands of emerging technofascism. It proposes instead the prefigurative tactic of 'decomputing', which draws on degrowth, deautomatisation and a convivial approach to technology. It explores decomputing as a means to mitigate both material and relational harms and as a decisive turn towards infrastructuring the common good. The paper concludes that AI is the contradiction that reveals many others, not least the gap between claims to legitimacy and the actuality of destructive violence, and proposes an alternative technopolitics of reciprocity that prioritises care and sustainability.

How Shifting Responsibility for AI Harms Undermines Democratic Accountability | TechPolicy.Press

The moralization of individual AI use deflects responsibility away from powerful actors like corporations and governments, Suvradip Maitra and others write.

I Will Fucking Piledrive You If You Mention AI Again — Ludicity

The recent innovations in the AI space, most notably those such as GPT-4, obviously have far-reaching implications for society, ranging from the utopian eliminating of drudgery, to the dystopian damage to the livelihood of artists in a capitalist society, to existential threats to humanity itself.