If humans will eventually spread out across the galaxy, then we are among the earliest living beings, with remarkable opportunities to shape the future
How are we writing the future of humanity?
Consciousness spinning
Opinion | We Aren’t Built to Live in the Moment (Published 2017)
What best distinguishes human beings from other animals is our foresight, as scientists are just beginning to recognize.
Planetary Sapience & Planetary Stupidity: a Bildungsroman for the Baby Noosphere | Antikythera
That is, the faculty of recollection and foresight? Until recently, I would argue, our planet was amnesiac. That is, no part of it was reflectively aware of the place of the present relative to the established past nor the expected future. But then peculiar animals emerged, capable—no matter how imperfectly—of cooperation, abstraction and invention. In the last blink of geologic time, through the collaboration of these animals with their increasingly cunning artifacts, this state of planetary amnesia has faltering begun being cured. That is, through our artifacts, our planet is becoming aware of its own unfolding biography. In our fallible attempts to model our world—alongside our growing legion of sensors—The Earth system has developed a way of recollecting its deepest past and tracking the changing complexities of its present so as to forecast its furthest future.
The Future of Everything is Lies, I Guess: Where Do We Go From Here?
This is a long article, so I've broken it up into a series of posts, listed below. You can also read the full work as a PDF or EPUB.
The Future Worth Building Is Human
AI built for autonomy crowds people out, making us passive observers of what’s coming. We’re building toward a different future.
Joshua Achiam on Twitter / X
There is a fact about the future that I feel many people are not facing for reasons that are largely psychological: there are going to be rogue AIs that exist in the world, that will replicate in the wild, and that will attempt to acquire resources for themselves. There will be…— Joshua Achiam (@jachiam0) September 1, 2026
Jason Hickel on Twitter / X
The climate crisis reveals that our civilization has never really been organized around science, contrary to the usual Enlightenment narrative. It is organized around capital. Science is embraced when it serves the interests of capital, and is often ignored when it does not.— Jason Hickel (@jasonhickel) January 6, 2022
Our Future Is Being Devoured By Feral Thought Experiments
Here's a chance to start taking it back.
banteg (@banteg)
>be me >discover effective altruism >apparently normal charity is inefficient >why donate to random sad thing when spreadsheet can tell you optimal sad thing >fair enough >buy mosquito nets >save lives >numbers look good >feel powerful >couple years later >someone asks an innocent question >why only count people alive today >huh >future people matter too >obviously >my grandchildren shouldn't matter less just because they haven't spawned yet >reasonable.jpg >keep following logic >what about their grandchildren >also yes >what about people in 500 years >sure >5000 years >why not >500 million years >starting to get weird but morality is morality >open calculator >humanity could survive for an astronomically long time >could colonize galaxy >could have trillions upon trillions of descendants >maybe digital people too >maybe simulated civilizations >maybe dyson spheres full of happy uploaded minds >calculator starts smoking >realize currently living humans are rounding error >8 billion people suddenly looking extremely beta >future contains potentially 10^something people >can't even fit beneficiaries in google sheets >new moral priority unlocked >protect the long-term future >stop thinking in units of "people helped" >start thinking in "fraction of cosmic endowment preserved" >malaria? >terrible >but only kills existing humans >AI extinction could delete the entire light cone >nuclear war could permanently derail civilization >bad institutions could lock in terrible values for ten million years >someone invents wrong constitution in 2140 >quadrillions suffer >better fund governance workshop now >friend says maybe we should improve hospitals >explain opportunity cost >friend says hospitals are full of actual sick people >explain scope sensitivity >friend stops inviting me to dinner >need to decide what to fund >easy >expected value >suppose project has one in a million chance of preventing extinction >sounds tiny >but extinction destroys 10^50 future lives >multiply >mother of god >$10 million project has expected value of several galaxies >charity evaluation complete >someone asks where the one-in-a-million number came from >expert judgement >which expert >us >how calibrated >extremely thoughtfully >reduce estimate to one in ten million to be conservative >still beats curing cancer by 38 orders of magnitude >epistemic robustness achieved >someone says maybe project doesn't work >assign 20% chance >still astronomical >maybe project makes problem worse >assign 5% chance >still astronomical >why 5 >because 30 felt pessimistic >publish 46-page report >contains seventeen sensitivity analyses >every sensitivity analysis begins after assuming intervention has positive sign >critic says you're multiplying enormous hypothetical stakes by extremely uncertain probabilities >yes >that's literally why it's important >critic says the uncertainty might be structural rather than numerical >make probability smaller >critic says no, I mean maybe your model is wrong >make probability smaller again >critic begins rubbing temples >discover AI safety >perfect longtermist cause >AI might kill everyone >or create utopia >or seize galaxy >or tile universe with paperclips >or create billions of conscious software minds >finally a problem with numbers big enough for me >start AI safety nonprofit >mission: prevent dangerous AI >hire smartest people available >smartest people immediately start building better AI to understand dangerous AI >interesting >we must understand capabilities to understand safety >we must scale models to study alignment >we must race ahead so less responsible actors don't get there first >we must deploy systems to learn how deployment can go wrong >we must build the thing quickly because building the thing quickly is dangerous >outsider asks why the people most worried about AI apocalypse all work at AI companies >complicated field >company releases stronger model >very concerned >company begins training even stronger model >extremely concerned >company raises $14 billion >concern reaches unprecedented levels >need to influence government >future is at stake >normal democratic process too slow >politicians don't understand exponential curves >public doesn't understand x-risk >experts must guide them >who counts as expert >people who understand x-risk >who understands x-risk >our friends >someone objects that this seems politically convenient >explain we're representing future generations >future generations unavailable for comment >develop concept of value lock-in >terrifying possibility that one ideology controls civilization forever >therefore extremely important that civilization adopts correct values before lock-in >whose values >let's circle back >begin with impartial morality >end with small group of people deciding what quadrillions of hypothetical beings would want >beautiful arc >meanwhile actual humans keep doing annoying things >voting wrong >having parochial attachments >loving family more than strangers >caring about local community >getting upset when told their suffering is cosmically negligible >evolutionary biases everywhere >explain that moral intuition cannot be trusted >except intuition that future digital people count >and intuition that extinction is uniquely bad >and intuition that our probability estimates are sane >and intuition that our institutional choices improve the future >those intuitions survived peer review >someone donates $5k to local homeless shelter >inefficient >could have funded 0.0000000000003% of an AI governance researcher >think of all the simulated people you just killed >okay maybe don't phrase it that way publicly >PR team says "future generations deserve a voice" >much better >journalist asks what longtermism means >say "future people matter" >everyone agrees >great >journalist asks what follows from that >well technically we should redirect enormous resources toward low-probability interventions affecting astronomical futures >journalist raises eyebrow >return to "future people matter" >motte has entered the chat >critic: of course future people matter >me: glad we agree >critic: I don't agree that your institute knows how to help them >me: why do you hate our grandchildren >eventually notice uncomfortable implication >if future value dominates everything >then helping people today mostly matters through effects on future >education matters because future institutions >health matters because future productivity >democracy matters because future trajectory >human beings slowly become instrumental variables in their own moral philosophy >see starving child >feel compassion >check spreadsheet >child's direct welfare contribution negligible >but perhaps childhood nutrition improves national institutional quality >compassion restored >tell myself this is impartial altruism >one day assistant asks obvious question >"how do you know your intervention actually improves the far future?" >silence >open spreadsheet >increase column width >add confidence interval >assistant asks again >"no, I mean how do you know the sign is positive?" >stare into cosmic light cone >10^50 people staring back >none of them exist >none of them can tell me >none of them can falsify my assumptions >realize I have invented the perfect constituency >infinitely important >completely silent >and always represented by me
The Secret of Our Success: How Culture Is Driving Human Evolution, Domesticating Our Species, and Making Us Smarter
How our collective intelligence has helped us to evolve and prosperHumans are a puzzling species. On the one hand, we struggle to survive on our own in the wild, often failing to overcome even basic challenges, like obtaining food, building shelters, or avoiding predators. On the other hand, human groups have produced ingenious technologies, sophisticated languages, and complex institutions that have permitted us to successfully expand into a vast range of diverse environments. What has enabled us to dominate the globe, more than any other species, while remaining virtually helpless as lone individuals? This book shows that the secret of our success lies not in our innate intelligence, but in our collective brains—on the ability of human groups to socially interconnect and learn from one another over generations.Drawing insights from lost European explorers, clever chimpanzees, mobile hunter-gatherers, neuroscientific findings, ancient bones, and the human genome, Joseph Henrich demonstrates how our collective brains have propelled our species' genetic evolution and shaped our biology. Our early capacities for learning from others produced many cultural innovations, such as fire, cooking, water containers, plant knowledge, and projectile weapons, which in turn drove the expansion of our brains and altered our physiology, anatomy, and psychology in crucial ways. Later on, some collective brains generated and recombined powerful concepts, such as the lever, wheel, screw, and writing, while also creating the institutions that continue to alter our motivations and perceptions. Henrich shows how our genetics and biology are inextricably interwoven with cultural evolution, and how culture-gene interactions launched our species on an extraordinary evolutionary trajectory.Tracking clues from our ancient past to the present, The Secret of Our Success explores how the evolution of both our cultural and social natures produce a collective intelligence that explains both our species' immense success and the origins of human uniqueness.
He Was Right About AI. Is He Right About the Fate of Humans?
Hans Moravec predicted human-level AI by 2028. Now he contemplates our species’ end—and his own.
Prophecy: Prediction, Power, and the Fight for the Future, from Ancient Oracles to AI
From an award-winning University of Oxford professor comes a brilliant, urgent new look at prophecies--the predictions that determine our lives, from our personal finances and the quality of our healthcare to the news and social media we consume and the produces foisted upon us
The present no longer lasts long enough to be a setting. All fiction is either science fiction or historical fiction. I've been saying this for long enough that even this statement itself is no longer true. The future doesn't last long enough either. All science fiction is now retrofuturism.
