AI existential risk probabilities are too unreliable to inform policy

How speculation gets laundered through pseudo-quantification

Learnings from a week in the wet lab — LessWrong

I work on biosafety evals for LLMs, but have never set foot in a wet lab. This seems kind of silly, so this week I decided to change that.  …

First They Built a Secular Apocalypse Belief System. Now They Want Religious Authority.

Over the weekend, a clip about “Anthropic thinks it’s building God” started making the rounds.

#13: A Timeline of the OpenAI Board

Yesterday, Sam Altman and Greg Brockman were fired from the Board of Directors of OpenAI.

Effective Altruism Funded the “AI Existential Risk” Ecosystem with Half a Billion Dollars

The “AI Existential Safety” field did not arise organically. Effective Altruism invested $500 million in its growth and expansion.

Think tank tied to tech billionaires played key role in Biden’s AI order

Researchers from the RAND Corporation — which took more than $15 million this year from a group financed by a Facebook co-founder — were a driving force behind the White House’s sweeping new AI reporting requirements.

Congress warns science agency over AI grant to tech-linked think tank

Lawmakers are worried the National Institute of Standards and Technology’s planned grant to the RAND Corp. lacks transparency.

Liron Shapira on Twitter / X

Meet the guy who invented @OpenAI's RLHF technique (https://t.co/opc5yWzi2e).His name is Dr. @PaulFChristiano, PhD Comp Sci from UC Berkeley.Paul says there's a 50% chance of doom once AI systems are human-level intelligent.So do we keep training smarter AI systems or no?🤔 pic.twitter.com/5U1EMsPADB— Liron Shapira (@liron) April 25, 2023

AI Doomers Are Starting to Admit It: They’re Going Too Far

One of the biggest doomsayers of artificial intelligence has done an about-face—and it could help save the world.

What the heck is wrong with our AI overlords?

New profile of Sam Altman shines a light on a whole industry.

NIST faces crisis over Paul Christiano hire | VentureBeat

NIST faces turmoil as staff consider quitting over Paul Christiano's expected appointment to a role at the US AI Safety Institute, sources say.

U.S. Must Act Quickly to Avoid Risks From AI, Report Says

The U.S. government must move “decisively” to avert an “extinction-level threat" to humanity from AI, says a government-commissioned report

Action Plan to increase the safety and security of advanced AI

The first U.S. government-commissioned assessment on catastrophic national security risks from advanced AI on the path to AGI.

The AI Doomers Have Infiltrated Washington

This week, a State Department funded report declared that AI posed an existential threat akin to nuclear weapons—and even recommended jail time for unauthorized AI development.

Towards a Weaker Longtermism

A key (new-ish) proposition in EA discussions is "Strong Longtermism," that the vast majority of the value in the universe is in the far future, and…

Overcoming Bias : Tiptoe Or Dash To Future?

To test who should TA elite classes, new physics grad students at U Chicago in ’81 were asked to pick a physics problem and explain its solution to the group.  I did well by picking the question: should you walk fast or slow if you want to get the least water on your front while moving a certain distance in the rain.  The answer is: move as fast as you can.