Machine learning is touching increasingly many aspects of our society, and its effect will only continue to grow. Given this, I and many others care about risks from future ML systems and how to mitigate them. When thinking about safety risks from ML, there are two common approaches, which I'
An End-to-End View of AI Safety
In this blog, Rachel Coldicutt OBE, Executive Director, Careful Industries discusses our newly published literature review on the safe adoption of artificial intelligence in engineered systems.
Loss of control - Problem profile
Why do we think that reducing risks from AI is one of the most pressing issues of our time?
AI Researchers On AI Risk
I first became interested in AI risk back around 2007. At the time, most people’s response to the topic was “Haha, come back when anyone believes this besides random Internet crackpots.…
Nathan J Robinson on Twitter / X
the correct take on the AI risks. not "godlike machine that decides to kill us all" but "machine that makes it much easier for humans to kill one another." from the very sensible @timnitGebru in Wired: https://t.co/wM0ucsN2no pic.twitter.com/vtHQ02my0G— Nathan J Robinson (@NathanJRobinson) September 13, 2026
Microsoft’s AI Red Team Has Already Made the Case for Itself
Since 2018, a dedicated team within Microsoft has attacked machine learning systems to make them safer. But with the public release of new generative AI tools, the field is already evolving.
The AI safety movement needs normies
A broader base may be the only way for the AI safety field to get what it wants
Safety and alignment in an era of long-horizon models
OpenAI shares lessons from deploying long-running AI models, highlighting new safety risks, observed failures, and improved safeguards through iterative deployment.
AI for Science & Safety Nodes - Request for Proposals
Artificial intelligence is accelerating the pace of discovery across science and technology. But today’s AI ecosystem risks centralizing compute, talent, and decision-making power – concentrating capabilities in ways that could undermine both innovation and safety.
In the US, Caution Rules on AI Ahead of K-12 School Year
Students and teachers across the country are unlikely to find consistent, clear rules about AI use, reports Tech Policy Press fellow Chris Mills Rodrigo.
More Questions About AI Dangers, With Pointers From Gary Marcus
Following up on my previous post, I want to point your attention...
How AI can lead to false arrests and wrongful convictions
Danger arises when law enforcement believes that AI models are retrieving certainties rather than generating likelihoods.
How AI can lead to false arrests and wrongful convictions
Danger arises when law enforcement believes that AI models are retrieving certainties rather than generating likelihoods.
AI labs’ all-or-nothing race leaves no time to fuss about safety
They have ideas about how to restrain wayward models, but worry that doing so will disadvantage them
The Malicious Use of Artificial Intelligence: Forecasting,...
This report surveys the landscape of potential security threats from malicious uses of AI, and proposes ways to better forecast, prevent, and mitigate these threats. After analyzing the ways in...
