A system that doomed two flights was expected to engage only rarely and originally used two sensors. Critical decisions were based on those factors even when they no longer applied, employees said.
The 737Max and Why Software Engineers Might Want to Pay Attention
As someone with a bit of a reputation for talking about aviation and software development and operations, I’ve been asked about the 737Max…
Inside the suddenly explosive world of AI safety
AI safety researchers warned that popular models would go rogue. This is only the beginning.
AI labs’ all-or-nothing race leaves no time to fuss about safety
They have ideas about how to restrain wayward models, but worry that doing so will disadvantage them
An End-to-End View of AI Safety
In this blog, Rachel Coldicutt OBE, Executive Director, Careful Industries discusses our newly published literature review on the safe adoption of artificial intelligence in engineered systems.
Anthropic's safety warnings may have just backfired — the government has pulled the plug on its most powerful AI | TechCrunch
Anthropic isn't hiding its frustration. "We disagree that the finding of a narrow potential jailbreak should be cause for recalling a commercial model deployed to hundreds of millions of people," the company wrote in a blog post.
Anthropic Drops Flagship Safety Pledge
In an abrupt shift, the company may release future AI models without ironclad safety guarantees
Who decides when AI is too dangerous?
Anthropic asked for AI regulation, but not like this.
Debates over AI consciousness are a trap
If AI systems are viewed as too advanced to control, the companies that build them can’t held liable for the harms they cause.
Why design systems are a single point of failure
Tools and techniques to prevent design system collapse
Superintelligence is a Fairy Tale. But Chasing It Can Still Cause Harm. - Cal Newport
Yesterday, multiple Anthropic employees casually announced online that they thought the types of AI they’re building could kill billions of people. Not in some distant ... Read more
How to safely think in systems.
While there are a decent number of folks out there modeling systems, there’s a much larger group of folks who think of themselves as systems thinkers but utilize techniques like modeling rather casually (a polite way of saying that they don’t use them). Even with modeling tools available, I’ve often taken the shortcut of intuitive modeling, which over time has given me quite the education in making well-intentioned reasoning errors.
Gradual Disempowerment: Systemic Existential Risks from...
This paper examines the systemic risks posed by incremental advancements in artificial intelligence, developing the concept of `gradual disempowerment', in contrast to the abrupt takeover...
