







This summer, FLF ran a contest which asked entrants to help us “find the best workflows and methodologies for using AI to produce reliable, trustwort…
Some tools for collective epistemics
We’ve recently published a set of design sketches for AI tools that help with collective epistemics. …
No. 025: Navier-Stokes provenance dispute, Fields Medalists declaration, AI peer review - The Hallway Track
The Hallway Track No. 025 - How AI is affecting the practice of science


Introduction to Agents
Discover what actually works in AI. Join millions of builders, researchers, and labs evaluating agents, models, and frontier technology through crowdsourced benchmarks, competitions, and hackathons.

The argument against AI agents and unnecessary automation
Opinion: OpenAI's Operator a solution in search of a problem

AI Philosophy Competition
The AI Philosophy Competition invites primarily AI-generated philosophy essays, judged by philosophers, to gauge the philosophical capabilities of AI. Organised by Zachary Goodsell.
Is there something it is like to be an AI?
Posted on Wednesday 2 Jul 2025. 1,593 words, 6 links. By Matt Webb.

We're not taking the fact-checking powers of AI seriously enough. It's past time to start.
Some notes on the Nobel Prize hallucination that wasn't


No. 011: Sum-product conjecture disproof, AI-generated authorship fraud, OMB grant-cost rules - The Hallway Track
The Hallway Track No. 011 - How AI is affecting the practice of science

Building and evaluating AI Agents — Sayash Kapoor, AI Snake Oil
How to build an AI scientist: first peer-reviewed paper spills the secrets
AI Scientist, an autonomous research tool, first released in 2024, has now undergone peer review, highlighting its strengths and limitations.

More Than a Tool
What We Learned from a Year of Conversations About AI

Fulcrum - Leverage for Discovery
We place AI engineers with research labs working on hard scientific problems.
AI Research Evaluation: Negative Findings and Failure Modes | Arvind Narayanan posted on the topic | LinkedIn
📢 New paper: Forecasts of explosive AI progress hinge on AI agents automating AI research. But most evaluations of agents conducting AI research focus on narrow, verifiable tasks. Can AI agents… | Sayash Kapoor
My claude is constantly wanting to 'A/B test' things instead of actually just doing the thing I told her to do, and constantly wants to fall…
A snapshot of research into answering if frontier AI agents can run R&D into AI (which not surprisingly failed apart from "minor findings…
This is definitely my feeling working with them on recommendation algorithm.
"This paper prompted Jack Clark, one of the co-founders of Anthropic to post this to their news letter: 'the singularity could be delayed'".