OpenAI says coding agents now run 3.1 days for every human research day, while its chief scientist warns the lab’s main monitoring method is weakening.
Research acceleration: The view inside OpenAI
Inside OpenAI, coding agents are reshaping AI research. Explore early data on agent usage, experiment velocity, task complexity, and research acceleration.
Measuring AI Ability to Complete Long Tasks
We propose measuring AI performance in terms of the *length* of tasks AI agents can complete. We show that this metric has been consistently exponentially increasing over the past 6 years, with a doubling time of around 7 months. Extrapolating this trend predicts that, in under a decade, we will see AI agents that can independently complete a large fraction of software tasks that currently take humans days or weeks.
AI coding agents generate more code, but not more software
Study finds coding efficiency gains get "absorbed" by human review "bottleneck."
What AI coding costs you | Tom Wojcik
What's the effect of the prolonged AI usage among coders and is it tracked correctly, if it all?
AI agents team up in Agent Laboratory to speed scientific research
Johns Hopkins University and AMD have developed Agent Laboratory, a new open-source framework that pairs human creativity with AI-powered workflows.
AI Coding Agent Benchmarks & Leaderboard | Artificial Analysis
We measure real-world performance of coding agents on software engineering tasks, including cost, token usage, and execution time. We compare how performance changes across agents, models, and execution settings.
OpenAI News
Stay up to speed on the rapid advancement of AI technology and the benefits it offers to humanity.
OpenAI News
Stay up to speed on the rapid advancement of AI technology and the benefits it offers to humanity.
Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity
We conduct a randomized controlled trial to understand how early-2025 AI tools affect the productivity of experienced open-source developers working on their own repositories. Surprisingly, we find that when developers use AI tools, they take 19% longer than without—AI makes them slower.
Scaling long-running autonomous coding · Cursor
We've been experimenting with running coding agents autonomously for weeks at a time.
6 months to live for open models
The most serious test to date of open source AI’s viability is happening right now.
Human scientists trounce the best AI agents on complex tasks
State-of-the-industry report finds that, despite the limitations of artificial-intelligence systems, researchers have embraced them.
Impressions from visiting OpenAI, Anthropic, & Cursor
A peek into where software engineering is headed from inside the sector’s leading AI labs. Agents running in the cloud are a major trend, while coding harnesses are spreading beyond the craft
MirrorCode: evidence AI can already do some weeks-long coding tasks
Early results from MirrorCode benchmark with METR: AI agents can complete weeks-long coding tasks, including reimplementing a 16,000-line codebase.
Building and evaluating AI Agents — Sayash Kapoor, AI Snake Oil
