







FrontierHarness Eval v1.1 ran 22 coding-agent harnesses with 5 models on the same 62 tasks, 4 times each: 27,280 runs. The best-value harness was different with each model, and cost ranks moved far between models. With the model fixed, the most expensive harness cost 1.8 to 5.0 times as much per task as the cheapest.
Extreme Harness Engineering for Token Billionaires: 1M LOC, 1B toks/day, 0% human code, 0% human review — Ryan Lopopolo, OpenAI Frontier & Symphony
We shed light on OpenAI's first Dark Factory for the first time.

DeepSWE
DeepSWE measures frontier coding agents on original, long-horizon software engineering tasks.

Harness Lens - a Hugging Face Space by harness-hub
Compare coding-agent harnesses, every claim linked to source
Introducing MaxxBench: Benchmarking Task Adaptation and Generalization in Frontier Coding Agents | MaxxBench
How coding models respond when familiar engineering tasks ask for something different.

Cline on Twitter / X
Your daily driver for AI coding shouldn't be a black box -- the stakes are too high. You should have confidence that when you spend $20 on frontier models, you're getting $20 in frontier model intelligence.With subscription tools, you never know what's happening:- Is that… pic.twitter.com/lKUVFLMEip— Cline (@cline) July 8, 2025

Securing our frontier model training environment
OpenAI explains how we strengthened containment for frontier model training and evaluation, including offline environments and high-compute red-teaming.

Harness² — Recursive Agent Harnessing for an Open World
Can recursion improve both the current harness and how future harnesses are improved?

Why SWE-bench Verified no longer measures frontier coding capabilities
SWE-bench Verified is increasingly contaminated and mismeasures frontier coding progress. Our analysis shows flawed tests and training leakage. We recommend SWE-bench Pro.

Building an Advanced Agentic Harness | Data For Science
From a single pilot to an air campaign: planning, parallelism, memory, verification, and observability for production-shaped agents.

AI Coding Agent Benchmarks & Leaderboard | Artificial Analysis
We measure real-world performance of coding agents on software engineering tasks, including cost, token usage, and execution time. We compare how performance changes across agents, models, and execution settings.
Honey, I Shrunk the Coding Agent
Coding Agent Adaptation Lets a 9B LLM Outperform 10x Larger Models on Aider Polyglot Benchmark

Running local models is good now
Local agentic coding has gotten great over the past few months

Our team just shipped Fugu-Ultra v1.1! 🐡 By dynamically orchestrating the latest frontier models, we pushed performance up by 7.9 points. We are now beating Fable 5 in complex coding and reasoning tasks without even having Fable 5 in our agent pool. Collective intelligence is the future.
Sakana AI
Announcing Fugu-Ultra v1.1 🐡 We’ve been thrilled by the reception to the Fugu model family. Thanks to everyone who tried it, shared feedback, and trusted Fugu with real work. Today, we’re releasing Fugu-Ultra v1.1 → sakana.ai/fugu Upgraded to incorporate the latest frontier models.