I wrote up my experiences programming with LLMs a bit over a year ago, and updated it for the world of agents eight months ago. A lot has changed since then, so here is an update.
The Bitter Lesson of LLM Extensions
From ChatGPT Plugins to Agent Skills, a look at how we've been trying (and failing) to extend LLMs for the last three years.
LLMs running on my laptop can drive coding agents now | Simon P. Couch
Qwen 3.5 and Gemma 4 are a step change for local coding agents.
Shann³ on Twitter / X
5 upgrades you can do to Karpathys LLM wikisave this blueprint and send it to your agents https://t.co/clFZiHARGn pic.twitter.com/T7LWgjtu9y— Shann³ (@shannholmberg) May 5, 2026
truefoundry/trueforge
The open-source agent harness - the runtime layer that turns an LLM into a working agent.
Georgi Gerganov on Twitter / X
llama.cpp at 100k starsnow that 90% of the code worldwide is being written by AI agents, I predict that within 3-6 months, 90% of all AI agents will be running locally with llama.cpp 😄Jokes aside, I am going to use this small milestone as an opportunity to reflect a bit on… pic.twitter.com/BpN5VL1bYV— Georgi Gerganov (@ggerganov) March 30, 2026
Karpathy's LLM Wiki as Agent Memory - Agentic AI Foundation (AAIF)
At work, I’m building agents to handle various operational tasks and have found Karpathy’s LLM Wiki design to be an excellent solution for implementing most ty…
Agent Recipes
Explore common agent recipes with ready to copy code to improve your LLM applications.
mesh-llm/docs/EXO_COMPARISON.md at 2c334485856b110e9eb3f8e46e4cc3e8993bea1d · Mesh-LLM/mesh-llm
Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat. - Mesh-LLM/mesh-llm
Paul Iusztin on Twitter / X
Using LLM wikis for agentic coding is pure gold. It's so powerful it feels like cheating. Here is how I used it to develop a coding harness from scratch:1. I ingested multiple coding harnesses repositories into the LLM wiki (e.g., opencode, pi, hermes, etc.) pic.twitter.com/7WE7NI9tnN— Paul Iusztin (@pauliusztin_) June 29, 2026
Philipp Schmid on Twitter / X
Should we build the web for agents, not agents for the web? 🤔 A new paper argues that current research is misguidedly focuses on improving LLMs leading to significant problems with efficiency, reliability, and safety, proposing a new "Agentic Web Interface" (AWI) that sits on… pic.twitter.com/I90k6kdYdk— Philipp Schmid (@_philschmid) June 14, 2025
elvis on Twitter / X
Diagram of the LLM Knowledge Base system.Feed this to your favorite agent and get your own LLM knowledge base going. https://t.co/4AQSFOv4PV pic.twitter.com/nPSNi4Ayqv— elvis (@omarsar0) April 3, 2026
Andrej Karpathy on Twitter / X
Personal update: I've joined Anthropic. I think the next few years at the frontier of LLMs will be especially formative. I am very excited to join the team here and get back to R&D. I remain deeply passionate about education and plan to resume my work on it in time.— Andrej Karpathy (@karpathy) May 19, 2026
AI Agents: Key Concepts and How They Overcome LLM Limitations
An AI agent is an autonomous software entity that is often used to augment a large language model. Here's what developers need to know.
Multi-agentic Software Development is a Distributed Systems Problem (AGI can't save you from it)
Recently, I've been thinking a lot about scaffolding and languages for managing systems of LLMs coordinating with each other — new programming languages might be the ideal solution for this area.
2025: The year in LLMs
This is the third in my annual series reviewing everything that happened in the LLM space over the past 12 months. For previous years see Stuff we figured out about …
