







This is a talk I gave at Google’s internal Code Health Summit in November of 2025. I’m sharing it here in the hopes that it sparks further learning and discussion. Abstract In a world where LLMs generate much of our code, understanding that code is more important than ever. But with a system as large … Continue reading Design for Understandability

Provisional Guidance for Users of LLM-Based Code Generators
available intuition for avoiding big risks

Systems that defy detailed understanding
Last week, I wrote about the mindset that computer systems can be understood, and behaviors can be explained, if we’re willing to dig deep enough into the stack of abstractions our software is built atop. Some of the ensuing discussion on Twitter and elsewhere lead me to write this followup, in which I want to run through a few classes of systems where I’ve found pursuing in-detail understanding of the system wasn’t the right answer.
God Help Us, Let’s Try To Learn About Mechanistic Interpretability Techniques
...

CodeGemma - an official Google release for code LLMs
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Compiling knowledge, not retrieving it: a hands-on deep dive into llm-wiki-compiler
The thesis of this piece is simple and uncomfortable: the problem of making an LLM “remember” what you’ve read isn’t solved with more…
One year as an AI Engineer: The 5 biggest misconceptions about LLM reliability I've encountered
535 votes, 59 comments. After spending a year building evaluation frameworks and debugging production LLM systems, I've noticed the same…
Alignment Is Proven To Be Solvable
That LLMs understand natural language as well as they do should dramatically change our understanding of the problem.

Here’s how I use LLMs to help me write code
Online discussions about using Large Language Models to help write code inevitably produce comments from developers who’s experiences have been disappointing. They often ask what they’re doing wrong—how come some …

Understanding Reasoning LLMs
Methods and Strategies for Building and Refining Reasoning Models

Why your local LLM feels dumber than it is
Quick Introduction We have all been on forums, chats, reddit, discord, youtube, or somewhere and heard “Oh! Model XYZ is AMAZEBALLZ!zomgwtfbbq” then downloaded it (or more likely, some quantized form of it) and said “eww… This sucks!” This post is going to be a rather technical series of experiments to demonstrate the impact of implementation-specific hazards with inference. I will be using the term “reference implementation” to describe the lab that published and offers first-party hosting of ...


The AI hater's guide to code with LLMs (The Overview) | All Confirmation Bias, All The Time
This is the post I don’t think many people expected me to write, and I have (rightly!) surrounded myself with people who are generally uncomfortable to somewhat hostile to “AI”, mostly for good reasons, though I’ll get into the many caveats on that as I go.
ADD / XOR / ROL: A non-anthropomorphized view of LLMs
In many discussions where questions of "alignment" or "AI safety" crop up, I am baffled by seriously intelligent people imbuing almost magic...
How to Build an LLM Knowledge Base
A hands-on guide to building a simple LLM knowledge base with raw markdown sources, a compiled wiki, reusable prompts, and an agent that keeps improving the knowledge base over time.

1/4 Do LLMs understand? "They understand in a way that’s very different from how humans understand," Dileep George, @dileeplearning.bsky.social, of Google DeepMind at the Simons Institute workshop on The Future of Language Models and Transformers. Video: simons.berkeley.edu/talks/dileep-george-google-de…