Introduction | RLHF and Post-Training Book by Nathan Lambert

How linguistics learned to stop worrying and love the language models

Language models (LMs) can produce fluent, grammatical text. Nonetheless, some maintain that language models don’t really learn language and also, even if they did, that would not be informative for the study of human learning and processing. On the other side, there have been claims that the success of LMs obviates the need for studying linguistic theory and structure. We argue that both extremes are wrong. LMs can contribute to fundamental questions about linguistic structure, language processing, and learning. They force us to rethink arguments and ways of thinking that have been foundational in linguistics. While they do not replace linguistic structure and theory, they serve as model systems and working proofs of concept for gradient, usage-based approaches to language. We offer an optimistic take on the relationship between language models and linguistics.

Recursive Language Models: the paradigm of 2026

How we plan to manage extremely long contexts

Extracting Training Data from Large Language Models

Nicholas Carlini, Google; Florian Tramèr, Stanford University; Eric Wallace, UC Berkeley; Matthew Jagielski, Northeastern University; Ariel Herbert-Voss, OpenAI and Harvard University; Katherine Lee and Adam Roberts, Google; Tom Brown, OpenAI; Dawn Song, UC Berkeley; Úlfar Erlingsson, Apple; Alina Oprea, Northeastern University; Colin Raffel, Google

Stanford CS336 | Language Modeling from Scratch (Spring 2025 Archive)

Archived course website for Stanford CS336: Language Modeling from Scratch (Spring 2025), including schedule, assignments, logistics, and materials.

Training AI Agents with RL | Unsloth Documentation

Learn how to train AI agents for real-world tasks using Reinforcement Learning (RL).

We Have Always Been Action TheoristsToward a Critical Theory of Language for the Era of “Large Language Models”

Scholars of literature and culture understandably place themselves among the world’s premiere experts on matters of language. But they also know that fields like linguistics and communication have their own ways of studying how people express themselves through speech and written media. A key difference concerns the theories and methodologies...

The Rel Language - RAI Documentation

Full documentation for the Rel language.

Computation and its Connotations

A Review of Language Machines by Leif Weatherby

Language model harnesses are compositional generalizers

Harnesses can lead to compositional generalization: we observe a property in training RLMs, in which similarly structured tasks are viewed as isomorphic and all individual LM calls in the harness become in-distribution.

Recursive Language Models

We propose Recursive Language Models (RLMs), an inference strategy where language models can decompose and recursively interact with input context of unbounded length through REPL environments.

Models overview

Claude is a family of state-of-the-art large language models developed by Anthropic. This guide introduces the available models and compares their performance.

Understanding Understanding: A Pragmatic Framework Motivated by...

Motivated by the rapid ascent of Large Language Models (LLMs) and debates about the extent to which they possess human-level qualities, we propose a framework for testing whether any agent (be it...