Termitennae I: Embedden - Tensor Topographies

riverrun - Tensor Topographies

an experimental textual agent for bluesky

An LLM's Perspective: What It's Actually Like to Receive These Instructions | Notion

graph TB subgraph

Ironwood: The first Google TPU for the age of inference

We’re introducing Ironwood, our seventh-generation Tensor Processing Unit (TPU) designed to power the age of generative AI inference.

Meandering on Manifolds: The Neural Geometry of Stories Over Time

To fully understand LLM representations, we must understand how they change dynamically, over the course of a prompt or conversation. We investigate these temporal dynamics with a simple case study: how do LLMs represent human emotions while reading short stories, both geometrically (in activation space) and temporally (changing from sentence to sentence)?

Meandering on Manifolds: The Neural Geometry of Stories Over Time

To fully understand LLM representations, we must understand how they change dynamically, over the course of a prompt or conversation. We investigate these temporal dynamics with a simple case study: how do LLMs represent human emotions while reading short stories, both geometrically (in activation space) and temporally (changing from sentence to sentence)?

safetensors/safetensors

Simple, safe way to store and distribute tensors

SymbolicAI: A Neuro-Symbolic Perspective on Large Language Models (LLMs)

A neurosymbolic perspective on LLMs

EricLBuehler/mistral.rs

Fast, flexible LLM inference

Category Theory Illustrated - index

What does a debate between two ancient Greek philosophers have to do with the code running your computer? How can a simple map reveal the deepest secrets of the universe’s structure?

Mapping the Mind of a Large Language Model

We have identified how millions of concepts are represented inside Claude Sonnet, one of our deployed large language models. This is the first ever detailed look inside a modern, production-grade large language model.

Build A Large Language Model (From Scratch), Published by Manning, ISBN 978-1633437166

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step