







A field guide to inference concepts, production operations, tooling, and career development for platform engineers.
Introduction - How to Write an Inference Engine
A zero-to-hero guide to Muse Glimmer on Apple Metal, kvpack, and disaggregated NVFP4 prefill.

Open-Source AI & Open Models Reading List
How to get up to speed on open models and their implications.

Overview - GroqDocs
Fast LLM inference, OpenAI-compatible. Simple to integrate, easy to scale. Start building in minutes.

High Performance AI Lab
High Performance AI Lab builds open inference systems and publishes the conditions behind every number — device, model, quant, and rep count.

Crafting a good (reasoning) model
A recent talk I gave on model training, reasoning, and the next frontier.

Open models by OpenAI
Advanced open-weight reasoning models to customize for any use case and run anywhere.

Dria on Twitter / X
Introducing Inference Arena v2.0.An agentic experience that searches, analyzes, and delivers insights about LLM inference.When we first launched, our goal was simple: make it easier for developers to compare models, engines, and hardware without digging through scattered… pic.twitter.com/fgWgos48lW— Dria (@driaforall) September 30, 2025
Msty Nexus - Inference Gateway
Put one governed inference layer behind your AI tools for model routing, local runtimes, provider keys, usage visibility, and guardrails.

gpt-oss:120b
OpenAI’s open-weight models designed for powerful reasoning, agentic tasks, and versatile developer use cases.

gpt-oss:20b
OpenAI’s open-weight models designed for powerful reasoning, agentic tasks, and versatile developer use cases.

Open Models Inference for Coding · Umans AI
Hosted Kimi K3, GLM 5.2, and DeepSeek V4 Flash. Pay per token, on infrastructure we own.

A taxonomy for next-generation reasoning models
Where we've been and where we're going with RLVR.


Open-Source Agentic Inference Benchmark | InferenceX
Compare AgentX, InferenceX's long-context, multi-turn coding scenario, with fixed-sequence AI inference across chips and frameworks. Public NVIDIA and AMD runs update when configurations change.

Cloudflare Workers AI | Open-source AI inference

NVIDIA NIM for Developers

SambaNova | The Fastest AI Inference Platform
Pricing | Mistral AI

GitHub Copilot · Plans & pricing

JetBrains AI Plans & Pricing