I just rewrote llama.cpp server in Rust (most of it at least), and made it scalable

llama.cpp/tools/server at master · ggml-org/llama.cpp

LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.

Victor M on Twitter / X

llama.cpp UI now has MCP support 🔥Working super well, make sure you are up to date:```brew install llama.cpp```then```llama-server --webui-mcp-proxy``` pic.twitter.com/r8JXwpbfHq— Victor M (@victormustar) March 9, 2026

llama.app - Official home for llama.cpp

Official website for the llama.cpp project

llama.app : website + unified `llama` binary · ggml-org llama.cpp · Discussion #23875

Overview We are launching an official website for llama.cpp: https://llama.app/ The main goal of the website is to provide a simple way for new users to install and run llama.cpp on their machines....

ikawrakow/ik_llama.cpp

llama.cpp fork with additional SOTA quants and improved performance

llama.cpp/docs/build.md at master · ggml-org/llama.cpp

LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.

disnet/semble-it

A fast, local-first client for Semble.

llama.cpp with ROCm

WarningThis is a technical guide and assumes a certain level of technical knowledge. If there are confusing parts or you run into issues, I recommend using a strong LLM with research/grounding and reasoning abilities (eg Claude Sonnet 4) to assist.…

eugr/llama-benchy

llama-benchy - llama-bench style benchmarking tool for all backends

atproto-crates — AT Protocol building blocks for Rust

A Rust workspace of eighteen crates for AT Protocol: content addressing, DID and handle resolution, repositories and Merkle Search Trees, OAuth with DPoP, XRPC services, and event streaming.

A rambling post on ollama / llama.cpp and when to use each. Pros and cons and everything in between.

I'm not a professional LLMer by any means, but I figured I'd lay out my little journey and the findings along the way. When I first saw you could run…

Project Robius

Community for Multi-platform Application Development in Rust - Project Robius

ggml-org/Llama-macOS

A cosy home for your LLMs.

Announcing Rust 1.96.1 | Rust Blog

Empowering everyone to build reliable and efficient software.