ikawrakow/ik_llama.cpp

I just rewrote llama.cpp server in Rust (most of it at least), and made it scalable

497 votes, 46 comments. Long story short, I rewrote most of the llama-server, made it scalable, and bundled that into Paddler. Initially, the project…

eugr/llama-benchy

llama-benchy - llama-bench style benchmarking tool for all backends

llama.app : website + unified `llama` binary · ggml-org llama.cpp · Discussion #23875

Overview We are launching an official website for llama.cpp: https://llama.app/ The main goal of the website is to provide a simple way for new users to install and run llama.cpp on their machines....

A rambling post on ollama / llama.cpp and when to use each. Pros and cons and everything in between.

I'm not a professional LLMer by any means, but I figured I'd lay out my little journey and the findings along the way. When I first saw you could run…

llama.cpp/tools/server at master · ggml-org/llama.cpp

LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.

lemonade-sdk/llamacpp-rocm

Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration

llama.app - Official home for llama.cpp

Official website for the llama.cpp project

Llama 4: How to Run & Fine-tune | Unsloth Documentation

How to run Llama 4 locally using our dynamic GGUFs which recovers accuracy compared to standard quantization.

llama.cpp/docs/build.md at master · ggml-org/llama.cpp

LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.

No llama.cpp acknowledgement · Issue #3697 · ollama/ollama

What is the issue? This project is heavily dependent on llama.cpp, as seen in this search, but there is no mention of that in the readme. This creates some conflict and distaste for this project th...

Victor M on Twitter / X

llama.cpp UI now has MCP support 🔥Working super well, make sure you are up to date:```brew install llama.cpp```then```llama-server --webui-mcp-proxy``` pic.twitter.com/r8JXwpbfHq— Victor M (@victormustar) March 9, 2026

predibase/lorax

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

Benjamin Marie (@bnjmnmarie)

A new alternative to Ollama: You can now run models directly through Unsloth (with Docker): https://docs.unsloth.ai/models/how-to-run-llms-with-docker It supports the same models as llama.cpp, which I guess means it runs on llama.cpp… But this way you don’t need to set up anything, if you already have Docker installed.

llama.cpp with ROCm

WarningThis is a technical guide and assumes a certain level of technical knowledge. If there are confusing parts or you run into issues, I recommend using a strong LLM with research/grounding and reasoning abilities (eg Claude Sonnet 4) to assist.…

kwindla on Twitter / X

Local voice AI with a 235 billion parameter LLM. ✅- smart-turn v2- MLX Whisper (large-v3-turbo-q4)- Qwen3-235B-A22B-Instruct-2507-3bit-DWQ- KokoroAll models running local on an M4 mac. Max RAM usage ~110GB.Voice-to-voice latency is ~950ms. There are a couple of… pic.twitter.com/iYNQlb9JkI— kwindla (@kwindla) July 27, 2025