Llama 4: How to Run & Fine-tune | Unsloth Documentation

llama.app : website + unified `llama` binary · ggml-org llama.cpp · Discussion #23875

Overview We are launching an official website for llama.cpp: https://llama.app/ The main goal of the website is to provide a simple way for new users to install and run llama.cpp on their machines....

eugr/llama-benchy

llama-benchy - llama-bench style benchmarking tool for all backends

llama.cpp/docs/build.md at master · ggml-org/llama.cpp

LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.

llama.cpp/tools/server at master · ggml-org/llama.cpp

LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.

Thireus/GGUF-Tool-Suite

Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input a target size and the toolchain will create a GGUF recipe tuned to your hardware within seconds — flexible model sizing and lowest achievable perplexity/kld for GGUF enthusiasts seeking precise and automated dynamic quant production.

Dynamic 1-bit DeepSeek-R1-0528 GGUFs out now!

118 votes, 16 comments. Hey guys sorry for the wait, but now you can now run DeepSeek-R1-0528 with our Dynamic 1-bit GGUFs!…

Run DeepSeek-R1 Dynamic 1.58-bit

DeepSeek R-1 is the most powerful open-source reasoning model that performs on par with OpenAI's o1 model. Run the 1.58-bit Dynamic GGUF version by Unsloth.

run-llama/notebookllama

A fully open-source, LlamaCloud-backed alternative to NotebookLM

llama.app - Official home for llama.cpp

Official website for the llama.cpp project

Matt Mireles on Twitter / X

Introducing...Gemma 4 Multimodal Fine-Tuner for  Apple Silicon- LoRA fine-tunning toolkit for Gemma LLM- runs locally on macOS via PyTorch and Metal- streams data from Google Cloud to your machine- fine-tune on audio, image and text- easy-to-use CLI wizardIf you want… pic.twitter.com/UduROxoxPU— Matt Mireles (@mattmireles) April 7, 2026

ggml-org/Llama-macOS

A cosy home for your LLMs.

Release 0.32.0: The llama has left the barn · ggml-org/Llama-macOS

LlamaBarn is now Llama. It's the same app with a new name, and your settings and downloaded models carry over automatically. Because of the rename, this update isn't automatic -- download a...

leobeeson/llm_benchmarks

A collection of benchmarks and datasets for evaluating LLM.

Unsloth AI on Twitter / X

Run Gemma 3n locally with our Dynamic GGUFs!✨@Google's Gemma 3n supports audio, vision, video & text and the 4B model fits on 8GB RAM for fast local inference.Fine-tuning is also supported in Unsloth.Gemma-3n-E4B GGUF: https://t.co/PliynxoKQc https://t.co/wMFWLjNaDR pic.twitter.com/lxsMNDmkW8— Unsloth AI (@UnslothAI) June 26, 2025