Community maintained hardware plugin for vLLM on Apple Silicon
Cua on Twitter / X
1/ Today, as part of our broader research into Apple Silicon virtualization, we're releasing a process-scoped Metal capability layer for macOS VMs. On one M1 Ultra, prompt / generation:TinyLlama: 11.08× / 16.36×Gemma 4 12B: 7.20× / 14.54×Muse Glimmer 30B: 7.55× / 8.87× pic.twitter.com/6UwxgoDowT— Cua (@trycua) August 11, 2026
Geek Lite on Twitter / X
在 Apple Silicon Mac 上本地运行 LLM 推理服务，提供比 Ollama 和 llama.cpp 更快的 OpenAI 兼容 API，同时原生支持工具调用和提示缓存。https://t.co/IXet9GW7x0Rapid-MLX 用 Apple 自家的 MLX 框架做推理，搭了个 FastAPI 服务跑 OpenAI 兼容 API。在 Apple Silicon 上比 Ollama 快 2-4 倍，靠… pic.twitter.com/d9QUbAWJSZ— Geek Lite (@QingQ77) May 3, 2026
We rebuilt the Linux microVM stack on Apple Silicon
Firecracker needs KVM and therefore a Linux host, and the image tooling around it needs loop mounts and Linux userland. We rebuilt the stack on Apple's Virtualization.framework to boot the same OCI images as microVMs on macOS and on Linux.
Doriandarko/MLX-GRPO
A pure MLX-based training pipeline for fine-tuning LLMs using GRPO on Apple Silicon.
vllm-project.github.io/_posts/2026-07-22-kimi-k3-preview.md at main · vllm-project/vllm-project.github.io
Contribute to vllm-project/vllm-project.github.io development by creating an account on GitHub.
Ollama is now powered by MLX on Apple Silicon in preview· Ollama Blog
Today, we're previewing the fastest way to run Ollama on Apple silicon, powered by MLX, Apple's machine learning framework.
Exploring LLMs with MLX and the Neural Accelerators in the M5 GPU
Mac with Apple silicon is increasingly popular among AI developers and researchers interested in using their Mac to experiment with the…
apple-silicon-llm-bench/results/complete_results.html at main · AlexHiesch/apple-silicon-llm-bench
Systematic LLM inference benchmark for Apple Silicon: 8 backends, 7 models, 791 measurements - AlexHiesch/apple-silicon-llm-bench
Apple Does Fusion.
For the first time in five generations of Apple Silicon, these chips are not a single piece of silicon. The newly announced M5 Pro and M5 Max use what Apple calls Fusion Architecture. This is a big…
Intel Xe VFIO Driver: GPU Virtualization Enters the Mainstream
Intel Xe VFIO driver in Linux 6.19 enables SR-IOV GPU virtualization for multiple VMs. After 20+ years in infrastructure: this changes…
Apple Container external driver for macOS by afbjorklund · Pull Request #3839 · lima-vm/lima
A new macOS driver similar to the WSL2 driver for Windows, creating virtual machines from container images (as rootfs). Issue #3788 make native && ADDITIONAL_DRIVERS=ac make additio...
Optimizing On-Device Inference for Apple Silicon
A custom local engine that improves prefill and decode throughput
ethicalabs-ai/BlossomTuneLLM-MLX
Federated Fine-Tuning of LLMs on Apple Silicon with Flower.ai and MLX-LM