Jan-nano, a 4B model that can outperform 671B on MCP

230. MCP - It's Hot, But Will It Win?

There's a long history of "middleware" in our industry. Everyone wants it. There's always a hot one, but it rarely makes to the finish line and often disappoints.

antirez/ds4

DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm

apple-silicon-llm-bench/results/complete_results.html at main · AlexHiesch/apple-silicon-llm-bench

Systematic LLM inference benchmark for Apple Silicon: 8 backends, 7 models, 791 measurements - AlexHiesch/apple-silicon-llm-bench

Release v0.29.0 · ml-explore/mlx

Highlights Support for mxfp4 quantization (Metal, CPU) More performance improvements, bug fixes, features in CUDA backend mx.distributed supports NCCL back-end for CUDA What's Changed [CUDA]...

drumih/turbo-fieldfare

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

Megakernel: Matching Apple Silicon Efficiency at 2x the Throughput on a RTX 3090

The first megakernel for hybrid DeltaNet/Attention LLMs. 413 tok/s at 1.87 tok/J on a 2020 RTX 3090, matching M5 Max efficiency at 1.8x throughput.

unsloth/Jan-nano-128k-GGUF · Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Running local models on an M4 with 24GB memory | jola.dev

Experiments with getting usable outputs out of local models on a standard Macbook

MacBook Air (M4)

The MacBook Air with the M4 chip is Apple's most powerful yet, with amazing battery life and buttery-smooth performance in a thin and light profile.

Cua on Twitter / X

1/ Today, as part of our broader research into Apple Silicon virtualization, we're releasing a process-scoped Metal capability layer for macOS VMs. On one M1 Ultra, prompt / generation:TinyLlama: 11.08× / 16.36×Gemma 4 12B: 7.20× / 14.54×Muse Glimmer 30B: 7.55× / 8.87× pic.twitter.com/6UwxgoDowT— Cua (@trycua) August 11, 2026

On Kimi K3: Its Capabilities And Related Discontents

Kimi K3 is a very good model with excellent benchmarks.

2TB SanDisk Extreme PRO with USB4 | Sandisk

The SanDisk Extreme PRO with USB4 portable SSD is engineered for on-the-move professionals and modern adventurers, with turbocharged read speeds up to 3800MB/s and capacities up to 4TB.

Steeve Morin on Twitter / X

For instance, we are now loading from SSD at about 14-16GB/s *in a composable manner*.That means about 1.1s to load an 8B BF16 model. https://t.co/i0c7xu8HhP— Steeve Morin (@steeve) November 1, 2025