







Did an afternoon / evening speedrun of setting up local AI on the @z-space.ca network with @jacob.cascadia.social @vangarderen.net @hadsie.com - proxmox node for openwebui, npm - ASUS GX10 node for inference - Old Macbook running LiteLLM for routing between machines
Jun 3, 2026 at 4:12 AM
freestylefly/wesight
Open-source desktop AI agent workspace with one-click Claude Code, Codex, OpenClaw, Hermes Agent setup and custom LLM model routing.
EXO — Run frontier AI locally.
EXO connects your Macs and workstations into one local inference cluster. Run frontier AI locally.

Own your AI with local models and open protocols | Tiles Blog
A Local-First Conf talk about local models, open protocols, and user-owned AI.

Nativ — Local AI for your Mac
Frontier intelligence on your desk. No accounts, subscriptions, or cloud.
raullenchai/Rapid-MLX
The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider.
raullenchai/Rapid-MLX
The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider.
Z-Space Local AI
ZAI is the Z-Space Local AI project, exploring hardware and software systems at the community level.

Locally AI - Run AI models locally on your iPhone, iPad, and Mac.
Run Llama, Gemma, Qwen, DeepSeek, and more on your iPhone, iPad, and Mac. Optimized for Apple Silicon. Offline. Private.

GGML and llama.cpp join HF to ensure the long-term progress of Local AI
We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Networked AI Agents in Decentralized Architecture (NANDA) - Ramesh Raskar 12.3.25
GradientHQ/parallax
Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere
SambaNova | The Fastest AI Inference Platform
Discover SambaNova - the complete AI platform delivering the fastest AI inference, fine-tuning, and scalable solutions for agentic AI easily integrated into existing data center infrastructures.

Ankesh Bharti - Tiles: Own your AI with local models and open protocols

Running local models on an M4 with 24GB memory | jola.dev
Why and How to Run Local Models in Zed

Running local models is good now