







Did an afternoon / evening speedrun of setting up local AI on the @z-space.ca network with @jacob.cascadia.social @vangarderen.net @hadsie.com - proxmox node for openwebui, npm - ASUS GX10 node for inference - Old Macbook running LiteLLM for routing between machines
Jun 3, 2026 at 4:12 AM
freestylefly/wesight
Open-source desktop AI agent workspace with one-click Claude Code, Codex, OpenClaw, Hermes Agent setup and custom LLM model routing.
EXO — Run frontier AI locally.
EXO connects your Macs and workstations into one local inference cluster. Run frontier AI locally.

Own your AI with local models and open protocols | Tiles Blog
A Local-First Conf talk about local models, open protocols, and user-owned AI.

View @Jefflau's post on Firefly
I think what's interesting is that the desire for local AI may inadvertently create a lot more local node users. It's a fraction of the actual compute local AI needs and just requires a decent amount of disk space.
Nativ — Local AI for your Mac
Frontier intelligence on your desk. No accounts, subscriptions, or cloud.
raullenchai/Rapid-MLX
The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider.
raullenchai/Rapid-MLX
The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider.
Z-Space Local AI
ZAI is the Z-Space Local AI project, exploring hardware and software systems at the community level.

Locally AI - Run AI models locally on your iPhone, iPad, and Mac.
Run Llama, Gemma, Qwen, DeepSeek, and more on your iPhone, iPad, and Mac. Optimized for Apple Silicon. Offline. Private.

GGML and llama.cpp join HF to ensure the long-term progress of Local AI
We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio
MLX on Mac with Apple silicon lets AI researchers and developers experiment locally with the latest models and methods in a private…
Networked AI Agents in Decentralized Architecture (NANDA) - Ramesh Raskar 12.3.25
GradientHQ/parallax
Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere
Introducing @huggingface/kernels: 200+ WebGPU Kernels for Local AI
We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Running local models on an M4 with 24GB memory | jola.dev
Why and How to Run Local Models in Zed

Running local models is good now