NobodyWho is an inference engine that lets you run LLMs locally on any device
Introducing any-llm: A unified API to access any LLM provider
When it comes to using LLMs, it’s not always a question of which model to use: it’s also a matter of choosing who provides the LLM and where it is deployed. Today, we announce the release of any-llm, a Python library that provides a simple unified interface to access the most popular providers.
LLMs running on my laptop can drive coding agents now | Simon P. Couch
Qwen 3.5 and Gemma 4 are a step change for local coding agents.
Mesh-LLM/mesh-llm
Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.
I don't pay for ChatGPT, Perplexity, Gemini, or Claude – I stick to my self-hosted LLMs instead
There's no point in relying on AI tools when my local LLMs can handle everything
Minions: where local and cloud LLMs meet· Ollama Blog
Avanika Narayan, Dan Biderman, and Sabri Eyuboglu from Christopher Ré's Stanford Hazy Research lab, along with Avner May, Scott Linderman, James Zou, have developed a way to shift a substantial portion of LLM workloads to consumer devices by having small on-device models (such as Llama 3.2 with Ollama) collaborate with larger models in the cloud (such as GPT-4o).
How to Serve Local LLMs Anywhere: Secure Remote Access with Cloudflare and Unsloth | Unsloth Documentation
Unsloth is an open-source project that allows you to train and run LLMs locally and with Cloudflare tunnel, you can access Unsloth from your mobile device, share access to a friend or coworker, host Unsloth on a server such as Google Colab, AWS, or even a personal server.
Rohan Paul on Twitter / X
👨🔧 Github: Native, Apple Silicon–only local LLM server. Similar to Ollama, but built on Apple's MLX- OpenAI API compatible, - Ollama‑compatible- OpenAI‑style tools + tool_choice, with tool_calls parsing and streaming deltasgithub. com/dinoki-ai/osaurus pic.twitter.com/G0NbWnEJcQ— Rohan Paul (@rohanpaul_ai) September 3, 2025
open-slopware
Free/Open Source Software choosing to use and/or support LLM usage/AI, as well as alternatives and tips to requesting better policies or forking.
truefoundry/trueforge
The open-source agent harness - the runtime layer that turns an LLM into a working agent.
Reuse your existing hardware to run LLMs privately and securely.
Trellis lets you run large language models on your organization's compute. Scale and data privacy, choose both.
Your Laptop Isn’t Ready for LLMs. That’s About to Change
The quest to run large AI models locally on an individual's machine are driving the biggest change in laptop architecture in decades.
mesh-llm/scripts/build-llama.sh at main · Mesh-LLM/mesh-llm
Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat. - Mesh-LLM/mesh-llm
How to Run and Deploy LLMs on your iOS or Android Phone | Unsloth Documentation
Tutorial for fine-tuning your own LLM and deploying it on your Android or iPhone with ExecuTorch.
OpenRouter
The unified interface for LLMs. Find the best models & prices for your prompts