Freedom to reliably deploy any open model effortlessly.
Moving Beyond Containers - Introducing Boxer by Daniel Phillips @Wasm I/O 2025
Extensible Software in the age of LLMs | Jeremy Morrell
Solid core + capability-based sandboxes + LLMs = Users with superpowers
Minions: where local and cloud LLMs meet· Ollama Blog
Avanika Narayan, Dan Biderman, and Sabri Eyuboglu from Christopher Ré's Stanford Hazy Research lab, along with Avner May, Scott Linderman, James Zou, have developed a way to shift a substantial portion of LLM workloads to consumer devices by having small on-device models (such as Llama 3.2 with Ollama) collaborate with larger models in the cloud (such as GPT-4o).
Benjamin Marie (@bnjmnmarie)
A new alternative to Ollama: You can now run models directly through Unsloth (with Docker): https://docs.unsloth.ai/models/how-to-run-llms-with-docker It supports the same models as llama.cpp, which I guess means it runs on llama.cpp… But this way you don’t need to set up anything, if you already have Docker installed.
Self-host and scale web apps without Kubernetes complexity | Uncloud
Take your Docker Compose apps to production with zero-downtime deployments, automatic HTTPS, and cross-machine scaling. Self-hosting made reliable without the complexity.
Self-Hosted Second Brains DWeb Camp 2026
Local-first knowledge bases with self-hosted integrated agents allow for people to leverage LLMs without having to trust the companies hosting cloud models.
How to Serve Local LLMs Anywhere: Secure Remote Access with Cloudflare and Unsloth | Unsloth Documentation
Unsloth is an open-source project that allows you to train and run LLMs locally and with Cloudflare tunnel, you can access Unsloth from your mobile device, share access to a friend or coworker, host Unsloth on a server such as Google Colab, AWS, or even a personal server.
Build Bigger With Small Ai: Running Small Models Locally
boop.cat - Free Static Hosting
Free, fast static site hosting for developers. Deploy directly from GitHub with zero config.
boop.cat - Free Static Hosting
Free, fast static site hosting for developers. Deploy directly from GitHub with zero config.
Easypanel — Deploy anything on your server
Deploy applications and open-source services on your own server with a modern, self-hosted platform as a service.
Introducing any-llm: A unified API to access any LLM provider
When it comes to using LLMs, it’s not always a question of which model to use: it’s also a matter of choosing who provides the LLM and where it is deployed. Today, we announce the release of any-llm, a Python library that provides a simple unified interface to access the most popular providers.
open-slopware
Free/Open Source Software choosing to use and/or support LLM usage/AI, as well as alternatives and tips to requesting better policies or forking.
Home - NobodyWho
NobodyWho is an inference engine that lets you run LLMs locally on any device
Histomat of F/OSS: We should reclaim LLMs, not reject them
A few days ago, I came across a blog post titled On FLOSS and training LLMs that articulates a growing frustration within the free and open source software…