LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
open-slopware
Free/Open Source Software choosing to use and/or support LLM usage/AI, as well as alternatives and tips to requesting better policies or forking.
chad/whichlang
What programming language do LLMs default to when you don't tell them? A small benchmark.
LLM Compressor
Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
distil labs — Replace LLMs with Custom Small Language Models
Train and deploy custom small language models that are faster, cheaper, and just as accurate as LLMs.
truefoundry/trueforge
The open-source agent harness - the runtime layer that turns an LLM into a working agent.
Featherless - Serverless LLM Hosting
Freedom to reliably deploy any open model effortlessly.
LM Link: Access models on your powerful devices you own, as if they were local
Tailscale and LM Studio partner to provide encrypted access to remote LLMs on hardware you own.
Wikipedia:LLM-assisted translation
This guideline applies to machine translation tools that include a large language model ("LLM"). Assume that it applies to any online translation tool unless you have confirmed there is no LLM element.
mesh-llm/docs/EXO_COMPARISON.md at 2c334485856b110e9eb3f8e46e4cc3e8993bea1d · Mesh-LLM/mesh-llm
Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat. - Mesh-LLM/mesh-llm
Extensible Software in the age of LLMs | Jeremy Morrell
Solid core + capability-based sandboxes + LLMs = Users with superpowers
