Mesh LLM

Mesh LLM: distributed AI computing on iroh

How Mesh LLM pools existing GPU resources across machines into a single OpenAI-compatible API, built on iroh.

Latency optimization | OpenAI API

Improve latency across a wide variety of LLM-related use cases.

BerriAI/litellm

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

Issue · BerriAI/litellm

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthr...

mesh-llm/docs/EXO_COMPARISON.md at 2c334485856b110e9eb3f8e46e4cc3e8993bea1d · Mesh-LLM/mesh-llm

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat. - Mesh-LLM/mesh-llm

OpenAI Model Spec

The Model Spec specifies desired behavior for the models underlying OpenAI's products (including our APIs).

Rohan Paul on Twitter / X

👨‍🔧 Github: Native, Apple Silicon–only local LLM server. Similar to Ollama, but built on Apple's MLX- OpenAI API compatible, - Ollama‑compatible- OpenAI‑style tools + tool_choice, with tool_calls parsing and streaming deltasgithub. com/dinoki-ai/osaurus pic.twitter.com/G0NbWnEJcQ— Rohan Paul (@rohanpaul_ai) September 3, 2025

Use OpenAI's Responses API with local models

OpenAI-compatible `/v1/responses` endpoint (stateful chats, remote mcp, custom tools)

Mesh-LLM/mesh-llm

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

OpenAI on Twitter / X

Our open models are here.Both of them.https://t.co/9tFxefOXcg— OpenAI (@OpenAI) August 5, 2025

OpenAI Developers on Twitter / X

Today we’re announcing Open Responses: an open-source spec for building multi-provider, interoperable LLM interfaces built on top of the original OpenAI Responses API.✅ Multi-provider by default✅ Useful for real-world workflows✅ Extensible without fragmentationBuild… pic.twitter.com/SJiBFx1BOF— OpenAI Developers (@OpenAIDevs) January 15, 2026

mesh-llm/scripts/build-llama.sh at main · Mesh-LLM/mesh-llm

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat. - Mesh-LLM/mesh-llm

Model Context Protocol

An open protocol that enables seamless integration between LLM applications and external data sources and tools. - Model Context Protocol

Overview - GroqDocs

Fast LLM inference, OpenAI-compatible. Simple to integrate, easy to scale. Start building in minutes.

Minions: where local and cloud LLMs meet· Ollama Blog

Avanika Narayan, Dan Biderman, and Sabri Eyuboglu from Christopher Ré's Stanford Hazy Research lab, along with Avner May, Scott Linderman, James Zou, have developed a way to shift a substantial portion of LLM workloads to consumer devices by having small on-device models (such as Llama 3.2 with Ollama) collaborate with larger models in the cloud (such as GPT-4o).