Communicate with an LLM provider using a single interface
Introducing any-llm: A unified API to access any LLM provider
When it comes to using LLMs, it’s not always a question of which model to use: it’s also a matter of choosing who provides the LLM and where it is deployed. Today, we announce the release of any-llm, a Python library that provides a simple unified interface to access the most popular providers.
LLM APIs are a Synchronization Problem
Maybe the LLM message APIs should be rethought as a synchronization problem.
OpenRouter
The unified interface for LLMs. Find the best models & prices for your prompts
interception
This is a very quick post. I had an idea as I was walking the dog this evening, and I wanted to build a functioning demo and write about it within a couple of hours. While the post and idea started this evening, the genesis of the idea has been brewing for a while and goes back over a year to August 2024, when I wrote about being sucked into a virtual internet. WebSim has been on my mind for a while, because I loved the idea of being able to simulate my own version of the web using the browser directly and not via another web page. And a couple of weeks ago, I managed to work out how to get Puppeteer to intercept requests and respond with content generated via an LLM.
feynon/intent-router-blueprint
A hybrid LLM intent routing system for secure agent orchestration.
Stream29/ProxyAsLocalModel
Proxy remote LLM API as Ollama and LM Studio, for using them in JetBrains AI Assistant
I don't pay for ChatGPT, Perplexity, Gemini, or Claude – I stick to my self-hosted LLMs instead
There's no point in relying on AI tools when my local LLMs can handle everything
Open Responses
This is the standardization effort I've most wanted in the world of LLMs: a vendor-neutral specification for the JSON API that clients can use to talk to hosted LLMs. Open …
open-slopware
Free/Open Source Software choosing to use and/or support LLM usage/AI, as well as alternatives and tips to requesting better policies or forking.
Tonight I integrated an LLM into every part of the request/response life-cycle of the the browser to see what I could do. aifoc.us/interception/ It was a lot of fun, in the demo linked I can rewrite a web page as before it's rendered by the browser to give me just a summary of the contents.
interception
aifoc.usChrome looks set to ship an LLM Prompt API to the web platform. At Mozilla, we oppose this API. We feel it has a large interoperability risk, and Google imposing T&Cs on a web API sets a dangerous precedent. Full details: github.com/mozilla/standards-positions/i…
Prompt API · Issue #1213 · mozilla/standards-positions
github.com
