Inference providers will look for other lines of business.
Dria on Twitter / X
Introducing Inference Arena v2.0.An agentic experience that searches, analyzes, and delivers insights about LLM inference.When we first launched, our goal was simple: make it easier for developers to compare models, engines, and hardware without digging through scattered… pic.twitter.com/fgWgos48lW— Dria (@driaforall) September 30, 2025
Public LLM exceeds superforecaster on Forecast bench by EOY 2026?
41% chance. Resolves to YES if any LLM released in 2026 exceeds the superforecaster baseline on ForecastBench by July 2027. Resolves to NO if this does not happen, or if after January 1, 2027 we have results from enough LLMs (e.g. the leading models from the major AI labs at the time) to be confident this will not occur. If The Forecasting Research Institute tells us how this market should resolve, then we will go with what they say.
Large Language Models: An Applied Econometric Framework
Large language models (LLMs) enable researchers to analyze text at unprecedented scale and minimal cost. Researchers can now revisit old questions and tackle novel ones with rich data. We provide an econometric framework for realizing this potential in two empirical uses. For prediction problems—forecasting outcomes from text—valid conclusions require “no training leakage” between the LLM's training data and the researcher's sample, which can be enforced through careful model choice and research design. For estimation problems—automating the measurement of economic concepts for downstream analysis—valid downstream inference requires combining LLM outputs with a small validation sample to deliver consistent and precise estimates. Absent a validation sample, researchers cannot assess possible errors in LLM outputs, and consequently seemingly innocuous choices (which model, which prompt) can produce dramatically different parameter estimates. When used appropriately, LLMs are powerful tools that can expand the frontier of empirical economics.
Dan Shipper 📧 on Twitter / X
this is true and is a big reason why you don’t need to be a highly technical researcher to use LLMs in surprising and novel ways https://t.co/TuxNzXzToU— Dan Shipper 📧 (@danshipper) July 27, 2025
Inference characteristics of Llama · Cursor
A primer on inference math and an examination of the surprising costs of Llama.
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Sebastian Raschka on Twitter / X
Pretty cool. I think 2025-2026 will be a stronger focus on these in open source tooling.I.e. having LLMs delegate knowledge-based queries to search, which in turn frees up model capacity to improve reasoning capabilities and tool use. https://t.co/wNTg283mb2— Sebastian Raschka (@rasbt) August 12, 2025
Overview - GroqDocs
Fast LLM inference, OpenAI-compatible. Simple to integrate, easy to scale. Start building in minutes.
Brandon Stewart on Twitter / X
1/ New @Nature! We study how powerful institutions shape the information environment for LLMs. Commercial LLM training is opaque, so we trace a path from state-coordinated media -> training data -> model responses. pic.twitter.com/5LdFvzbFaf— Brandon Stewart (@b_m_stewart) May 13, 2026
State of AI 2025: 100T Token LLM Usage Study | OpenRouter
Read OpenRouter's 2025 State of AI report — an empirical 100 trillion token study of real LLM usage, model trends, and developer insights.
LLM in a Flash: Efficient Large Language Model Inference with Limited Memory
Large language models (LLMs) are central to modern natural language processing, delivering exceptional performance in various tasks…
Take caution in using LLMs as human surrogates | PNAS
Recent studies suggest large language models (LLMs) can generate human-like responses, aligning with human behavior in economic experiments, survey...
Understanding Reasoning LLMs
Methods and Strategies for Building and Refining Reasoning Models
