EricLBuehler/mistral.rs

Fast, flexible LLM inference

Economic futures for LLM inference

Inference providers will look for other lines of business.

Producing The Perfect Token

The unspoken inference quality gap and how numerics determine if the inference you're paying for is worth it.

llama.cpp/docs/build.md at master · ggml-org/llama.cpp

LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.

Take caution in using LLMs as human surrogates | PNAS

Recent studies suggest large language models (LLMs) can generate human-like responses, aligning with human behavior in economic experiments, survey...

The Past and Present of Computer-Augmented Hypothesis Generation

Don Swanson’s career started on a path familiar to many who read this blog.

LLM use in scholarly writing poses a provenance problem

Nature Machine Intelligence - LLM use in scholarly writing poses a provenance problem

llama.ttf

llama.ttf is a font file which is also a large language model and an inference engine for that model.

llama.cpp/tools/server at master · ggml-org/llama.cpp

LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.

Why Are LLMs Smart?

A popular way to explain how current LLMs work is to say that “all” they do is predict the next most likely word in a sentence.

ggml-org/llama.cpp

LLM inference in C/C++

ggml-org/llama.cpp

LLM inference in C/C++

LLMs believe false statements even after explicit warnings that they're false

Fine-tuning tests show "bias... toward confidently representing the claims as true."

What sort of maths are LLMs good at?

For the sake of anyone who might read this blog post in the distant future (a month from now, say), let me mention that I am writing it a few days after OpenAI announced that it had solved ten majo…

uzu - Mirai Docs

Inference engine

Understanding Reasoning LLMs

Methods and Strategies for Building and Refining Reasoning Models