A primer on inference math and an examination of the surprising costs of Llama.
Economic futures for LLM inference
Inference providers will look for other lines of business.
Producing The Perfect Token
The unspoken inference quality gap and how numerics determine if the inference you're paying for is worth it.
llama.cpp/docs/build.md at master · ggml-org/llama.cpp
LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.
The Past and Present of Computer-Augmented Hypothesis Generation
Don Swanson’s career started on a path familiar to many who read this blog.
Statistical Foundations of LLM-based A/B Testing: A Surrogacy...
Organizations and researchers show increasing interest in using large language models (LLMs) in place of human participants in A/B tests, in the hope of experimenting faster and at lower cost. We...
LLM use in scholarly writing poses a provenance problem
Nature Machine Intelligence - LLM use in scholarly writing poses a provenance problem
llama.ttf
llama.ttf is a font file which is also a large language model and an inference engine for that model.
llama.cpp/tools/server at master · ggml-org/llama.cpp
LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.
Why Are LLMs Smart?
A popular way to explain how current LLMs work is to say that “all” they do is predict the next most likely word in a sentence.
LLMs believe false statements even after explicit warnings that they're false
Fine-tuning tests show "bias... toward confidently representing the claims as true."
What sort of maths are LLMs good at?
For the sake of anyone who might read this blog post in the distant future (a month from now, say), let me mention that I am writing it a few days after OpenAI announced that it had solved ten majo…
