Wolfram LLM Benchmarking Project

leobeeson/llm_benchmarks

A collection of benchmarks and datasets for evaluating LLM.

Best LLM for Coding 2026 | AI Coding Model Rankings & Benchmarks

Which AI model writes the best code? We rank every major LLM — open and closed source — across SWE-bench, HumanEval, LiveCodeBench, and Terminal-Bench coding benchmarks. Compare the best LLMs for coding, software engineering, and programming.

ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilities

Recent large language models (LLMs) advancements sparked a growing research interest in tool assisted LLMs solving real-world challenges…

chad/whichlang

What programming language do LLMs default to when you don't tell them? A small benchmark.

Fast and Hard Code

People pick languages differently with LLMs.

Speed Comparison - Programming Languages

Benchmarks run on GitHub Actions. Results may vary based on runner hardware.

Aider LLM Leaderboards

Quantitative benchmarks of LLM code editing skill.

Demystifying llm-d and vLLM: The race to production

Learn how vLLM and llm-d work together for efficient and scalable large language model (LLM) inference. Discover the benefits of disaggregated scaling, expert-parallel scheduling, and KV cache-aware routing.

harbor-framework/terminal-bench

A benchmark for LLMs on complicated tasks in the terminal

eugr/llama-benchy

llama-benchy - llama-bench style benchmarking tool for all backends

Benchmarks | EXO

Transparent benchmarks for LLMs tested on real hardware. Coming soon.

On-Device LLM Throughput Calculator - a Hugging Face Space by FL33TW00D-HF

This tool estimates and visualizes the throughput of Large Language Models on devices with memory bandwidth constraints. Users input device and model configurations, and the tool generates a plot s...

Training Large Language Models with Interpreter Feedback using WebAssembly

A fast, local, and secure approach to training LLMs for code with WebAssembly and interpreter-based rewards

Magicoder: Empowering Code Generation with OSS-Instruct

We introduce Magicoder, a series of fully open-source (code, weights, and data) Large Language Models (LLMs) for code that significantly closes the gap with top code models while having no more...