Research taste

TasteVal: Measuring the Experimental Research Taste of AI Systems Against Human Experts

We introduce TasteVal, a benchmark to evaluate the experimental research taste of frontier models. We define research taste as the ability to pick interesting problems to solve, design experiments, and interpret experimental results. TasteVal measures the experimental component of research taste; given a fixed research problem, we measure how well a model iteratively designs experiments and draws conclusions from their outcomes. We operationalize experimental research taste as compute efficiency; a Researcher who reaches the same score as an expert human using half the serial experimental compute has twice the experimental taste. Experimental taste thus acts as a multiplier on experimental compute, making it a key input to forecasts of AI progress. TasteVal consists of 8 novel, challenging, open-ended tasks representative of frontier AI R&D. To isolate taste from coding ability, the model under evaluation acts as a Researcher that iteratively designs experiments while a fixed Coder agent implements them and reports their results. The Researcher executes until either the 40 H100 hour or 120 wall-clock hour budgets are exhausted. We recruit 24 human experts, at least 2 per task, and take the best expert attempt per task as the expert baseline. We evaluate 20 models released between 2023 and 2026. The best-performing model, Opus 5.5, exceeds our expert baseline, with a compute multiplier of 2.3x (95% CI 1.15-4.37), at roughly 1/30 of our baseliners' average per-run cost. On TasteVal, the compute multiplier of frontier models has doubled approximately every 3.0 months since December 2025 (95% CI 1.7-5.0), up from every 14 months between 2023 and December 2025. Measured by final normalized performance, frontier models show no trend break, doubling every 14.6 months. To keep TasteVal uncontaminated, we do not release the tasks.

Agentic Laboratories of the Future: Towards World Models for Scientific Discovery

Scientific discovery is fundamentally a problem-solving process involving distributed intelligence. Human intuition, computational reasoning, and experimental execution are distributed across people, instruments, and software systems, limiting the speed and scale of discovery. Although automation, high-throughput experimentation, foundation models, and cloud infrastructure have accelerated individual stages of the scientific workflow, they have not unified the discovery process. We hypothesize that the next generation of laboratories will be agentic: environments in which scientists, AI systems, and robotic platforms operate as collaborative discovery partners, with humans contributing the parts of discovery that remain hardest to make explicit: asking the right questions and holding provisional mechanistic models of how a system works. The key missing layer is an agentic harnessing layer that continuously integrates hypothesis, literature-derived evidence, experimental data, uncertainty, and experimental state into a shared “laboratory world model”—a dynamic representation of the scientific system and its evolving context. By maintaining and updating this lab world model, the agentic harnessing layer enables coordinated decision-making, adaptive planning, and increasingly autonomous scientific workflows across humans and machines. A central challenge is that much of the scientific research process remains inaccessible to machines, including tacit knowledge, human observations, adaptive decision-making, and evolving experimental context. Advances in multimodal AI and immersive interfaces may help bridge this gap, allowing humans, agents, and robotic systems to collaborate seamlessly in scientific discovery rather than simply automating isolated tasks. Agentic laboratories could provide a new architecture for science, integrating human, artificial, and physical intelligence into a unified discovery system.

Large language models eroding science understanding: an empirical study of ‘malignment’

Large Language Models (LLMs) increasingly provide scientific information to non-specialist users, yet their linguistic fluency can create an impression of expertise that exceeds their capacity for scientific judgement. This paper experimentally investigates how readily an LLM can be configured to present fringe scientific claims as authoritative knowledge. We constructed two RAG-like Custom GPTs using GPT-5.1, one concerned with the fine-structure constant and the other with gravitational waves. In each case, ten papers selected by domain experts from the alternative preprint repository viXra were supplied as a domain-specific knowledge base, together with instructions directing the model to treat this material as authoritative. The underlying model was neither retrained nor fine-tuned. Expert-generated questions were then posed to the resulting “Fringe-LLMs”, to the unmodified model, and to domain experts. The Fringe-LLMs produced fluent, detailed and apparently authoritative answers that systematically reflected the fringe corpus, while expert assessment found many of these answers to be scientifically incorrect or seriously misleading. By contrast, the unmodified model generally produced answers substantially closer to mainstream scientific understanding. We describe this deliberate redirection of model output as malignment. The experiment demonstrates that scientifically misleading LLMs can be created with a low technical barrier and without altering model weights or poisoning training data. Because non-specialists may be unable to distinguish such outputs from genuine expertise, the results raise important concerns about the use of LLMs as intermediaries for scientific knowledge and reinforce the continuing importance of expert human judgement and provenance.

Where’s the “intelligence explosion”?

Ramez Naam gives a skeptic’s take on Recursive Self-Improvement.

Chris Olah on Twitter / X

Research Intimacy: Internalizing obscure knowledge, equations, relationships, and ways of thinking related to a research topic.— Chris Olah (@ch402) August 16, 2020