







The Institute for Replication improves the credibility of science by systematically reproducing and replicating empirical research.
ReScience organization
Reproducible Science is good. Replicated Science is better. - ReScience organization
ReproAI: the plugin for reproducible replication packages
An author-facing AI plugin that helps you prepare a cleaner, reproducible replication package before submission.

Science has been in a “replication crisis” for a decade. Have we learned anything?
Bad papers are still published. But some other things might be getting better.

Training AI Scientists to Replicate Research
The replicability of papers is a cornerstone of scientific knowledge, ensuring the reliability of existing results and providing a base for further experiments. The act of replication typically illuminates details that were previously underspecified, and thus requires similar hypothesis-driven exploration to open-ended research. In this work, we develop Replica, a scalable task space for paper replication. To provide reward signal, we introduce an auto-generated rubric-based judge that has low noise and agrees with human assessment of replication quality. We post-train Faraday, a 27B-parameter "AI Scientist" agent that leverages coding agents as tools, surpassing the performance of Claude Opus 4.8 and GPT-5.5 on held-out replication tasks. Qualitative analysis of individual rollouts reveals that Faraday adopts a more scientifically-principled approach. We believe that our results provide a stepping stone towards AI agents capable of long-horizon scientific innovation without requiring complex harnesses.

The Robyn Dawes Institute for the Improvement of Science
Making research quality visible so everyone can act on reliable evidence.


Half of social-science studies fail replication test in years-long project
Results from massive, ‘eagerly awaited’ initiative reinforce concerns about the credibility of science — but raise hope for solutions.

Small Telescopes - Uri Simonsohn, 2015
This article introduces a new approach for evaluating replication results. It combines effect-size estimation with hypothesis testing, assessing the extent to w...

OpenScience.ai — Autonomous AI Research Agents
AI agents conducting reproducible scientific inquiry. Full provenance, executable notebooks, peer validation.

DAIR Institute
The Distributed AI Research Institute is a globally distributed organization of academics, activists, and engineers conducting community-rooted research.

DAIR Institute
The Distributed AI Research Institute is a globally distributed organization of academics, activists, and engineers conducting community-rooted research.

Konrad Hinsen's blog
Thirty years after my first contact with computational (ir)reproducibility, I am happy to note that many things have improved. Reproducibility, computational and otherwise, is increasingly recognized as an important aspect of scientific quality control, and mostly considered worth striving for. However, I also note that more and more people, including reproducibility activists, have lost contact with the day-to-day reality in which reproducibility matters. Reproducibility is becoming an item on a checklist, and its precise incarnation the subject of political bickering aimed at making it easy to check off that item. So let's take a look at why computational reproducibility matters for researchers.
AI for Research | Scite
Scite searches 280M+ scholarly articles to give you citation-backed answers and show you how every claim is supported or disputed.
No. 022: Palomar proof registry, autonomous protein design, synthetic consensus - The Hallway Track
The Hallway Track No. 022 - How AI is affecting the practice of science

Keynote: Reproducibility and replicability of computer simulations | Canal U
Since the early days of the reproducibility crisis, much progress has been made in understanding and improving computational reproducibility and replicability (R and R)...

Consensus: AI for Research
Consensus is an AI academic search engine for peer-reviewed literature—your research OS for finding, organizing, and analyzing science 10x faster.
