Generative AI deserves scientific attention. But the rush to study it is producing a feedback loop of topical and methodological convergence, flattening scientific imagination and crowding out the pluralism needed to keep research adaptive, resilient, and intellectually generative.
Artificial intelligence and illusions of understanding in scientific research
Scientists are enthusiastically imagining ways in which artificial intelligence (AI) tools might improve research. Why are AI tools so attractive and what are the risks of implementing them across the research pipeline? Here we develop a taxonomy of scientists’ visions for AI, observing that their appeal comes from promises to improve productivity and objectivity by overcoming human shortcomings. But proposed AI solutions can also exploit our cognitive limitations, making us vulnerable to illusions of understanding in which we believe we understand more about the world than we actually do. Such illusions obscure the scientific community’s ability to see the formation of scientific monocultures, in which some types of methods, questions and viewpoints come to dominate alternative approaches, making science less innovative and more vulnerable to errors. The proliferation of AI tools in science risks introducing a phase of scientific enquiry in which we produce more but understand less. By analysing the appeal of these tools, we provide a framework for advancing discussions of responsible knowledge production in the age of AI.
AI has supercharged scientists—but may have shrunk science
Analysis of 41 million papers finds that although AI expands individual impact, it narrows collective scientific exploration
Deep Research, information vs. insight, and the nature of science
What AI will accelerate in the scientific process, what it cannot do, and how we can prepare for new manners of scientific investigation.
The Thoughts The Civilized Keep
The hype around a new AI language generator reveals the sterility of mainstream thinking on AI today — and indeed on how we think about thinking itself.
AI Research Agents Narrow Scientific Exploration
AI research agents can now generate research ideas, design experiments, run code, and draft papers, raising the possibility of large-scale AI-assisted scientific discovery. Many current agent frameworks explicitly encourage the generation of novel and high-impact ideas. Yet it remains unclear whether AI-assisted ideation broadens scientific exploration or mainly concentrates around existing work. We study AI research agents as scientific search systems. Using four AI research-agent frameworks and six large language models, we generate 37,802 scientific ideas from shared seed literature across citation-defined research areas in AI and machine learning. We then compare the resulting AI ideas against human-authored papers from the same research areas, follow-on human research emerging from the same seed literature, and the seed literature itself. Across experiments, four consistent patterns emerge. First, AI-generated ideas are substantially more concentrated than human-authored papers from the same research areas. Second, AI-generated ideas remain much closer to their starting literature than later human follow-on work does. Third, papers most similar to AI-generated ideas tend to receive lower subsequent citations. Fourth, when AI-generated ideas differ from prior work, the differences arise primarily from recombining existing technical methods rather than introducing fundamentally new research questions. Overall, current AI research agents appear better suited to local elaboration than to broadening scientific exploration.
Science that Compounds: The Need for A New Substrate for Research in the Age of AI
This paper is a perspective from Lightcone Research, an open-source initiative building tooling for scientific research in the age of agentic AI.
Artificial intelligence tools expand scientists’ impact but contract science’s focus
Nature - Artificial intelligence boosts individual scientists’ output, citations and career progression, but collectively narrows research diversity and reduces collaboration, concentrating...
AI is not superhuman
What metaphor should drive the field of AI research?
Charting AI’s Role in Scientific Discovery — Renaissance Philanthropy – A brighter future for all through science, technology, and innovation
Renaissance Philanthropy, with support from Google.org , is conducting a landscape study of AI integration in scientific research — and we want your perspective.
In spite of hype, many companies are moving cautiously when it comes to generative AI | TechCrunch
Companies are extremely interested in generative AI as vendors push potential benefits, but turning that desire from a proof of concept into a working product is proving much more challenging.
Ars Technica's policy on generative AI
How Ars Technica uses, and doesn't use, generative AI.
AI for Research | Scite
Scite searches 280M+ scholarly articles to give you citation-backed answers and show you how every claim is supported or disputed.
Designing AI for Disruptive Science
Why scaling AI won’t automatically lead to paradigm shifts.
‘AI fatigue’ is settling in as companies’ proofs of concept increasingly fail. Here’s how to prevent it | Fortune
Along with the excitement about the possibilities of generative AI is a great deal of pressure for leaders and employees participating in projects.
Meet the academics refusing to use generative AI
Researchers say they have their reasons for avoiding AI tools — and they’re sick of arguing about it.
Meet the academics refusing to use generative AI
Researchers say they have their reasons for avoiding AI tools — and they’re sick of arguing about it.