I recently tried refine, an AI tool for refining academic articles, developed by Yann Calvó López and Ben Golub.
AI Research Assistant Claude Scholar: Open Source, Free, and Citation-Verified | João Cláudio Nunes Carvalho posted on the topic | LinkedIn
🚨 Professors are going to hate this. Someone just open sourced an AI that writes research papers from idea to publication. Conference-ready. Citation-verified. Free. It's called Claude Scholar. An AI-powered research system that handles every step of the academic workflow. Idea to publication. Fully automated. No advisor at 2am. No staring at blank LaTeX files. No crying during rebuttal season. Here's what's inside this thing: → AI brainstorms research topics, reviews literature, and finds gaps nobody has explored → Runs statistical analysis on your experiments. t-tests, ANOVA, ablation studies. Publication-ready figures. → Writes your paper section by section. Abstract to conclusion. Conference-formatted. → Verifies every citation through multi-layer validation so AI never hallucinates a reference → Strips robotic AI language and adds human voice so reviewers can't tell → Self-reviews your draft with a 6-point quality checklist before you submit → Parses reviewer comments, classifies each one, and drafts your entire rebuttal Here's the wildest part: It supports NeurIPS, ICML, ICLR, ACL, AAAI, Nature, Science, Cell, and PNAS. Downloads the conference template, strips sample content, and gives you a clean LaTeX structure ready to write into. The creator says it covers 90% of the academic research lifecycle. Research assistants charge $30 to $60/hour. Conference paper consultants charge $5,000+. Graduate programs cost $50K/year. This is free. All of it. 100% Open Source.
AI for Research | Scite
Scite searches 280M+ scholarly articles to give you citation-backed answers and show you how every claim is supported or disputed.
AI-powered Literature Review & Synthesis
Recording from my workshop last week on smarter literature review with AI
Language agents achieve superhuman synthesis of scientific knowledge
Language models are known to hallucinate incorrect information, and it is unclear if they are sufficiently accurate and reliable for use in scientific research. We developed a rigorous human-AI comparison methodology to evaluate language model agents on real-world literature search tasks covering information retrieval, summarization, and contradiction detection tasks. We show that PaperQA2, a frontier language model agent optimized for improved factuality, matches or exceeds subject matter expert performance on three realistic literature research tasks without any restrictions on humans (i.e., full access to internet, search tools, and time). PaperQA2 writes cited, Wikipedia-style summaries of scientific topics that are significantly more accurate than existing, human-written Wikipedia articles. We also introduce a hard benchmark for scientific literature research called LitQA2 that guided design of PaperQA2, leading to it exceeding human performance. Finally, we apply PaperQA2 to identify contradictions within the scientific literature, an important scientific task that is challenging for humans. PaperQA2 identifies 2.34 +/- 1.99 contradictions per paper in a random subset of biology papers, of which 70% are validated by human experts. These results demonstrate that language model agents are now capable of exceeding domain experts across meaningful tasks on scientific literature.
Building Scholar-Ready AI: A Conversation with Todd Toler - The Scholarly Kitchen
A conversation on AI retrieval, the provenance problem, and the shared infrastructure scholarly publishing needs.
PaperOrchestra: A Multi-Agent Framework for Automated AI Research Paper Writing
Synthesizing unstructured research materials into manuscripts is an essential yet under-explored challenge in AI-driven scientific discovery. Existing autonomous writers are rigidly coupled to specific experimental pipelines, and produce superficial literature reviews. We introduce PaperOrchestra, a multi-agent framework for automated AI research paper writing. It flexibly transforms unconstrained pre-writing materials into submission-ready LaTeX manuscripts, including comprehensive literature synthesis and generated visuals, such as plots and conceptual diagrams. To evaluate performance, we present PaperWritingBench, the first standardized benchmark of reverse-engineered raw materials from 200 top-tier AI conference papers, alongside a comprehensive suite of automated evaluators. In side-by-side human evaluations, PaperOrchestra significantly outperforms autonomous baselines, achieving an absolute win rate margin of 50%-68% in literature review quality, and 14%-38% in overall manuscript quality.
Halupedia: An AI-Generated Wikipedia-Style Encyclopedia of Fabricated Knowledge and Absurd AI Fabulation - BizTech Weekly
Analysis of Halupedia’s AI-driven on-demand encyclopedia model reveals real-time, non-persistent article generation that simulates authoritative references through fabricated citations and internal “canon” consistency, highlighting challenges in provenance, hallucination, moderation, and the evolving trade-offs between novelty-driven engagement and information integrity in generative AI systems.
AI Focus
NotebookLM is one of my favorite applications in decades. If you haven’t experienced it before, it’s an application that lets you pull in sources from all around - Google Drive, PDFs, public links - collate them into a notebook, and then query or transform that content. Want to turn five research papers into a podcast? Done. Need to extract key takeaways from a collection of articles? Easy. It’s a fundamentally different way of interacting with information that wasn’t possible before large language models.
Semantic Scholar | AI-Powered Research Tool
Semantic Scholar uses groundbreaking AI and engineering to understand the semantics of scientific literature to help Scholars discover relevant research.
Article Galaxy MCP: Your AI Now Talks To Your Literature Library
Article Galaxy MCP connects AI tools directly to research libraries, eliminating workflow gaps by allowing researchers to search, access, and acquire articles without leaving their AI environment.
How To Argue With An AI Booster
Editor's Note: For those of you reading via email, I recommend opening this in a browser so you can use the Table of Contents. This is my longest newsletter - a 16,000-word-long opus - and if you like it, please subscribe to my premium newsletter. Thanks for reading! In
Writing documentation for AI: best practices | kapa.ai docs
Retrieval-Augmented Generation (RAG) systems like Kapa rely on your
Guest Post — Scholarly AI Search Shortcomings and the Need for Better Metadata - The Scholarly Kitchen
AI scholarly search tools often miss important literature due to incomplete metadata. Better full-text-derived metadata could significantly improve discovery.
AI agents are checking the scientific literature — and spotting decades-old errors
The technology is proving adept at finding faults in decades-old papers and reference databases.
The Economic Benefit of Refactoring
Notes from my Thoughtworks colleagues on AI-assisted software delivery
