







Nihar Shah did a heroic experiment for TMLR: he spent 20-25 hours over two weeks interviewing authors of seemingly low-quality submissions about their own papers. He confirmed what we all suspected: people submitting these papers have *no idea* what is going on in them.
Transactions on Machine Learning Research
TMLR has faced a deluge of submissions, necessitating stricter desk rejection policies due to limited reviewer capacity Co-EiC Nihar Shah reached out to authors of 10 papers slated for desk reject. Could they answer questions about their *own* submission? medium.com/@TmlrOrg/asking-authors-about…
Sep 16, 2026 at 8:36 PM
Gautam Kamath on Twitter / X
Nihar Shah did a heroic experiment for TMLR: he spent 20-25 hours over two weeks interviewing authors of seemingly low-quality submissions about their own papers. He confirmed what we all suspected: people submitting these papers have *no idea* what is going on in them. https://t.co/6CJF152u7I— Gautam Kamath (@thegautamkamath) September 16, 2026
Vipul Gupta on Twitter / X
Feels bad to say, but paper writing/reviewing is definitely cooked.Reviewed 4 papers recently and genuinely felt like I spent more time reviewing them than the authors spent writing them.— Vipul Gupta (@vipul_1011) September 19, 2026
Thomas G. Dietterich on Twitter / X
We are seeing a new trend in submissions to @arxiv (and presumably to conferences and journals): Authors submitting papers whose contents they likely do not understand. 1/— Thomas G. Dietterich (@tdietterich) September 13, 2026
Maksym Andriushchenko on Twitter / X
many people seem to be upset by >50k submissions to ICLR. i think we should celebrate it! more people are doing AI (including AI safety) research - isn't it amazing?as for how to navigate the growing amount of papers, luckily, Larry Wasserman formulated a solution back in 2012! pic.twitter.com/U85FGshTqw— Maksym Andriushchenko (@maksym_andr) September 20, 2026
Okay so, we just found that over 50 papers published at @Neurips 2025 have AI hallucinations by @alexcdot(Alex Cui) | Twitter Thread Reader
Okay so, we just found that over 50 papers published at @Neurips 2025 have AI hallucinations I don't think people realize how bad the slop is right now It's not just that researchers from @GoogleDeepMind, @Meta, @MIT, @Cambridge_Uni are using AI - they allowed LLMs to generate hallucinations in their papers and didn't notice at all. It's insane that these made it through peer review👇

Mikel Artetxe on Twitter / X
3/4 papers I reviewed and 2/3 reviews I got this ARR cycle were AI slop. Fraudsters are already outnumbering honest researchers. Unless drastic measures are urgently adopted, conference publications will have zero value or even become negative signal, and academia will be toast.— Mikel Artetxe (@artetxem) September 19, 2026
NBER on Twitter / X
An LLM workflow that reproduces, improves, and extends economics research has been applied to over 4,000 published replication packages, from Matthew Schwartz, Isaiah Andrews, and Jesse M. Shapiro https://t.co/jrWNP9wOlf pic.twitter.com/ZX6Eem16vo— NBER (@nberpubs) September 28, 2026
📢 New paper: Forecasts of explosive AI progress hinge on AI agents automating AI research. But most evaluations of agents conducting AI research focus on narrow, verifiable tasks. Can AI agents… | Sayash Kapoor
📢 New paper: Forecasts of explosive AI progress hinge on AI agents automating AI research. But most evaluations of agents conducting AI research focus on narrow, verifiable tasks. Can AI agents conduct open-ended research? https://lnkd.in/gfP-q4CD We gave agents research questions from two unpublished papers, six days, and thousands of dollars of API credits and compute. The authors of the original papers reviewed the AI-generated papers. They unambiguously rejected agents' outputs. Agents were fluent at most *engineering* tasks. They conducted serious literature reviews, debugged GPU environments, ran hundreds of experiments, and turned in camera-ready LaTeX without human help. We also found no evidence of reward hacking. If anything, we found the opposite: the agents started with marketable claims and walked them back to negative results as the evidence came in. But neither agent output was close to the bar of a top conference paper. Both papers suffered from similar failures: poor judgment about the bar for an AI paper submitted to a top conference, the lack of creative problem solving and ineffective backtracking, poor awareness of resources, and instruction drift. This research design has many limitations: the small sample size, non-blind reviews, and the reviewers knowing that the work was AI-generated. We also couldn't test Anthropic's strongest model, because Fable 5 is deliberately limited on frontier AI research tasks, so ended up using OpenClaw with Opus 4.8 (extra-high) for our main experiments and Codex with Sol 5.6 (ultra) for a robustness check. But we think the research design is still helpful in assessing AI agents' ability to conduct research, and it is complementary to evaluations on verifiable tasks, as well as blinded reviews of AI outputs. In follow-up studies, we are expanding the set of non-public papers we evaluate. If you are an AI researcher with unpublished papers, we would love to collaborate with you on our next evaluation. Expression of interest: https://lnkd.in/gpeykJea We also release the agent logs and all the code and data, so that others can conduct their own analyses of our results: https://lnkd.in/gJarPAnb Finally, we plan to conduct such evaluations regularly, and are hiring a senior researcher to help lead these efforts. Apply here: https://lnkd.in/erJZdmve I'm grateful for the core team leading this effort: Peter Kirgis, Andrew Schwartz, Stephan Rabanser, and Arvind Narayanan, and to our collaborators who reviewed AI papers, analyzed agents logs, and gave feedback on the paper: David Demitri Africa, Konstantinos V., Viet Nguyen, Dr Toby D. Pilditch, Magda Dubois, Harry Coppock, Cozmin Ududec, Nitya Nadgir, Matilda Orona, Tilman Bayer, Derrick Chan-Sew, Eric (Yue) Ling, Abhishek Shetty, Helen Toner, Gillian K. Hadfield, Seth Lazar, Steve Newman, Shoshannah Tekofsky, Rishi Bommasani
Eric Topol on Twitter / X
This is a FRAUDULENT paper, AI-generated. My name was used as an author and I had nothing to do with it, never saw it until today https://t.co/Ky60zJrMEZThe "Editors" Angelo Rossi Mori, David Mensah, and Zarnie Khadjesari should be reported. pic.twitter.com/2Z5CE8w4bn— Eric Topol (@EricTopol) April 22, 2026
Shreya Shankar on Twitter / X
This problem has gotten significantly worse. As Twitter and other social media have become primary channels for sharing research, academics are now expected to make the same ideas legible and appealing to both the general public (to go "viral") and senior scholars (to get the… https://t.co/zPF3tKzbVa— Shreya Shankar (@sh_reya) July 25, 2026
Cas (Stephen Casper) on Twitter / X
It is hard to overstate how disappointing I think this new paper from Oxford, OpenAI, Anthropic, and Google (et al) is. I can't take it seriously as academic work, just as propaganda. It also has some very bad scholarship and questionable adherence to research ethics. Having… pic.twitter.com/Z5fBx360ya— Cas (Stephen Casper) (@StephenLCasper) May 13, 2026

Noam Brown on Twitter / X
And yes we did try other major problems without success. Sadly no Millennium Prize problems (yet).But also, we didn’t spend a lot on each problem. It’s possible to push test-time compute much further.— Noam Brown (@polynoamial) August 1, 2026
Publication bias in the social sciences: Unlocking the file drawer
The file drawer is full. Should we worry? Experiments that produce null results face a higher barrier to publication than those that yield statistically significant differences. Whether this is a problem depends on how many null but otherwise valid results might be trapped in the file drawer. Franco et al. use a Time-sharing Experiments in the Social Sciences archive of nearly 250 peer-reviewed proposals of social science experiments conducted on nationally representative samples. They find that only 10 out of 48 null results were published, whereas 56 out of 91 studies with strongly significant results made it into a journal. Science , this issue p. 1502 , Fully half of peer-reviewed and implemented social science experiments are not published. , We studied publication bias in the social sciences by analyzing a known population of conducted studies—221 in total—in which there is a full accounting of what is published and unpublished. We leveraged Time-sharing Experiments in the Social Sciences (TESS), a National Science Foundation–sponsored program in which researchers propose survey-based experiments to be run on representative samples of American adults. Because TESS proposals undergo rigorous peer review, the studies in the sample all exceed a substantial quality threshold. Strong results are 40 percentage points more likely to be published than are null results and 60 percentage points more likely to be written up. We provide direct evidence of publication bias and identify the stage of research production at which publication bias occurs: Authors do not write up and submit null findings.

Anthropic Found Out Why AIs Go Insane
How times change! A decade ago, a failed replication of work by the same lab led to 'repligate' and blog posts such as psychol.cam.ac.uk/cece/blog Now, failed replications can be published an no one blinks an eye. That is progress due to all the scholars working hard to improve science!