Synthetic Controls Test Whether AI Drove arXiv Mathematics Surge

This episode examines a September 2026 paper that asks whether the roughly 33.5% jump in arXiv Mathematics list entries (35,307 to 47,127, January through August) reflects a real generative-AI effect or just a growing platform. It walks through a "ladder" of estimates. Raw growth is 33.5%, growth over Mathematics' own pre-2022 trend is 36.8%, and growth over a synthetic-control counterfactual built from other archives is 11.9%, or about five thousand extra entries in eight months. The hosts explain why math and theoretical physics might respond first: cheap validators such as proof kernels, executable code and limiting cases let researchers check LLM output. They also cover the paper's two proposed mechanisms, a capability threshold and delayed diffusion, and the rival explanations of platform growth and tighter arXiv endorsement rules. They argue over whether the shrinking estimate makes the effect small, and whether a physics-heavy comparison group that is itself AI-boosted understates the gap. The episode is useful for anyone who wants to see how careful causal design, and its limits (one treated unit, no clean treatment date, data available only on request), can turn a headline percentage into a defensible estimate.

Sources:
1. The Generative AI Gold Rush in Theoretical and Computational Research — Xiaoshn Nee, Haobo Zhong, Xiaomin Ni, 2026
http://arxiv.org/abs/2609.04872
2. The Economic Costs of Conflict: A Case Study of the Basque Country — Alberto Abadie, Javier Gardeazabal, 2003
https://scholar.google.com/scholar?q=The+Economic+Costs+of+Conflict%3A+A+Case+Study+of+the+Basque+Country
3. Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California's Tobacco Control Program — Alberto Abadie, Alexis Diamond, Jens Hainmueller, 2010
https://scholar.google.com/scholar?q=Synthetic+Control+Methods+for+Comparative+Case+Studies%3A+Estimating+the+Effect+of+California%27s+Tobacco+Control+Program
4. Using Synthetic Controls: Feasibility, Data Requirements, and Methodological Aspects — Alberto Abadie, 2021
https://scholar.google.com/scholar?q=Using+Synthetic+Controls%3A+Feasibility%2C+Data+Requirements%2C+and+Methodological+Aspects
5. Synthetic Difference-in-Differences — Dmitry Arkhangelsky, Susan Athey, David A. Hirshberg, Guido W. Imbens, Stefan Wager, 2021
https://scholar.google.com/scholar?q=Synthetic+Difference-in-Differences
6. The Augmented Synthetic Control Method — Eli Ben-Michael, Avi Feller, Jesse Rothstein, 2021
https://scholar.google.com/scholar?q=The+Augmented+Synthetic+Control+Method
7. Mapping the Increasing Use of LLMs in Scientific Papers — Weixin Liang, Yaohui Zhang, Zhengxuan Wu, Haley Lepp, Wenlong Ji, Xuandong Zhao, Hancheng Cao, Sheng Liu, Siyu He, Zhi Huang, Diyi Yang, Christopher Potts, Christopher D. Manning, James Zou, 2024
https://scholar.google.com/scholar?q=Mapping+the+Increasing+Use+of+LLMs+in+Scientific+Papers
8. Delving into LLM-assisted writing in biomedical publications through excess vocabulary — Dmitry Kobak, Rita González-Márquez, Emőke-Ágnes Horvát, Jan Lause, 2025
https://scholar.google.com/scholar?q=Delving+into+LLM-assisted+writing+in+biomedical+publications+through+excess+vocabulary
9. Scientific production in the era of large language models — Keigo Kusumegi, Xinyu Yang, Paul Ginsparg, Mathijs de Vaan, Toby Stuart, Yian Yin, 2025
https://scholar.google.com/scholar?q=Scientific+production+in+the+era+of+large+language+models
10. Artificial intelligence tools expand scientists' impact but contract science's focus — Qianyue Hao, Fengli Xu, Yong Li, James Evans, 2026
https://scholar.google.com/scholar?q=Artificial+intelligence+tools+expand+scientists%27+impact+but+contract+science%27s+focus
11. Are Ideas Getting Harder to Find? — Nicholas Bloom, Charles I. Jones, John Van Reenen, Michael Webb, 2020
https://scholar.google.com/scholar?q=Are+Ideas+Getting+Harder+to+Find%3F
12. Mathematical discoveries from program search with large language models (FunSearch) — Bernardino Romera-Paredes, Mohammadamin Barekatain, Alexander Novikov, Matej Balog, M. Pawan Kumar, Emilien Dupont, Francisco J. R. Ruiz, Jordan S. Ellenberg, Pengming Wang, Omar Fawzi, Pushmeet Kohli, Alhussein Fawzi, 2023
https://scholar.google.com/scholar?q=Mathematical+discoveries+from+program+search+with+large+language+models+%28FunSearch%29
13. Solving olympiad geometry without human demonstrations (AlphaGeometry) — Trieu H. Trinh, Yuhuai Wu, Quoc V. Le, He He, Thang Luong, 2024
https://scholar.google.com/scholar?q=Solving+olympiad+geometry+without+human+demonstrations+%28AlphaGeometry%29
14. The Rapid Adoption of Generative AI — Alexander Bick, Adam Blandin, David J. Deming, 2024
https://scholar.google.com/scholar?q=The+Rapid+Adoption+of+Generative+AI
15. The Productivity J-Curve: How Intangibles Complement General Purpose Technologies — Erik Brynjolfsson, Daniel Rock, Chad Syverson, 2021
https://scholar.google.com/scholar?q=The+Productivity+J-Curve%3A+How+Intangibles+Complement+General+Purpose+Technologies
16. An Exact and Robust Conformal Inference Method for Counterfactual and Synthetic Controls — Victor Chernozhukov, Kaspar Wüthrich, Yinchu Zhu, 2021
https://scholar.google.com/scholar?q=An+Exact+and+Robust+Conformal+Inference+Method+for+Counterfactual+and+Synthetic+Controls
17. Synthetic Control Method: Inference, Sensitivity Analysis and Confidence Sets — Sergio Firpo, Vitor Possebom, 2018
https://scholar.google.com/scholar?q=Synthetic+Control+Method%3A+Inference%2C+Sensitivity+Analysis+and+Confidence+Sets
18. Cherry Picking with Synthetic Controls — Bruno Ferman, Cristine Pinto, Vitor Possebom, 2020
https://scholar.google.com/scholar?q=Cherry+Picking+with+Synthetic+Controls
19. Synthetic Controls with Imperfect Pretreatment Fit — Bruno Ferman, Cristine Pinto, 2021
https://scholar.google.com/scholar?q=Synthetic+Controls+with+Imperfect+Pretreatment+Fit
20. Matrix Completion Methods for Causal Panel Data Models — Susan Athey, Mohsen Bayati, Nikolay Doudchenko, Guido Imbens, Khashayar Khosravi, 2021
https://scholar.google.com/scholar?q=Matrix+Completion+Methods+for+Causal+Panel+Data+Models
21. A Penalized Synthetic Control Estimator for Disaggregated Data — Alberto Abadie, Jérémy L'Hour, 2021
https://scholar.google.com/scholar?q=A+Penalized+Synthetic+Control+Estimator+for+Disaggregated+Data
22. Mathematical Exploration and Discovery at Scale (AlphaEvolve applied to open problems) — Bogdan Georgiev, Javier Gómez-Serrano, Terence Tao, Adam Zsolt Wagner, 2025
https://scholar.google.com/scholar?q=Mathematical+Exploration+and+Discovery+at+Scale+%28AlphaEvolve+applied+to+open+problems%29
23. Early Science Acceleration Experiments with GPT-5 — Sébastien Bubeck et al. (OpenAI), 2025
https://scholar.google.com/scholar?q=Early+Science+Acceleration+Experiments+with+GPT-5
24. The Entities Enabling Scientific Fraud at Scale Are Large, Resilient, and Growing Rapidly — Reese A. K. Richardson et al., 2025
https://scholar.google.com/scholar?q=The+Entities+Enabling+Scientific+Fraud+at+Scale+Are+Large%2C+Resilient%2C+and+Growing+Rapidly