Science Utopia? Closed-Loop LLM Simulation of Academic Research Ecosystems
In the authors' words
Scientific progress emerges from a longitudinal ecosystem in which researchers, institutions, funding agencies, collaboration networks, and the scientific literature co-evolve. As AI becomes increasingly involved throughout the scientific research cycle, understanding these interconnected and evolving processes becomes increasingly important. We introduce SciUtopia, a persistent, closed-loop LLM-agent simulation framework for studying academic research ecosystems. SciUtopia models interconnected scientific processes such as research-direction choice, collaboration, submission, peer review, resubmission, citation, funding, and researcher attrition, while maintaining evolving states across simulated years. Its configurable institutional mechanisms and information channels provide a controlled testbed for matched counterfactual experiments and targeted interventions. Across 61 simulation worlds, SciUtopia simulates over 40,000 researchers from 8,000 institutions, producing around 400,000 publication decisions and 1.2 million LLM-generated peer reviews. Using these longitudinal simulations, we find that rejection-driven resubmission substantially amplifies reviewer burden beyond population growth alone, cautious exploration balances citation impact with career success and long-term topic diversity, and resource inequality can emerge even without detectable cumulative advantage from narrowly winning early funding. Code is available at https://github.com/Ahren09/ScienceUtopia.
In plain words AI summary
The authors built SciUtopia, a computer simulation that uses AI agents to mimic how academic research works over time. The simulation includes researchers, institutions, funding, collaborations, peer review, and how scientists choose what to study. They ran 61 simulated worlds with over 40,000 researchers from 8,000 institutions, producing about 400,000 publication decisions and 1.2 million AI-generated reviews. They found that resubmitting rejected papers greatly increases reviewer workload beyond what population growth alone would cause. Careful exploration of new topics balances citation impact with career success, and unfair resource distribution can arise even without clear early advantages.
Written by Kimi K2.5 using only the abstract above. Jev checked that every sentence is supported by the abstract sentences it cites, and removed any that were not. Point at a sentence to highlight its source.
Appeared: Friday, October 2. arXiv. Preprint, not yet peer-reviewed.
Authors' comment: https://ahren09.github.io/ScienceUtopia/