Virtuous Machines: Towards Artificial General Science
Gabrielle Wehr, Reuben Rideaux, Amaya J. Fox, David R. Lightfoot, Jason Tangen, Jason B. Mattingley, Shane E. Ehrhardt
TL;DR
The paper addresses the bottleneck in scientific progress by building a domain-agnostic, agentic AI Scientist that can autonomously navigate the full scientific workflow from hypothesis generation to manuscript preparation. It implements a hierarchical multi-agent system with cognitive operators and dynamic memory (d-RAG), leveraging a mixture of frontier LLMs to ideate, design, execute online studies, analyze data, and compose reports. In cognitive psychology, the system autonomously conducted three studies with 288 online participants, producing three complete manuscripts in ~17 hours per study, with expert review confirming rigorous methods but noting conceptual nuances and interpretation gaps. The work demonstrates a step toward embodied AI that can actively test hypotheses in real-world settings and raises important questions about scientific understanding, credit, safety, and governance as AI-driven discovery scales across domains.
Abstract
Artificial intelligence systems are transforming scientific discovery by accelerating specific research tasks, from protein structure prediction to materials design, yet remain confined to narrow domains requiring substantial human oversight. The exponential growth of scientific literature and increasing domain specialisation constrain researchers' capacity to synthesise knowledge across disciplines and develop unifying theories, motivating exploration of more general-purpose AI systems for science. Here we show that a domain-agnostic, agentic AI Scientist system can independently navigate the scientific workflow - from hypothesis generation through data collection to manuscript preparation. The system autonomously designed and executed three psychological studies on visual working memory, mental rotation, and imagery vividness, executed one new online data collection with 288 participants, developed analysis pipelines through 8-hour+ continuous coding sessions, and produced completed manuscripts. The results demonstrate the capability of AI scientific discovery pipelines to conduct non-trivial research with theoretical reasoning and methodological rigour comparable to experienced researchers, though with limitations in conceptual nuance and theoretical interpretation. This is a step toward embodied AI that can test hypotheses through real-world experiments, accelerating discovery by autonomously exploring regions of scientific space that human cognitive and resource constraints might otherwise leave unexplored. It raises important questions about the nature of scientific understanding and the attribution of scientific credit.
