Are AI Capabilities Increasing Exponentially? A Competing Hypothesis
Haosen Ge, Hamsa Bastani, Osbert Bastani
TL;DR
This note challenges the claim that AI capabilities grow exponentially by re-analyzing METR's 50% model horizon data and proposing a multiplicative model that separates base capabilities from reasoning. By fitting sigmoid-based link functions to a base and a reasoning component, the authors show an inflection point occurring in the past for base capabilities and project a near-term inflection for reasoning, implying potential plateauing rather than unbounded exponential growth. The approach uses Bayesian/Stan estimation and compares against METR's exponential fit, highlighting how model structure and decomposition can dramatically alter forecasts. The work argues for more domain-grounded forecasting and robust evaluation to avoid fragile exponential projections that may not generalize as technology evolves.
Abstract
Rapidly increasing AI capabilities have substantial real-world consequences, ranging from AI safety concerns to labor market consequences. The Model Evaluation & Threat Research (METR) report argues that AI capabilities have exhibited exponential growth since 2019. In this note, we argue that the data does not support exponential growth, even in shorter-term horizons. Whereas the METR study claims that fitting sigmoid/logistic curves results in inflection points far in the future, we fit a sigmoid curve to their current data and find that the inflection point has already passed. In addition, we propose a more complex model that decomposes AI capabilities into base and reasoning capabilities, exhibiting individual rates of improvement. We prove that this model supports our hypothesis that AI capabilities will exhibit an inflection point in the near future. Our goal is not to establish a rigorous forecast of our own, but to highlight the fragility of existing forecasts of exponential growth.
