Table of Contents
Fetching ...

Active search for Bifurcations

Yorgos M. Psarellis, Themistoklis P. Sapsis, Ioannis G. Kevrekidis

TL;DR

This work tackles locating bifurcations in dynamical systems from scarce, possibly noisy data by formulating bifurcation detection as an active-learning problem solved with Bayesian Optimization and Gaussian Process surrogates. It derives analytical expressions for the uncertainty propagation from GP-predicted vector fields to steady-state derivatives, Jacobians, and eigenvalues, enabling uncertainty-aware acquisition functions that guide efficient sampling. The framework handles black-box timesteppers and extends to reduced-order PDE/ABM models, demonstrating robust performance across 1D folds, 2D Hopf bifurcations, 2D folds, 4D neuronal folds, and POD-reduced PDEs. The approach yields substantial computational savings over Monte Carlo methods while providing principled uncertainty quantification, with broad applicability to resource-constrained experimental and computational settings.

Abstract

Bifurcations mark qualitative changes of long-term behavior in dynamical systems and can often signal sudden ("hard") transitions or catastrophic events (divergences). Accurately locating them is critical not just for deeper understanding of observed dynamic behavior, but also for designing efficient interventions. When the dynamical system at hand is complex, possibly noisy, and expensive to sample, standard (e.g. continuation based) numerical methods may become impractical. We propose an active learning framework, where Bayesian Optimization is leveraged to discover saddle-node or Hopf bifurcations, from a judiciously chosen small number of vector field observations. Such an approach becomes especially attractive in systems whose state x parameter space exploration is resource-limited. It also naturally provides a framework for uncertainty quantification (aleatoric and epistemic), useful in systems with inherent stochasticity.

Active search for Bifurcations

TL;DR

This work tackles locating bifurcations in dynamical systems from scarce, possibly noisy data by formulating bifurcation detection as an active-learning problem solved with Bayesian Optimization and Gaussian Process surrogates. It derives analytical expressions for the uncertainty propagation from GP-predicted vector fields to steady-state derivatives, Jacobians, and eigenvalues, enabling uncertainty-aware acquisition functions that guide efficient sampling. The framework handles black-box timesteppers and extends to reduced-order PDE/ABM models, demonstrating robust performance across 1D folds, 2D Hopf bifurcations, 2D folds, 4D neuronal folds, and POD-reduced PDEs. The approach yields substantial computational savings over Monte Carlo methods while providing principled uncertainty quantification, with broad applicability to resource-constrained experimental and computational settings.

Abstract

Bifurcations mark qualitative changes of long-term behavior in dynamical systems and can often signal sudden ("hard") transitions or catastrophic events (divergences). Accurately locating them is critical not just for deeper understanding of observed dynamic behavior, but also for designing efficient interventions. When the dynamical system at hand is complex, possibly noisy, and expensive to sample, standard (e.g. continuation based) numerical methods may become impractical. We propose an active learning framework, where Bayesian Optimization is leveraged to discover saddle-node or Hopf bifurcations, from a judiciously chosen small number of vector field observations. Such an approach becomes especially attractive in systems whose state x parameter space exploration is resource-limited. It also naturally provides a framework for uncertainty quantification (aleatoric and epistemic), useful in systems with inherent stochasticity.
Paper Structure (32 sections, 31 equations, 7 figures, 4 algorithms)

This paper contains 32 sections, 31 equations, 7 figures, 4 algorithms.

Figures (7)

  • Figure 1: A schematic summarizing the methodology presented in this manuscript. Here, $x,p$ represent the state variable and parameter respectively, $f(x;p)$ the parameter-dependent vectorfield (see Sec. \ref{['sec:problem']}) and $\alpha(x)$ an acquisition function defined on the state space which can be used to guide Bayesian Optimization (see Sec. \ref{['subsec:analytical']} for various examples). Solid lines/surfaces represent mean quantities while semi-transparent ones are representative of uncertainty.
  • Figure 2: BO performance for the vector field in Eq. \ref{['eq:loggrowth']}: On the left, the predicted bifurcation diagram (and its uncertainty) at various BO iterations is visualized overlayed on the analytical bifurcation diagram (and the exact bifurcation location), which was computed with AUTO doedel1998auto. On the top right, a single BO trajectory is plotted on top of the bifurcation diagram, converging to the bifurcation location. On the bottom right, the performance of BO with analytical statistics is compared with BO with Monte Carlo (MC) statistics of various sample sizes for 50 BO experiments.
  • Figure 3: Bayesian Optimization convergence for the discovery of a Hopf bifurcation using the statistics of Jacobian traces. The performance of BO with analytical statistics is compared with BO with Monte Carlo statistics of various sample sizes.
  • Figure 4: BO convergence for the discovery of a Hopf bifurcation using the statistics of eigenvalue real parts. The performance of BO with analytical statistics is compared with BO with Monte Carlo statistics of various sample sizes.
  • Figure 5: BO for the discovery of a fold bifurcation using the statistics of the eigenvalues' real part.
  • ...and 2 more figures