Table of Contents
Fetching ...

Generalizable Physics-Informed Learning for Stochastic Safety-Critical Systems

Zhuoyuan Wang, Albert Chern, Yorie Nakahira

TL;DR

The paper addresses the challenge of estimating long-horizon risk in stochastic safety-critical systems when long-term data are scarce. It derives that four long-term risk probabilities can be characterized by convection-diffusion PDEs on an augmented state, and embeds these PDE constraints into a physics-informed neural network (PIPE) to learn risk probabilities from short-term data. PIPE couples PDE residuals with empirical data, providing bounded-error guarantees and convergence under mild conditions, while enabling rapid online inference, gradient computation, and generalization to unseen states and parameters. The framework demonstrates superior sample efficiency, robustness to parameter changes, and utility as a surrogate for varying dynamics, with broad applicability to stochastic safe control and risk-aware decision-making.

Abstract

Accurate estimation of long-term risk is essential for the design and analysis of stochastic dynamical systems. Existing risk quantification methods typically rely on extensive datasets involving risk events observed over extended time horizons, which can be prohibitively expensive to acquire. Motivated by this gap, we propose an efficient method for learning long-term risk probabilities using short-term samples with limited occurrence of risk events. Specifically, we establish that four distinct classes of long-term risk probabilities are characterized by specific partial differential equations (PDEs). Using this characterization, we introduce a physics-informed learning framework that combines empirical data with physics information to infer risk probabilities. We then analyze the theoretical properties of this framework in terms of generalization and convergence. Through numerical experiments, we demonstrate that our framework not only generalizes effectively beyond the sampled states and time horizons but also offers additional benefits such as improved sample efficiency, rapid online inference capabilities under changing system dynamics, and stable computation of probability gradients. These results highlight how embedding PDE constraints, which contain explicit gradient terms and inform how risk probabilities depend on state, time horizon, and system parameters, improves interpolation and generalization between/beyond the available data.

Generalizable Physics-Informed Learning for Stochastic Safety-Critical Systems

TL;DR

The paper addresses the challenge of estimating long-horizon risk in stochastic safety-critical systems when long-term data are scarce. It derives that four long-term risk probabilities can be characterized by convection-diffusion PDEs on an augmented state, and embeds these PDE constraints into a physics-informed neural network (PIPE) to learn risk probabilities from short-term data. PIPE couples PDE residuals with empirical data, providing bounded-error guarantees and convergence under mild conditions, while enabling rapid online inference, gradient computation, and generalization to unseen states and parameters. The framework demonstrates superior sample efficiency, robustness to parameter changes, and utility as a surrogate for varying dynamics, with broad applicability to stochastic safe control and risk-aware decision-making.

Abstract

Accurate estimation of long-term risk is essential for the design and analysis of stochastic dynamical systems. Existing risk quantification methods typically rely on extensive datasets involving risk events observed over extended time horizons, which can be prohibitively expensive to acquire. Motivated by this gap, we propose an efficient method for learning long-term risk probabilities using short-term samples with limited occurrence of risk events. Specifically, we establish that four distinct classes of long-term risk probabilities are characterized by specific partial differential equations (PDEs). Using this characterization, we introduce a physics-informed learning framework that combines empirical data with physics information to infer risk probabilities. We then analyze the theoretical properties of this framework in terms of generalization and convergence. Through numerical experiments, we demonstrate that our framework not only generalizes effectively beyond the sampled states and time horizons but also offers additional benefits such as improved sample efficiency, rapid online inference capabilities under changing system dynamics, and stable computation of probability gradients. These results highlight how embedding PDE constraints, which contain explicit gradient terms and inform how risk probabilities depend on state, time horizon, and system parameters, improves interpolation and generalization between/beyond the available data.
Paper Structure (35 sections, 16 theorems, 122 equations, 15 figures, 6 tables)

This paper contains 35 sections, 16 theorems, 122 equations, 15 figures, 6 tables.

Key Result

Theorem 1

Consider system eq:x_trajectory with the initial state $X_0 = x$. Let $z = [\phi(x), x^\intercal]^\intercal\in\mathbb R^{n+1}$. Then, the complementary cumulative distribution function (CCDF) of $\Phi_x(T)$, is the solution to the initial-boundary-value problem of the convection-diffusion equation on the super-level set $\{z\in\mathbb R^n: z[1]\geq \ell\}$ where $D:=\zeta\zeta^\intercal$. Here, t

Figures (15)

  • Figure 1: The overview diagram of the proposed PIPE framework. The system takes form \ref{['eq:x_trajectory']} with safe set defined as \ref{['eq:safe_region']}. For the physics model, we derive that the mapping between state-time pair and the risk probability satisfies a governing convection diffusion equation (Theorem \ref{['thm:InvariantProbability_MainTheorem1']}-\ref{['thm:ConvergenceProbability_MainTheorem4']}). For training data, one can acquire the empirical risk probabilities with any existing rare event simulation method, without the need to cover the entire time-state space. The PIPE framework uses physics-informed neural networks to learn the risk probability by fitting the empirical training data and using the physics model as constraints. PIPE gives more accurate and sample efficient risk probability and gradient predictions than Monte Carlo or its variants, and can generalize to unseen regions in the state space and unknown parameters in the system dynamics thanks to its integration of data and physics models.
  • Figure 2: The training scheme of the physics-informed neural network.
  • Figure 3: Settings and results of the risk probability generalization task. Note that shaded area in (a) in the spatial-temporal space are not covered by training data. MC with fitting (TPS), neural network without PDE constraint and the proposed PIPE framework are compared. The average absolute error of prediction is $9.2 \times 10^{-2}$ for TPS, and $1.5 \times 10^{-2}$ for neural network without PDE constraints, $0.3 \times 10^{-2}$ for PIPE.
  • Figure 4: Percentage error of risk probability estimation for different MC sample numbers for (a) rare events and (b) normal events. PIPE, MC and denoised MC with uniform kernel filtering are compared. Both error and sample number are in log scale.
  • Figure 5: Risk probability prediction of unconstrained neural network and PIPE on unseen system parameters $\lambda_{\text{test}} = 1.5$. The average absolute prediction error across all $\lambda_{\text{test}} = [0.3, 0.7, 1.2, 1.5, 2]$ is $2.23 \times 10^{-2}$ for unconstrained neural network, and $0.60 \times 10^{-2}$ for PIPE.
  • ...and 10 more figures

Theorems & Definitions (38)

  • Definition 1: Safe Set
  • Definition 2: Forward Invariance
  • Definition 3: Forward Convergent Set
  • Remark 1
  • Definition 4: Infinitesimal Generator
  • Theorem 1
  • Remark 2
  • Theorem 2
  • Theorem 3
  • Theorem 4
  • ...and 28 more