Table of Contents
Fetching ...

Certifying Lyapunov Stability of Black-Box Nonlinear Systems via Counterexample Guided Synthesis (Extended Version)

Chiao Hsieh, Masaki Waga, Kohei Suenaga

TL;DR

This work tackles the problem of certifying Lyapunov stability for black-box nonlinear systems without access to explicit dynamics. It introduces a counterexample-guided inductive synthesis (CEGIS) framework that directly bounds the Lie derivative using Lipschitz constants, together with a regional verification strategy and lazy sampling to efficiently certify stability region-by-region. The method is backed by termination guarantees via Analytic Center Cutting-Plane Method (ACCPM) when formulated as a convex feasibility problem, and a practical prototype demonstrates orders-of-magnitude sample efficiency over prior data-driven approaches. The approach enables reliable stability certification for learning-enabled controllers in safety-critical contexts and suggests scalable extensions, including richer Lyapunov templates and applicability to switched/hybrid dynamics.

Abstract

Finding Lyapunov functions to certify the stability of control systems has been an important topic for verifying safety-critical systems. Most existing methods on finding Lyapunov functions require access to the dynamics of the system. Accurately describing the complete dynamics of a control system however remains highly challenging in practice. Latest trend of using learning-enabled control systems further reduces the transparency. Hence, a method for black-box systems would have much wider applications. Our work stems from the recent idea of sampling and exploiting Lipschitz continuity to approximate the unknown dynamics. Given Lipschitz constants, one can derive a non-statistical upper bounds on approximation errors; hence a strong certification on this approximation can certify the unknown dynamics. We significantly improve this idea by directly approximating the Lie derivative of Lyapunov functions instead of the dynamics. We propose a framework based on the learner-verifier architecture from Counterexample-Guided Inductive Synthesis (CEGIS). Our insight of combining regional verification conditions and counterexample-guided sampling enables a guided search for samples to prove stability region-by-region. Our CEGIS algorithm further ensures termination. Our numerical experiments suggest that it is possible to prove the stability of 2D and 3D systems with a few thousands of samples. Our visualization also reveals the regions where the stability is difficult to prove. In comparison with the existing black-box approach, our approach at the best case requires less than 0.01% of samples.

Certifying Lyapunov Stability of Black-Box Nonlinear Systems via Counterexample Guided Synthesis (Extended Version)

TL;DR

This work tackles the problem of certifying Lyapunov stability for black-box nonlinear systems without access to explicit dynamics. It introduces a counterexample-guided inductive synthesis (CEGIS) framework that directly bounds the Lie derivative using Lipschitz constants, together with a regional verification strategy and lazy sampling to efficiently certify stability region-by-region. The method is backed by termination guarantees via Analytic Center Cutting-Plane Method (ACCPM) when formulated as a convex feasibility problem, and a practical prototype demonstrates orders-of-magnitude sample efficiency over prior data-driven approaches. The approach enables reliable stability certification for learning-enabled controllers in safety-critical contexts and suggests scalable extensions, including richer Lyapunov templates and applicability to switched/hybrid dynamics.

Abstract

Finding Lyapunov functions to certify the stability of control systems has been an important topic for verifying safety-critical systems. Most existing methods on finding Lyapunov functions require access to the dynamics of the system. Accurately describing the complete dynamics of a control system however remains highly challenging in practice. Latest trend of using learning-enabled control systems further reduces the transparency. Hence, a method for black-box systems would have much wider applications. Our work stems from the recent idea of sampling and exploiting Lipschitz continuity to approximate the unknown dynamics. Given Lipschitz constants, one can derive a non-statistical upper bounds on approximation errors; hence a strong certification on this approximation can certify the unknown dynamics. We significantly improve this idea by directly approximating the Lie derivative of Lyapunov functions instead of the dynamics. We propose a framework based on the learner-verifier architecture from Counterexample-Guided Inductive Synthesis (CEGIS). Our insight of combining regional verification conditions and counterexample-guided sampling enables a guided search for samples to prove stability region-by-region. Our CEGIS algorithm further ensures termination. Our numerical experiments suggest that it is possible to prove the stability of 2D and 3D systems with a few thousands of samples. Our visualization also reveals the regions where the stability is difficult to prove. In comparison with the existing black-box approach, our approach at the best case requires less than 0.01% of samples.

Paper Structure

This paper contains 43 sections, 10 theorems, 35 equations, 3 figures, 8 tables, 1 algorithm.

Key Result

theorem 1

The analytic center cutting-plane method (ACCPM) solves the convex feasibility problem with $k$ queries to the separating oracle as soon as $k$ satisfies $\frac{\gamma^2}{d} \geq \frac{\frac{1}{2} +2d\ln(1+\frac{k+1}{8d^2})}{2d+k+1}$ where $d$ and $\gamma$ are the same as in def:convex-feasibility.

Figures (3)

  • Figure 1: Architecture of CEGIS of Lyapunov functions.
  • Figure 2: Architecture for black-box CEGIS of Lyapunov functions. The detailed decision flow is in \ref{['alg:ceglya']}.
  • Figure 3: Comparison on Van der Pol. Phase portrait with BOAs (Left) and final triangulation covering $\mathcal{X}$ (Right). The disk between the two red circles is $\mathcal{X}$. The blue ellipse is our BOA, and the dashed green contour is the BOA by zhou_neural_2022.

Theorems & Definitions (34)

  • definition 1: Lipschitz continuity
  • definition 2: Regional Lipschitz Bound
  • definition 3: Lyapunov Function for Asymptotic Stability
  • definition 4: Observation Compatibility
  • definition 5: Separating Oracle
  • definition 6: Convex Feasibility
  • definition 7: Analytic Center of a Polytope
  • theorem 1: From goffin_complexity_1996
  • definition 8: Subgradient and Subdifferential
  • proposition 1: Existence of Subgradients bertsekas_convex_2009
  • ...and 24 more