Table of Contents
Fetching ...

Composite Lyapunov Criteria for Stability and Convergence with Applications to Optimization Dynamics

Hassan Saoud

TL;DR

This work develops a composite Lyapunov framework that derives strict decay from a pair of differential inequalities involving two observables $N_1$ and $N_2$ and two Lyapunov candidates $V_1,V_2$. By constructing a composite function $W=V_1+\delta V_2$ and a mild slope bound on the cross-term $h$, it proves a global decay \(\dot W\le -\gamma (N_1+N_2)\) and establishes integral bounds, vanishing observables, and convergence to the critical set $E=\{x:N_1(x)=N_2(x)=0\}$, with local variants for bounded trajectories. The framework unifies Lyapunov and Matrosov reasoning, yields quantitative rates (including $L^2$-integrability and $O(t^{-1/2})$ decay) under local error bounds, and provides exponential convergence under quadratic growth. Applications to inertial gradient-like systems and Primal–Dual gradient flows illustrate pointwise asymptotic stability of $E$ and semistability of equilibria, yielding convergence to minimizers or KKT points without relying on compactness or invariance principles. Overall, the results offer a constructive, broadly applicable approach for stability and convergence in optimization dynamics and related nonlinear systems.

Abstract

We propose a composite Lyapunov framework for nonlinear autonomous systems that ensures strict decay through a pair of differential inequalities. The approach yields integral estimates, quantitative convergence rates, vanishing of dissipation measures, convergence to a critical set, and semistability under mild conditions, without relying on invariance principles or compactness assumptions. The framework unifies convergence to points and sets and is illustrated through applications to inertial gradient systems and Primal--Dual gradient flows.

Composite Lyapunov Criteria for Stability and Convergence with Applications to Optimization Dynamics

TL;DR

This work develops a composite Lyapunov framework that derives strict decay from a pair of differential inequalities involving two observables and and two Lyapunov candidates . By constructing a composite function and a mild slope bound on the cross-term , it proves a global decay \(\dot W\le -\gamma (N_1+N_2)\) and establishes integral bounds, vanishing observables, and convergence to the critical set , with local variants for bounded trajectories. The framework unifies Lyapunov and Matrosov reasoning, yields quantitative rates (including -integrability and decay) under local error bounds, and provides exponential convergence under quadratic growth. Applications to inertial gradient-like systems and Primal–Dual gradient flows illustrate pointwise asymptotic stability of and semistability of equilibria, yielding convergence to minimizers or KKT points without relying on compactness or invariance principles. Overall, the results offer a constructive, broadly applicable approach for stability and convergence in optimization dynamics and related nonlinear systems.

Abstract

We propose a composite Lyapunov framework for nonlinear autonomous systems that ensures strict decay through a pair of differential inequalities. The approach yields integral estimates, quantitative convergence rates, vanishing of dissipation measures, convergence to a critical set, and semistability under mild conditions, without relying on invariance principles or compactness assumptions. The framework unifies convergence to points and sets and is illustrated through applications to inertial gradient systems and Primal--Dual gradient flows.

Paper Structure

This paper contains 12 sections, 9 theorems, 98 equations.

Key Result

Theorem 2.1

Suppose there exist continuously differentiable functions $V_1,V_2 : \mathbb{R}^n \to \mathbb{R}$, continuous nonnegative functions $N_1,N_2 : \mathbb{R}^n \to [0,+\infty)$, and a continuous function $h : [0,+\infty) \to [0,+\infty)$ with $h(0)=0$ such that, along every solution, Assume in addition that Then, for any $\delta \in (0,1/L)$ and $W(x):=V_1(x)+\delta V_2(x)$, there exists a constant

Theorems & Definitions (18)

  • Theorem 2.1: Strict Decay of a Composite Lyapunov Function
  • Remark 2.2: Optimal choice of constants
  • Theorem 2.3: Local Strict Decay with Optimal Constants
  • Corollary 2.4: Bounded-Trajectory Version with $L_R$
  • Remark 2.5: Useful Specializations
  • Proposition 2.6: Integral estimates and convergence of observables
  • Remark 2.7
  • Theorem 2.8: Convergence to $E$
  • Remark 2.9: Separation property
  • Proposition 2.10: Quantitative convergence from a local error bound
  • ...and 8 more