Table of Contents
Fetching ...

Data-Driven Distributionally Robust Safety Verification Using Barrier Certificates and Conditional Mean Embeddings

Oliver Schön, Zhengang Zhong, Sadegh Soudjani

TL;DR

The paper addresses safety verification for unknown discrete-time stochastic systems by learning barrier certificates (BCs) from trajectory data using kernel mean embeddings in RKHS and by formulating a distributionally robust, data-driven BC condition. It rewrites the BC constraint as an inner product with the conditional mean embedding (CME) and builds an RKHS ambiguity set around the empirical CME to obtain probabilistic guarantees with finite data, solved via sum-of-squares optimization and a Gaussian-process envelope. Key contributions include a data-driven BC formulation with probabilistic guarantees, a practical SOS-based solver plus GP-based norm control, and a lane-keeping case study demonstrating improved data efficiency versus prior approaches. The work advances scalable, model-free safety verification for realistic systems by removing strong model assumptions and providing verifiable probabilistic safety certificates from limited data.

Abstract

Algorithmic verification of realistic systems to satisfy safety and other temporal requirements has suffered from poor scalability of the employed formal approaches. To design systems with rigorous guarantees, many approaches still rely on exact models of the underlying systems. Since this assumption can rarely be met in practice, models have to be inferred from measurement data or are bypassed completely. Whilst former usually requires the model structure to be known a-priori and immense amounts of data to be available, latter gives rise to a plethora of restrictive mathematical assumptions about the unknown dynamics. In a pursuit of developing scalable formal verification algorithms without shifting the problem to unrealistic assumptions, we employ the concept of barrier certificates, which can guarantee safety of the system, and learn the certificate directly from a compact set of system trajectories. We use conditional mean embeddings to embed data from the system into a reproducing kernel Hilbert space (RKHS) and construct an RKHS ambiguity set that can be inflated to robustify the result w.r.t. a set of plausible transition kernels. We show how to solve the resulting program efficiently using sum-of-squares optimization and a Gaussian process envelope. Our approach lifts the need for restrictive assumptions on the system dynamics and uncertainty, and suggests an improvement in the sample complexity of verifying the safety of a system on a tested case study compared to a state-of-the-art approach.

Data-Driven Distributionally Robust Safety Verification Using Barrier Certificates and Conditional Mean Embeddings

TL;DR

The paper addresses safety verification for unknown discrete-time stochastic systems by learning barrier certificates (BCs) from trajectory data using kernel mean embeddings in RKHS and by formulating a distributionally robust, data-driven BC condition. It rewrites the BC constraint as an inner product with the conditional mean embedding (CME) and builds an RKHS ambiguity set around the empirical CME to obtain probabilistic guarantees with finite data, solved via sum-of-squares optimization and a Gaussian-process envelope. Key contributions include a data-driven BC formulation with probabilistic guarantees, a practical SOS-based solver plus GP-based norm control, and a lane-keeping case study demonstrating improved data efficiency versus prior approaches. The work advances scalable, model-free safety verification for realistic systems by removing strong model assumptions and providing verifiable probabilistic safety certificates from limited data.

Abstract

Algorithmic verification of realistic systems to satisfy safety and other temporal requirements has suffered from poor scalability of the employed formal approaches. To design systems with rigorous guarantees, many approaches still rely on exact models of the underlying systems. Since this assumption can rarely be met in practice, models have to be inferred from measurement data or are bypassed completely. Whilst former usually requires the model structure to be known a-priori and immense amounts of data to be available, latter gives rise to a plethora of restrictive mathematical assumptions about the unknown dynamics. In a pursuit of developing scalable formal verification algorithms without shifting the problem to unrealistic assumptions, we employ the concept of barrier certificates, which can guarantee safety of the system, and learn the certificate directly from a compact set of system trajectories. We use conditional mean embeddings to embed data from the system into a reproducing kernel Hilbert space (RKHS) and construct an RKHS ambiguity set that can be inflated to robustify the result w.r.t. a set of plausible transition kernels. We show how to solve the resulting program efficiently using sum-of-squares optimization and a Gaussian process envelope. Our approach lifts the need for restrictive assumptions on the system dynamics and uncertainty, and suggests an improvement in the sample complexity of verifying the safety of a system on a tested case study compared to a state-of-the-art approach.
Paper Structure (13 sections, 5 theorems, 22 equations, 2 figures)

This paper contains 13 sections, 5 theorems, 22 equations, 2 figures.

Key Result

Proposition 1

Consider an MC $\mathbf{M}=(\mathbb{X},\mathbb{X}_0,\mathbf{t})$ and a safety specification $\psi=(\mathbb{X}_u,T)$. Suppose there exists a BC $B$ w.r.t. $\mathbb{X}_u$ (Definition def:cbc) with constants $(\eta,\gamma,c)$. Then, it follows that

Figures (2)

  • Figure 1: Polynomial barrier certificate computed using SOSTOOLS depicted for $\upphi=0$. The unsafe regions $\mathbb{X}_u$ are indicated in red and the initial region $\mathbb{X}_0$ in black. The two gray planes represent the level sets $\eta$ and $\gamma$.
  • Figure 2: Robust safety probability via BCs generated for radii $\varepsilon$, averaged over ten samples of size $N=10^4$ and a constant $\bar{B}=0.1$.

Theorems & Definitions (10)

  • Definition 1: Markov chain (MC)
  • Definition 2: Barrier certificate (BC)
  • Proposition 1: Finite-horizon safety
  • Remark 1: Infinite-horizon safety
  • Definition 3: Mean embedding (ME)
  • Definition 4: Conditional mean embedding (CME)
  • Proposition 2: Empirical CME
  • Theorem 1
  • Theorem 2
  • Theorem 3: Data-driven finite-horizon safety