Table of Contents
Fetching ...

Convergence in total variation for the kinetic Langevin algorithm

Joseph Lehec

TL;DR

This work analyzes sampling from a log-density $\mu(dx)=e^{-V(x)}dx$ on $\mathbb{R}^n$ using the kinetic (underdamped) Langevin algorithm and provides non-asymptotic total-variation guarantees in high dimension under Poincaré and smoothness assumptions on $V$. It deploys a hypocoercivity framework, leveraging a space-time Poincaré inequality and a divergence equation to obtain explicit decay bounds for the chi-square divergence along the kinetic diffusion, despite degeneracy. The discretization error is controlled via a Girsanov-based relative-entropy argument, leading to concrete step-size and iteration-count prescriptions that achieve $TV(x_k,\mu)\le\varepsilon$, with dimension dependence improved from $O(n)$ to $O(\sqrt{n})$ relative to the overdamped case; log-concavity yields further improvements. The results highlight the practical and theoretical advantages of the kinetic approach, offering polynomial warm-start dependence and potential extensions to related sampling schemes such as Hamiltonian Monte Carlo.

Abstract

We prove non asymptotic total variation estimates for the kinetic Langevin algorithm in high dimension when the target measure satisfies a Poincaré inequality and has gradient Lipschitz potential. The main point is that the estimate improves significantly upon the corresponding bound for the non kinetic version of the algorithm, due to Dalalyan. In particular the dimension dependence drops from $O(n)$ to $O(\sqrt n)$.

Convergence in total variation for the kinetic Langevin algorithm

TL;DR

This work analyzes sampling from a log-density on using the kinetic (underdamped) Langevin algorithm and provides non-asymptotic total-variation guarantees in high dimension under Poincaré and smoothness assumptions on . It deploys a hypocoercivity framework, leveraging a space-time Poincaré inequality and a divergence equation to obtain explicit decay bounds for the chi-square divergence along the kinetic diffusion, despite degeneracy. The discretization error is controlled via a Girsanov-based relative-entropy argument, leading to concrete step-size and iteration-count prescriptions that achieve , with dimension dependence improved from to relative to the overdamped case; log-concavity yields further improvements. The results highlight the practical and theoretical advantages of the kinetic approach, offering polynomial warm-start dependence and potential extensions to related sampling schemes such as Hamiltonian Monte Carlo.

Abstract

We prove non asymptotic total variation estimates for the kinetic Langevin algorithm in high dimension when the target measure satisfies a Poincaré inequality and has gradient Lipschitz potential. The main point is that the estimate improves significantly upon the corresponding bound for the non kinetic version of the algorithm, due to Dalalyan. In particular the dimension dependence drops from to .
Paper Structure (15 sections, 11 theorems, 168 equations)

This paper contains 15 sections, 11 theorems, 168 equations.

Key Result

Theorem 1

Suppose that $\mu$ satisfies Poincaré with contant $C_P$ and has $\mathcal{C}^2$-smooth and gradient Lipschitz potentiel, with constant $L$. Assume that the kinetic Langevin algorithm is initiated at $(x_0,y_0)$ with $x_0$ independent of $y_0$, and $y_0$ distributed according to the standard Gaussia where $c,C$ are universal constants. Then we have If in addition $\mu$ is log-concave then we have

Theorems & Definitions (20)

  • Theorem 1
  • Theorem 2
  • Theorem 3
  • Lemma 4
  • Lemma 5: Bochner formula
  • Corollary 6
  • proof
  • Proposition 7
  • Remark
  • Lemma 8
  • ...and 10 more