Table of Contents
Fetching ...

Geometric characterizations of Lipschitz stability for convex optimization problems

Tran T. A. Nghia

TL;DR

This work develops geometric, computable characterizations of tilt stability and Lipschitz stability for convex optimization problems of the form $\min_x f(x)+g(x)$, where $f$ is smooth and $g$ is convex (possibly nonpolyhedral). By imposing a quadratic growth condition for $g$ on a targeted set $\mathcal{M}$ and establishing relative approximations of $\partial g$ by $\mathcal{M}$, the authors derive a clean condition $\ker \nabla^2 f(\bar{x})\cap 𝔗_{\mathcal{M}}=\{0\}$ that characterizes tilt stability via a second-subderivative framework, avoiding the need to compute generalized Hessians. They then show that tilt stability implies Lipschitz stability of the solution map $S(b,\mu)$, with a stronger message for nonpolyhedral regularizers such as the $\ell_1/\ell_2$ group Lasso and the nuclear norm: if the solution map is single-valued, Lipschitz stability follows automatically. The paper provides explicit geometric conditions for group Lasso and nuclear-norm minimization, including a strong sufficient condition and, in the nuclear-norm case, a nondegeneracy-based equivalence to uniqueness. Together, these results offer a practical, second-order-analytic route to certify stability and sensitivity in important convex optimization problems.

Abstract

In this paper, we mainly study tilt stability and Lipschitz stability of convex optimization problems. Our characterizations are geometric and fully computable in many important cases. As a result, we apply our theory to the group Lasso problem and the nuclear norm minimization problem and reveal that the Lipschitz stability of the solution mapping in these problems is automatic whenever the solution mapping is single-valued.

Geometric characterizations of Lipschitz stability for convex optimization problems

TL;DR

This work develops geometric, computable characterizations of tilt stability and Lipschitz stability for convex optimization problems of the form , where is smooth and is convex (possibly nonpolyhedral). By imposing a quadratic growth condition for on a targeted set and establishing relative approximations of by , the authors derive a clean condition that characterizes tilt stability via a second-subderivative framework, avoiding the need to compute generalized Hessians. They then show that tilt stability implies Lipschitz stability of the solution map , with a stronger message for nonpolyhedral regularizers such as the group Lasso and the nuclear norm: if the solution map is single-valued, Lipschitz stability follows automatically. The paper provides explicit geometric conditions for group Lasso and nuclear-norm minimization, including a strong sufficient condition and, in the nuclear-norm case, a nondegeneracy-based equivalence to uniqueness. Together, these results offer a practical, second-order-analytic route to certify stability and sensitivity in important convex optimization problems.

Abstract

In this paper, we mainly study tilt stability and Lipschitz stability of convex optimization problems. Our characterizations are geometric and fully computable in many important cases. As a result, we apply our theory to the group Lasso problem and the nuclear norm minimization problem and reveal that the Lipschitz stability of the solution mapping in these problems is automatic whenever the solution mapping is single-valued.
Paper Structure (5 sections, 15 theorems, 163 equations)

This paper contains 5 sections, 15 theorems, 163 equations.

Key Result

Theorem 2.3

Suppose that $0\in \partial \varphi(\bar{x})$. The following are equivalent:

Theorems & Definitions (41)

  • Definition 2.1: Second subderivative
  • Definition 2.2: Tilt stability
  • Theorem 2.3: Characterization of tilt stability via subgradient
  • Lemma 2.4
  • proof
  • Corollary 2.5: Characterization of tilt stability via second subderivative
  • proof
  • Definition 3.1: Quadratic growth condition for a set
  • Example 3.2: Convex piecewise linear-quadratic functions, RW98
  • Example 3.3: $\ell_1/\ell_2$ norm
  • ...and 31 more