Table of Contents
Fetching ...

Comparison theorems for the minimum eigenvalue of a random positive-semidefinite matrix

Joel A. Tropp

TL;DR

The paper develops a Gaussian-comparison principle for the minimum eigenvalue of sums of independent random PSD matrices, showing that $\lambda_{\min}$ can be controlled by a Gaussian model with matched first and second moments and a computable weak variance $\sigma_*^2$. Central to the approach are trace mgf comparisons via Stahl's theorem, Bernstein/Stein-type tools, and the weak-variance framework, which yield dimension-free tails in many models. The authors provide concise, conceptual proofs for classical and new results in high-dimensional statistics—such as bounds for sample covariance matrices and sparse covariance structures—and resolve an open question on injectivity for very sparse random maps through recursive Gaussian-comparison arguments. The methodology unifies several PSD-sum settings (random weighting and iid sums) and yields applications to projective designs, randomized subspace injections, and matrix-concentration problems, with notable gains over previous moment-based approaches. Overall, the work offers a powerful, general framework for invertibility-like statistics of random PSD sums with broad implications in high-dimensional statistics and numerical linear algebra.

Abstract

This paper establishes a new comparison principle for the minimum eigenvalue of a sum of independent random positive-semidefinite matrices. The principle states that the minimum eigenvalue of the matrix sum is controlled by the minimum eigenvalue of a Gaussian random matrix that inherits its statistics from the summands. This methodology is powerful because of the vast arsenal of tools for treating Gaussian random matrices. As applications, the paper presents short, conceptual proofs of some old and new results in high-dimensional statistics. It also settles a long-standing open question in computational linear algebra about the injectivity properties of very sparse random matrices.

Comparison theorems for the minimum eigenvalue of a random positive-semidefinite matrix

TL;DR

The paper develops a Gaussian-comparison principle for the minimum eigenvalue of sums of independent random PSD matrices, showing that can be controlled by a Gaussian model with matched first and second moments and a computable weak variance . Central to the approach are trace mgf comparisons via Stahl's theorem, Bernstein/Stein-type tools, and the weak-variance framework, which yield dimension-free tails in many models. The authors provide concise, conceptual proofs for classical and new results in high-dimensional statistics—such as bounds for sample covariance matrices and sparse covariance structures—and resolve an open question on injectivity for very sparse random maps through recursive Gaussian-comparison arguments. The methodology unifies several PSD-sum settings (random weighting and iid sums) and yields applications to projective designs, randomized subspace injections, and matrix-concentration problems, with notable gains over previous moment-based approaches. Overall, the work offers a powerful, general framework for invertibility-like statistics of random PSD sums with broad implications in high-dimensional statistics and numerical linear algebra.

Abstract

This paper establishes a new comparison principle for the minimum eigenvalue of a sum of independent random positive-semidefinite matrices. The principle states that the minimum eigenvalue of the matrix sum is controlled by the minimum eigenvalue of a Gaussian random matrix that inherits its statistics from the summands. This methodology is powerful because of the vast arsenal of tools for treating Gaussian random matrices. As applications, the paper presents short, conceptual proofs of some old and new results in high-dimensional statistics. It also settles a long-standing open question in computational linear algebra about the injectivity properties of very sparse random matrices.

Paper Structure

This paper contains 69 sections, 22 theorems, 253 equations, 2 figures.

Key Result

Theorem 2.1

Fix a system of psd matrices $(\bm{A}_1, \dots, \bm{A}_n)$, real or complex, with common dimension $d$. Consider an independent family $(W_1, \dots, W_n)$ of nonnegative real random variables with two finite moments: $W_i \geq 0$ and $\operatorname{\mathbb{E}}[ W_i^2 ] < +\infty$. Define the random Then there is a stochastic comparison between the minimum eigenvalues of $\bm{Y}$ and $\bm{Z}$. In

Figures (2)

  • Figure 1.1: (Positive sum: Comparison). These plots illustrate the distribution $Y$ of an iid sum of nonnegative real random variables (black line), along with the matching Gaussian distribution $Z$ (dashed blue), described by \ref{['eqn:intro-scalar-mgf']}, and the tail bound (dotted red), described by \ref{['eqn:intro-scalar-tail']}. The left-hand panel shows the densities; the right-hand panel shows the cumulative distributions.
  • Figure 1.2: (Bivariate positive sum: Comparison). This figure illustrates the Gaussian comparison \ref{['eqn:intro-matrix-comp']} for a $2 \times 2$ diagonal random matrix $\bm{W}$ with independent entries. [Top] The bivariate distribution of a pair of independent positive sums. [Bottom] The distribution of the matching Gaussian model. [Left] Probability densities. [Right] Bivariate cumulative distribution functions. Brighter colors correspond to higher probabilities. The Gaussian comparison is valid southwest of the expectation (white lines). More precisely, the comparison concerns the minimum of the two coordinates, whose distribution looks similar to the univariate case (\ref{['fig:comparison-1d']}).

Theorems & Definitions (52)

  • Theorem 2.1: Comparison: Randomly weighted psd matrices
  • Definition 2.2: Random matrix: Second moments, self-adjoint case
  • Theorem 2.3: Comparison: Sum of iid psd matrices
  • Conjecture 2.4: Non-iid sums
  • Example 2.5: Wishart: Matrix concentration
  • Remark 2.6: Intrinsic freeness
  • Proposition 3.1: Moments: Equivariance
  • proof
  • Proposition 3.2: Gaussians: Monotonicity
  • proof
  • ...and 42 more