Table of Contents
Fetching ...

Global Universality of Singular Values in Products of Many Large Random Matrices

Boris Hanin, Tianze Jiang

TL;DR

This work establishes a global universality result for the singular-value distribution of products of independent random matrices in the simultaneous growth regime $n,N\to\infty$. By combining novel small-ball estimates for singular vectors with martingale concentration and a Doob decomposition, the authors prove non-asymptotic bounds that force the empirical distribution of the rescaled squared singular values to converge to the uniform law on $[0,1]$, under minimal moment and density conditions on the entry distribution $\mu$. A key feature is that universality emerges for the Lyapunov-exponent distribution once the matrix size grows with $N$, even though fixed-$n$ universality fails, highlighting a distinct global- versus local-statistics separation. The techniques yield quantitative control via $d_{KS}$ bounds and open pathways to extensions to complex matrices, with implications for understanding Jacobians in randomized systems and neural networks under broad randomness assumptions.

Abstract

We study the singular values (and Lyapunov exponents) for products of $N$ independent $n\times n$ random matrices with i.i.d. entries. Such matrix products have been extensively analyzed using free probability, which applies when $n\to \infty$ at fixed $N$, and the multiplicative ergodic theorem, which holds when $N\to \infty$ while $n$ remains fixed. The regime when $N,n\to \infty$ simultaneously is considerably less well understood, and our work is the first to prove universality for the global distribution of singular values in this setting. Our main result gives non-asymptotic upper bounds on the Kolmogorov-Smirnoff distance between the empirical measure of (normalized) squared singular values and the uniform measure on $[0, 1]$ that go to zero when $n, N\to \infty$ at any relative rate. We assume only that the distribution of matrix entries has zero mean, unit variance, bounded fourth moment, and a bounded density. Our proofs rely on two key ingredients. The first is a novel small-ball estimate on singular vectors of random matrices from which we deduce a non-asymptotic variant of the multiplicative ergodic theorem that holds for growing matrix size $n$. The second is a martingale concentration argument, which shows that while Lyapunov exponents at large $N$ are not universal at fixed matrix size, their empirical distribution becomes universal as soon as the matrix size grows with $N$.

Global Universality of Singular Values in Products of Many Large Random Matrices

TL;DR

This work establishes a global universality result for the singular-value distribution of products of independent random matrices in the simultaneous growth regime . By combining novel small-ball estimates for singular vectors with martingale concentration and a Doob decomposition, the authors prove non-asymptotic bounds that force the empirical distribution of the rescaled squared singular values to converge to the uniform law on , under minimal moment and density conditions on the entry distribution . A key feature is that universality emerges for the Lyapunov-exponent distribution once the matrix size grows with , even though fixed- universality fails, highlighting a distinct global- versus local-statistics separation. The techniques yield quantitative control via bounds and open pathways to extensions to complex matrices, with implications for understanding Jacobians in randomized systems and neural networks under broad randomness assumptions.

Abstract

We study the singular values (and Lyapunov exponents) for products of independent random matrices with i.i.d. entries. Such matrix products have been extensively analyzed using free probability, which applies when at fixed , and the multiplicative ergodic theorem, which holds when while remains fixed. The regime when simultaneously is considerably less well understood, and our work is the first to prove universality for the global distribution of singular values in this setting. Our main result gives non-asymptotic upper bounds on the Kolmogorov-Smirnoff distance between the empirical measure of (normalized) squared singular values and the uniform measure on that go to zero when at any relative rate. We assume only that the distribution of matrix entries has zero mean, unit variance, bounded fourth moment, and a bounded density. Our proofs rely on two key ingredients. The first is a novel small-ball estimate on singular vectors of random matrices from which we deduce a non-asymptotic variant of the multiplicative ergodic theorem that holds for growing matrix size . The second is a martingale concentration argument, which shows that while Lyapunov exponents at large are not universal at fixed matrix size, their empirical distribution becomes universal as soon as the matrix size grows with .

Paper Structure

This paper contains 27 sections, 17 theorems, 112 equations.

Key Result

Theorem 1

Under cond:main_mu, there exist constants $c_1, c_2, c_3, c_4>0$ depending on $K_\infty, M_4$ with the following property. For all $\varepsilon \in\left(0, 1/2\right)$, if $N>c_1 \varepsilon^{-2}$ and $n>c_2 \varepsilon^{-2} \cdot \log(1/\varepsilon)$, then where $d_{KS}$ is the Kolmogorov-Smirnoff distance and $\mathrm{U}_{[0,1]}$ is the uniform distribution on $[0,1]$.

Theorems & Definitions (27)

  • Theorem 1
  • Proposition 1: Reduction from sup norm to pointwise norm
  • Proposition 2
  • Lemma 1: See also Section 9 in hanin2021non
  • proof
  • Lemma 2: See also gelfand1950unitary
  • proof
  • Lemma 3: Theorem 1.1 of rudelson2015small
  • Lemma 4
  • proof
  • ...and 17 more