Table of Contents
Fetching ...

Hidden Clique Inference in Random Ising Model II: the planted Sherrington-Kirkpatrick model

Yihan He, Han Liu, Jianqing Fan

TL;DR

A universality result implying that all the obtained rates still hold with non-Gaussian couplings is proved and a family of novel concentration bounds and central limiting theorems for the averaging statistics in the local and global phases of the planted SK model are established.

Abstract

We study the problem of testing and recovering $k$-clique Ferromagnetic mean shift in the planted Sherrington-Kirkpatrick model (i.e., a type of spin glass model) with $n$ spins. The planted SK model -- a stylized mixture of an uncountable number of Ising models -- allows us to study the fundamental limits of correlation analysis for dependent random variables under misspecification. Our paper makes three major contributions: (i) We identify the phase diagrams of the testing problem by providing minimax optimal rates for multiple different parameter regimes. We also provide minimax optimal rates for exact recovery in the high/critical and low temperature regimes. (ii) We prove a universality result implying that all the obtained rates still hold with non-Gaussian couplings. (iii) To achieve the major results, we also establish a family of novel concentration bounds and central limiting theorems for the averaging statistics in the local and global phases of the planted SK model. These technical results shed new insights into the planted spin glass models. The pSK model also exhibits close connections with a binary variant of the single spike Gaussian sparse principle component analysis model by replacing the background identity precision matrix with a Wigner random matrix.

Hidden Clique Inference in Random Ising Model II: the planted Sherrington-Kirkpatrick model

TL;DR

A universality result implying that all the obtained rates still hold with non-Gaussian couplings is proved and a family of novel concentration bounds and central limiting theorems for the averaging statistics in the local and global phases of the planted SK model are established.

Abstract

We study the problem of testing and recovering -clique Ferromagnetic mean shift in the planted Sherrington-Kirkpatrick model (i.e., a type of spin glass model) with spins. The planted SK model -- a stylized mixture of an uncountable number of Ising models -- allows us to study the fundamental limits of correlation analysis for dependent random variables under misspecification. Our paper makes three major contributions: (i) We identify the phase diagrams of the testing problem by providing minimax optimal rates for multiple different parameter regimes. We also provide minimax optimal rates for exact recovery in the high/critical and low temperature regimes. (ii) We prove a universality result implying that all the obtained rates still hold with non-Gaussian couplings. (iii) To achieve the major results, we also establish a family of novel concentration bounds and central limiting theorems for the averaging statistics in the local and global phases of the planted SK model. These technical results shed new insights into the planted spin glass models. The pSK model also exhibits close connections with a binary variant of the single spike Gaussian sparse principle component analysis model by replacing the background identity precision matrix with a Wigner random matrix.
Paper Structure (72 sections, 55 theorems, 353 equations, 2 tables, 5 algorithms)

This paper contains 72 sections, 55 theorems, 353 equations, 2 tables, 5 algorithms.

Key Result

Theorem IX.1

Assume that $k\log k=o(n)$ and the condition atcondition holds. Depending on the different temperature regimes, the optimal sample complexities $m$ for asymptotic powerful testing are given by :

Theorems & Definitions (69)

  • definition 19: Asymptotic Power of Tests
  • definition 20: Exact Recovery
  • definition 21: Flatness of Local Optimum
  • Theorem IX.1
  • definition 22: Within the AT line
  • Theorem IX.2
  • Theorem IX.3
  • lemma 148
  • Remark 22
  • lemma 149
  • ...and 59 more