Table of Contents
Fetching ...

Gaussian Broadcast on Grids

Pakawut Jiradilok, Elchanan Mossel

TL;DR

This work introduces Gaussian variants of broadcasting on grids defined by graded posets and analyzes reconstruction thresholds in both infinite (half-space Z^{d+1}_{+}) and finite (orthant Z_{\ge0}^{d+1}) models. Nodes compute averages of their parents plus independent Gaussian noise, and memory of the initial state X_0 is studied via correlation of layer functions ζ_t with X_0 under finite-support reconstructions, including convex versions. The authors establish sharp thresholds: in the finite model memory exists iff some α_i > 1/i, while in the infinite model memory depends on α_{d+1} relative to 1/(d+1), with a dimension-dependent critical case α = 1/(d+1) yielding memorization only for d ≥ 3. They also derive exact asymptotics in low dimensions (e.g., S_t for d=1 in the critical finite case) and provide rate-of-convergence results, convex reconstruction bounds, and covariance/variance analyses underpinning the thresholds. The results illuminate how Gaussian local updates influence memory in grid-based computation and connect to classic memory/broadcast problems in information theory and statistical physics, offering precise thresholds and techniques that may inform related non-Gaussian models.

Abstract

Motivated by the classical work on finite noisy automata (Gray 1982, Gács 2001, Gray 2001) and by the recent work on broadcasting on grids (Makur, Mossel, and Polyanskiy 2022), we introduce Gaussian variants of these models. These models are defined on graded posets. At time $0$, all nodes begin with $X_0$. At time $k\ge 1$, each node on layer $k$ computes a combination of its inputs at layer $k-1$ with independent Gaussian noise added. When is it possible to recover $X_0$ with non-vanishing correlation? We consider different notions of recovery including recovery from a single node, recovery from a bounded window, and recovery from an unbounded window. Our main interest is in two models defined on grids: In the infinite model, layer $k$ is the vertices of $\mathbb{Z}^{d+1}$ whose sum of entries is $k$ and for a vertex $v$ at layer $k \ge 1$, $X_v=α\sum (X_u + W_{u,v})$, summed over all $u$ on layer $k-1$ that differ from $v$ exactly in one coordinate, and $W_{u,v}$ are i.i.d. $\mathcal{N}(0,1)$. We show that when $α<1/(d+1)$, the correlation between $X_v$ and $X_0$ decays exponentially, and when $α>1/(d+1)$, the correlation is bounded away from $0$. The critical case when $α=1/(d+1)$ exhibits a phase transition in dimension, where $X_v$ has non-vanishing correlation with $X_0$ if and only if $d\ge 3$. The same results hold for any bounded window. In the finite model, layer $k$ is the vertices of $\mathbb{Z}^{d+1}$ with nonnegative entries with sum $k$. We identify the sub-critical and the super-critical regimes. In the sub-critical regime, the correlation decays to $0$ for unbounded windows. In the super-critical regime, there exists for every $t$ a convex combination of $X_u$ on layer $t$ whose correlation is bounded away from $0$. We find that for the critical parameters, the correlation is vanishing in all dimensions and for unbounded window sizes.

Gaussian Broadcast on Grids

TL;DR

This work introduces Gaussian variants of broadcasting on grids defined by graded posets and analyzes reconstruction thresholds in both infinite (half-space Z^{d+1}_{+}) and finite (orthant Z_{\ge0}^{d+1}) models. Nodes compute averages of their parents plus independent Gaussian noise, and memory of the initial state X_0 is studied via correlation of layer functions ζ_t with X_0 under finite-support reconstructions, including convex versions. The authors establish sharp thresholds: in the finite model memory exists iff some α_i > 1/i, while in the infinite model memory depends on α_{d+1} relative to 1/(d+1), with a dimension-dependent critical case α = 1/(d+1) yielding memorization only for d ≥ 3. They also derive exact asymptotics in low dimensions (e.g., S_t for d=1 in the critical finite case) and provide rate-of-convergence results, convex reconstruction bounds, and covariance/variance analyses underpinning the thresholds. The results illuminate how Gaussian local updates influence memory in grid-based computation and connect to classic memory/broadcast problems in information theory and statistical physics, offering precise thresholds and techniques that may inform related non-Gaussian models.

Abstract

Motivated by the classical work on finite noisy automata (Gray 1982, Gács 2001, Gray 2001) and by the recent work on broadcasting on grids (Makur, Mossel, and Polyanskiy 2022), we introduce Gaussian variants of these models. These models are defined on graded posets. At time , all nodes begin with . At time , each node on layer computes a combination of its inputs at layer with independent Gaussian noise added. When is it possible to recover with non-vanishing correlation? We consider different notions of recovery including recovery from a single node, recovery from a bounded window, and recovery from an unbounded window. Our main interest is in two models defined on grids: In the infinite model, layer is the vertices of whose sum of entries is and for a vertex at layer , , summed over all on layer that differ from exactly in one coordinate, and are i.i.d. . We show that when , the correlation between and decays exponentially, and when , the correlation is bounded away from . The critical case when exhibits a phase transition in dimension, where has non-vanishing correlation with if and only if . The same results hold for any bounded window. In the finite model, layer is the vertices of with nonnegative entries with sum . We identify the sub-critical and the super-critical regimes. In the sub-critical regime, the correlation decays to for unbounded windows. In the super-critical regime, there exists for every a convex combination of on layer whose correlation is bounded away from . We find that for the critical parameters, the correlation is vanishing in all dimensions and for unbounded window sizes.
Paper Structure (31 sections, 25 theorems, 229 equations, 1 figure, 1 table)

This paper contains 31 sections, 25 theorems, 229 equations, 1 figure, 1 table.

Key Result

Theorem 2.1

Let $d \ge 0$. When $P = \mathbb{Z}_{\ge 0}^{d+1}$, we have the following.

Figures (1)

  • Figure 1: Poset of relations.

Theorems & Definitions (50)

  • Definition 2.1
  • Definition 2.2
  • Definition 2.3
  • Definition 2.4
  • Theorem 2.1
  • Theorem 2.2
  • Theorem 2.3
  • Theorem 2.4
  • Corollary 2.5
  • Proposition 3.1
  • ...and 40 more