Table of Contents
Fetching ...

Noisy Computing of the Threshold Function

Ziao Wang, Nadim Ghaddar, Banghua Zhu, Lele Wang

TL;DR

This work characterizes the query complexity of computing the threshold function $\mathsf{TH}_k$ under noisy bit readings through a Binary Symmetric Channel with fixed noise $p\in(0,1/2)$. It delivers asymptotically tight results: an achievability bound of $\Theta\left(\frac{n\log(m/\delta)}{D_{\mathrm{KL}}(p\|1-p)}\right)$ and a matching (up to smaller factors) converse bound, where $m=\min\{k,n-k+1\}$ and $D_{\mathrm{KL}}(p\|1-p)$ is the KL divergence between $\mathrm{Bern}(p)$ and $\mathrm{Bern}(1-p)$. The paper sharpens previous results by tightening dependence on $p$ and establishing tightness for $m=o(n)$ and near-tightness for general $m$, with MAJORITY ($k=n/2$) achieving exact-throughput up to a factor of 2. The authors develop two complementary analyses: a Le Cam-based lower bound and a genie-aided, balls-in-bins lower-bound for large $m$, and two regimes for the upper bound using per-bit checking or a filtering-plus-heap strategy. These findings advance understanding of robust threshold computation under noise and point to extensions when $p$ is unknown or varies with $n$.

Abstract

Let $\mathsf{TH}_k$ denote the $k$-out-of-$n$ threshold function: given $n$ input Boolean variables, the output is $1$ if and only if at least $k$ of the inputs are $1$. We consider the problem of computing the $\mathsf{TH}_k$ function using noisy readings of the Boolean variables, where each reading is incorrect with some fixed and known probability $p \in (0,1/2)$. As our main result, we show that it is sufficient to use $(1+o(1)) \frac{n\log \frac{m}δ}{D_{\mathsf{KL}}(p \| 1-p)}$ queries in expectation to compute the $\mathsf{TH}_k$ function with a vanishing error probability $δ= o(1)$, where $m\triangleq \min\{k,n-k+1\}$ and $D_{\mathsf{KL}}(p \| 1-p)$ denotes the Kullback-Leibler divergence between $\mathsf{Bern}(p)$ and $\mathsf{Bern}(1-p)$ distributions. Conversely, we show that any algorithm achieving an error probability of $δ= o(1)$ necessitates at least $(1-o(1))\frac{(n-m)\log\frac{m}δ}{D_{\mathsf{KL}}(p \| 1-p)}$ queries in expectation. The upper and lower bounds are tight when $m=o(n)$, and are within a multiplicative factor of $\frac{n}{n-m}$ when $m=Θ(n)$. In particular, when $k=n/2$, the $\mathsf{TH}_k$ function corresponds to the $\mathsf{MAJORITY}$ function, in which case the upper and lower bounds are tight up to a multiplicative factor of two. Compared to previous work, our result tightens the dependence on $p$ in both the upper and lower bounds.

Noisy Computing of the Threshold Function

TL;DR

This work characterizes the query complexity of computing the threshold function under noisy bit readings through a Binary Symmetric Channel with fixed noise . It delivers asymptotically tight results: an achievability bound of and a matching (up to smaller factors) converse bound, where and is the KL divergence between and . The paper sharpens previous results by tightening dependence on and establishing tightness for and near-tightness for general , with MAJORITY () achieving exact-throughput up to a factor of 2. The authors develop two complementary analyses: a Le Cam-based lower bound and a genie-aided, balls-in-bins lower-bound for large , and two regimes for the upper bound using per-bit checking or a filtering-plus-heap strategy. These findings advance understanding of robust threshold computation under noise and point to extensions when is unknown or varies with .

Abstract

Let denote the -out-of- threshold function: given input Boolean variables, the output is if and only if at least of the inputs are . We consider the problem of computing the function using noisy readings of the Boolean variables, where each reading is incorrect with some fixed and known probability . As our main result, we show that it is sufficient to use queries in expectation to compute the function with a vanishing error probability , where and denotes the Kullback-Leibler divergence between and distributions. Conversely, we show that any algorithm achieving an error probability of necessitates at least queries in expectation. The upper and lower bounds are tight when , and are within a multiplicative factor of when . In particular, when , the function corresponds to the function, in which case the upper and lower bounds are tight up to a multiplicative factor of two. Compared to previous work, our result tightens the dependence on in both the upper and lower bounds.
Paper Structure (29 sections, 28 theorems, 112 equations, 1 figure, 6 algorithms)

This paper contains 29 sections, 28 theorems, 112 equations, 1 figure, 6 algorithms.

Key Result

Theorem 1

Suppose $k\le n/2$ and $\delta=o(1)$. Consider any variable-length algorithm for computing $\mathsf{TH}_k(\mathbf{x})$ that makes $M$ noisy queries. If $M$ satisfies $\mathop{\mathrm{\mathsf{E}}}\nolimits[M|\mathbf{x}]\le (1-o(1))\frac{(n-k)\log\frac{k}{\delta}}{{D_\mathrm{KL}(p\|1-p)}}$ for any inp

Figures (1)

  • Figure 1: Average number of queries used by the proposed noisy threshold algorithm for computing the $\mathsf{MAJORITY}$ function (i.e., $k=n/2$), in comparison to the algorithm proposed in feige1994computing, for $n=100$ and $\delta=10^{-2}$. The theoretical lower bound corresponds to the plot of $\frac{(n-m)\log(m/\delta)}{{D_\mathrm{KL}(p\|1-p)}}$, where $m = \min\{k,n-k+1\}$.

Theorems & Definitions (46)

  • Theorem 1: Converse
  • Theorem 2: Achievability
  • Corollary 1
  • Remark 1: Gap between the upper and lower bounds
  • Corollary 2: Tight bounds for $\mathsf{OR}$ and $\mathsf{AND}$ functions
  • Corollary 3: Fixed-length algorithms
  • Lemma 1
  • Proposition 1
  • Proposition 2
  • proof
  • ...and 36 more