Table of Contents
Fetching ...

A Strong Separation for Adversarially Robust $\ell_0$ Estimation for Linear Sketches

Elena Gribelyuk, Honghao Lin, David P. Woodruff, Huacheng Yu, Samson Zhou

TL;DR

This work gives the first known adaptive attack against linear sketches for the well-studied $\ell_{0}$-estimation problem over turnstile, integer streams and provides an exponential improvement over the previous number of queries known to break an $\ell_{0}$-estimation sketch.

Abstract

The majority of streaming problems are defined and analyzed in a static setting, where the data stream is any worst-case sequence of insertions and deletions that is fixed in advance. However, many real-world applications require a more flexible model, where an adaptive adversary may select future stream elements after observing the previous outputs of the algorithm. Over the last few years, there has been increased interest in proving lower bounds for natural problems in the adaptive streaming model. In this work, we give the first known adaptive attack against linear sketches for the well-studied $\ell_0$-estimation problem over turnstile, integer streams. For any linear streaming algorithm $\mathcal{A}$ that uses sketching matrix $\mathbf{A}\in \mathbb{Z}^{r \times n}$ where $n$ is the size of the universe, this attack makes $\tilde{\mathcal{O}}(r^8)$ queries and succeeds with high constant probability in breaking the sketch. We also give an adaptive attack against linear sketches for the $\ell_0$-estimation problem over finite fields $\mathbb{F}_p$, which requires a smaller number of $\tilde{\mathcal{O}}(r^3)$ queries. Finally, we provide an adaptive attack over $\mathbb{R}^n$ against linear sketches $\mathbf{A} \in \mathbb{R}^{r \times n}$ for $\ell_0$-estimation, in the setting where $\mathbf{A}$ has all nonzero subdeterminants at least $\frac{1}{\textrm{poly}(r)}$. Our results provide an exponential improvement over the previous number of queries known to break an $\ell_0$-estimation sketch.

A Strong Separation for Adversarially Robust $\ell_0$ Estimation for Linear Sketches

TL;DR

This work gives the first known adaptive attack against linear sketches for the well-studied -estimation problem over turnstile, integer streams and provides an exponential improvement over the previous number of queries known to break an -estimation sketch.

Abstract

The majority of streaming problems are defined and analyzed in a static setting, where the data stream is any worst-case sequence of insertions and deletions that is fixed in advance. However, many real-world applications require a more flexible model, where an adaptive adversary may select future stream elements after observing the previous outputs of the algorithm. Over the last few years, there has been increased interest in proving lower bounds for natural problems in the adaptive streaming model. In this work, we give the first known adaptive attack against linear sketches for the well-studied -estimation problem over turnstile, integer streams. For any linear streaming algorithm that uses sketching matrix where is the size of the universe, this attack makes queries and succeeds with high constant probability in breaking the sketch. We also give an adaptive attack against linear sketches for the -estimation problem over finite fields , which requires a smaller number of queries. Finally, we provide an adaptive attack over against linear sketches for -estimation, in the setting where has all nonzero subdeterminants at least . Our results provide an exponential improvement over the previous number of queries known to break an -estimation sketch.
Paper Structure (36 sections, 42 theorems, 139 equations, 2 figures, 2 algorithms)

This paper contains 36 sections, 42 theorems, 139 equations, 2 figures, 2 algorithms.

Key Result

Theorem 1.4

Suppose that $\mathcal{A}$ is a linear streaming algorithm that solves the $(\alpha + c, \beta - c)$- $\ell_0$ gap norm problem for some constants $\alpha, \beta, c$. Then there exists a randomized adversary that, with high constant probability can generate a distribution $D$ over $\mathbb{Z}^n$ suc

Figures (2)

  • Figure 1: Construction of Our Attack
  • Figure 2: Construction of Our Attack over the Reals

Theorems & Definitions (73)

  • Definition 1.1
  • Definition 1.2: $\ell_0$ gap norm problem
  • Definition 1.3: Linear streaming algorithm
  • Theorem 1.4: Informal version of \ref{['thm:thm:main-theorem']}
  • Theorem 1.5: Informal version of \ref{['thm:finitefield']}
  • Theorem 1.6: Informal version of \ref{['thm:thm:real']}
  • Definition 2.1: Interactive Fingerprinting Code Game
  • Definition 2.2: Entropy and conditional entropy
  • Definition 2.3: Mutual information and conditional mutual information
  • Theorem 2.4: Data-processing inequality
  • ...and 63 more