Table of Contents
Fetching ...

Punctured Low-Bias Codes Behave Like Random Linear Codes

Venkatesan Guruswami, Jonathan Mosheiff

TL;DR

The work demonstrates that puncturing a short, low-bias mother code yields a code whose local, combinatorial properties closely match those of random linear codes, effectively derandomizing RLCs with only linear randomness in the length. By framing properties as monotone, local, and row-symmetric, the authors transfer the RLC threshold behavior to punctured codes and obtain capacity- and list-decodability results that apply to both worst-case and stochastic error models. The results extend to near-optimal-distance mother codes and large alphabets, and include a general derandomization technique for sampling RLC-like codes with guaranteed property preservation. This derandomization has practical implications for constructing capacity-achieving codes with algebraic structure and potentially enabling efficient decoding in structured settings.

Abstract

Random linear codes are a workhorse in coding theory, and are used to show the existence of codes with the best known or even near-optimal trade-offs in many noise models. However, they have little structure besides linearity, and are not amenable to tractable error-correction algorithms. In this work, we prove a general derandomization result applicable to random linear codes. Namely, in settings where the coding-theoretic property of interest is "local" (in the sense of forbidding certain bad configurations involving few vectors -- code distance and list-decodability being notable examples), one can replace random linear codes (RLCs) with a significantly derandomized variant with essentially no loss in parameters. Specifically, instead of randomly sampling coordinates of the (long) Hadamard code (which is an equivalent way to describe RLCs), one can randomly sample coordinates of any code with low bias. Over large alphabets, the low bias requirement can be weakened to just large distance. Furthermore, large distance suffices even with a small alphabet in order to match the current best known bounds for RLC list-decodability. In particular, by virtue of our result, all current (and future) achievability bounds for list-decodability of random linear codes extend automatically to random puncturings of any low-bias (or large alphabet) "mother" code. We also show that our punctured codes emulate the behavior of RLCs on stochastic channels, thus giving a derandomization of RLCs in the context of achieving Shannon capacity as well. Thus, we have a randomness-efficient way to sample codes achieving capacity in both worst-case and stochastic settings that can further inherit algebraic or other algorithmically useful structural properties of the mother code.

Punctured Low-Bias Codes Behave Like Random Linear Codes

TL;DR

The work demonstrates that puncturing a short, low-bias mother code yields a code whose local, combinatorial properties closely match those of random linear codes, effectively derandomizing RLCs with only linear randomness in the length. By framing properties as monotone, local, and row-symmetric, the authors transfer the RLC threshold behavior to punctured codes and obtain capacity- and list-decodability results that apply to both worst-case and stochastic error models. The results extend to near-optimal-distance mother codes and large alphabets, and include a general derandomization technique for sampling RLC-like codes with guaranteed property preservation. This derandomization has practical implications for constructing capacity-achieving codes with algebraic structure and potentially enabling efficient decoding in structured settings.

Abstract

Random linear codes are a workhorse in coding theory, and are used to show the existence of codes with the best known or even near-optimal trade-offs in many noise models. However, they have little structure besides linearity, and are not amenable to tractable error-correction algorithms. In this work, we prove a general derandomization result applicable to random linear codes. Namely, in settings where the coding-theoretic property of interest is "local" (in the sense of forbidding certain bad configurations involving few vectors -- code distance and list-decodability being notable examples), one can replace random linear codes (RLCs) with a significantly derandomized variant with essentially no loss in parameters. Specifically, instead of randomly sampling coordinates of the (long) Hadamard code (which is an equivalent way to describe RLCs), one can randomly sample coordinates of any code with low bias. Over large alphabets, the low bias requirement can be weakened to just large distance. Furthermore, large distance suffices even with a small alphabet in order to match the current best known bounds for RLC list-decodability. In particular, by virtue of our result, all current (and future) achievability bounds for list-decodability of random linear codes extend automatically to random puncturings of any low-bias (or large alphabet) "mother" code. We also show that our punctured codes emulate the behavior of RLCs on stochastic channels, thus giving a derandomization of RLCs in the context of achieving Shannon capacity as well. Thus, we have a randomness-efficient way to sample codes achieving capacity in both worst-case and stochastic settings that can further inherit algebraic or other algorithmically useful structural properties of the mother code.

Paper Structure

This paper contains 38 sections, 32 theorems, 104 equations.

Key Result

Theorem A

Let $\mathcal{D}$ be a linearThe linearity of $\mathcal{D}$ is crucial here. Indeed, there exists a (non-linear) code $\mathcal{D}$ of small bias such that a random puncturing of $\mathcal{D}$ is unlikely to be similar, in the sense of Theorem thm:IntroLowBias, to either an RLC or to a plain random

Theorems & Definitions (75)

  • Theorem A: Main result about puncturing of low-bias codes (informal version of Theorem \ref{['thm:MainLowBiasProperties']})
  • Theorem B: Main result about puncturing of large-distance codes (informal version of Theorems \ref{['thm:MainLargeDistanceProperties']} and \ref{['thm:MainReduceToGHK']})
  • Theorem C: Puncturing of large-distance codes in stochastic channels (informal version of Theorem \ref{['thm:MainStochastic']})
  • Definition 2.1: Random puncturing
  • Definition 2.2
  • Lemma 2.3: Actual rate equals design rate whp
  • proof
  • Definition 2.4: clustered sets and list-decodability
  • Definition 2.5: Local and row-symmetric properties
  • Theorem 2.7: Thresholds for local and row-symmetric properties MRRSW
  • ...and 65 more