Noisy Sorting Capacity
Ziao Wang, Nadim Ghaddar, Banghua Zhu, Lele Wang
TL;DR
This work introduces the noisy sorting capacity, the maximum sorting rate achievable when sorting n elements via noisy pairwise comparisons with unknown flip probability p ∈ (0,1/2). It develops insertion-sort-based coding schemes that use Burnashev–Zigangirov (BZ) querying with p estimation to achieve positive rates, showing C(p) ≥ 1/2 (1−H(p)) and, for fixed-length codes, C_f(p) ≥ (1/2) log(1/g(p)) with g(p) = 1/2 + sqrt{p(1−p)}. The paper further derives two converse bounds: C(p) ≤ 1−H(p) for general codes and a tighter bound for insertion-based codes, C_ins(p) ≤ 1 / (1/(1−H(p)) + 1/D(p∥1−p)); these results collectively advance the understanding of sorting under unknown noise and connect sorting with classical channel coding with feedback. The proposed, p-agnostic schemes outperform prior methods (e.g., ren 2019) and lay groundwork for tighter characterizations of noisy sorting capacity, with implications for robust ranking and information-theoretic sorting limits.
Abstract
Sorting is the task of ordering $n$ elements using pairwise comparisons. It is well known that $m=Θ(n\log n)$ comparisons are both necessary and sufficient when the outcomes of the comparisons are observed with no noise. In this paper, we study the sorting problem when each comparison is incorrect with some fixed yet unknown probability $p$. Unlike the common approach in the literature which aims to minimize the number of pairwise comparisons $m$ to achieve a given desired error probability, we consider randomized algorithms with expected number of queries $\textsf{E}[M]$ and aim at characterizing the maximal sorting rate $\frac{n\log n}{\textsf{E}[M]}$ such that the ordering of the elements can be estimated with a vanishing error probability asymptotically. The maximal rate is referred to as the noisy sorting capacity. In this work, we derive upper and lower bounds on the noisy sorting capacity. The two lower bounds -- one for fixed-length algorithms and one for variable-length algorithms -- are established by combining the insertion sort algorithm with the well-known Burnashev--Zigangirov algorithm for channel coding with feedback. Compared with existing methods, the proposed algorithms are universal in the sense that they do not require the knowledge of $p$, while maintaining a strictly positive sorting rate. Moreover, we derive a general upper bound on the noisy sorting capacity, along with an upper bound on the maximal rate that can be achieved by sorting algorithms that are based on insertion sort.