Novel Results on the Number of Runs of the Burrows-Wheeler-Transform
Sara Giuliani, Shunsuke Inenaga, Zsuzsanna Lipták, Nicola Prezza, Marinella Sciortino, Anna Toffanello
TL;DR
This paper studies $ρ(n)$, the maximal ratio between the number of BWT runs of a word and of its reverse, as a measure of text repetitiveness. Building on the upper bound for $ρ(n)$ of $O(log^2 n)$ from Kempa and Kociumaka, the authors construct infinite binary word families to establish a non-trivial lower bound $ρ(n) = Ω(log n)$. The main technical result shows that Fibonacci-plus words satisfy $ρ(v) = Θ(log n)$ by having $r(v) = 4$ and $r(v^{rev}) = Ω(log n)$, and that a single final character extension can amplify $r$ by a factor $Θ(log n)$ (a one-bit catastrophe). These findings imply that $r$ is not invariant under reversal and leave a gap between the proven lower bound $Ω(log n)$ and the known upper bound $O(log^2 n)$ for $ρ(n)$. They also suggest that the apparent constancy of $ρ$ on real repetitive datasets does not hold in worst-case constructions and have implications for BWT-based compression and index structures.
Abstract
The Burrows-Wheeler-Transform (BWT), a reversible string transformation, is one of the fundamental components of many current data structures in string processing. It is central in data compression, as well as in efficient query algorithms for sequence data, such as webpages, genomic and other biological sequences, or indeed any textual data. The BWT lends itself well to compression because its number of equal-letter-runs (usually referred to as $r$) is often considerably lower than that of the original string; in particular, it is well suited for strings with many repeated factors. In fact, much attention has been paid to the $r$ parameter as measure of repetitiveness, especially to evaluate the performance in terms of both space and time of compressed indexing data structures. In this paper, we investigate $ρ(v)$, the ratio of $r$ and of the number of runs of the BWT of the reverse of $v$. Kempa and Kociumaka [FOCS 2020] gave the first non-trivial upper bound as $ρ(v) = O(\log^2(n))$, for any string $v$ of length $n$. However, nothing is known about the tightness of this upper bound. We present infinite families of binary strings for which $ρ(v) = Θ(\log n)$ holds, thus giving the first non-trivial lower bound on $ρ(n)$, the maximum over all strings of length $n$. Our results suggest that $r$ is not an ideal measure of the repetitiveness of the string, since the number of repeated factors is invariant between the string and its reverse. We believe that there is a more intricate relationship between the number of runs of the BWT and the string's combinatorial properties.
