Table of Contents
Fetching ...

Novel Results on the Number of Runs of the Burrows-Wheeler-Transform

Sara Giuliani, Shunsuke Inenaga, Zsuzsanna Lipták, Nicola Prezza, Marinella Sciortino, Anna Toffanello

TL;DR

This paper studies $ρ(n)$, the maximal ratio between the number of BWT runs of a word and of its reverse, as a measure of text repetitiveness. Building on the upper bound for $ρ(n)$ of $O(log^2 n)$ from Kempa and Kociumaka, the authors construct infinite binary word families to establish a non-trivial lower bound $ρ(n) = Ω(log n)$. The main technical result shows that Fibonacci-plus words satisfy $ρ(v) = Θ(log n)$ by having $r(v) = 4$ and $r(v^{rev}) = Ω(log n)$, and that a single final character extension can amplify $r$ by a factor $Θ(log n)$ (a one-bit catastrophe). These findings imply that $r$ is not invariant under reversal and leave a gap between the proven lower bound $Ω(log n)$ and the known upper bound $O(log^2 n)$ for $ρ(n)$. They also suggest that the apparent constancy of $ρ$ on real repetitive datasets does not hold in worst-case constructions and have implications for BWT-based compression and index structures.

Abstract

The Burrows-Wheeler-Transform (BWT), a reversible string transformation, is one of the fundamental components of many current data structures in string processing. It is central in data compression, as well as in efficient query algorithms for sequence data, such as webpages, genomic and other biological sequences, or indeed any textual data. The BWT lends itself well to compression because its number of equal-letter-runs (usually referred to as $r$) is often considerably lower than that of the original string; in particular, it is well suited for strings with many repeated factors. In fact, much attention has been paid to the $r$ parameter as measure of repetitiveness, especially to evaluate the performance in terms of both space and time of compressed indexing data structures. In this paper, we investigate $ρ(v)$, the ratio of $r$ and of the number of runs of the BWT of the reverse of $v$. Kempa and Kociumaka [FOCS 2020] gave the first non-trivial upper bound as $ρ(v) = O(\log^2(n))$, for any string $v$ of length $n$. However, nothing is known about the tightness of this upper bound. We present infinite families of binary strings for which $ρ(v) = Θ(\log n)$ holds, thus giving the first non-trivial lower bound on $ρ(n)$, the maximum over all strings of length $n$. Our results suggest that $r$ is not an ideal measure of the repetitiveness of the string, since the number of repeated factors is invariant between the string and its reverse. We believe that there is a more intricate relationship between the number of runs of the BWT and the string's combinatorial properties.

Novel Results on the Number of Runs of the Burrows-Wheeler-Transform

TL;DR

This paper studies , the maximal ratio between the number of BWT runs of a word and of its reverse, as a measure of text repetitiveness. Building on the upper bound for of from Kempa and Kociumaka, the authors construct infinite binary word families to establish a non-trivial lower bound . The main technical result shows that Fibonacci-plus words satisfy by having and , and that a single final character extension can amplify by a factor (a one-bit catastrophe). These findings imply that is not invariant under reversal and leave a gap between the proven lower bound and the known upper bound for . They also suggest that the apparent constancy of on real repetitive datasets does not hold in worst-case constructions and have implications for BWT-based compression and index structures.

Abstract

The Burrows-Wheeler-Transform (BWT), a reversible string transformation, is one of the fundamental components of many current data structures in string processing. It is central in data compression, as well as in efficient query algorithms for sequence data, such as webpages, genomic and other biological sequences, or indeed any textual data. The BWT lends itself well to compression because its number of equal-letter-runs (usually referred to as ) is often considerably lower than that of the original string; in particular, it is well suited for strings with many repeated factors. In fact, much attention has been paid to the parameter as measure of repetitiveness, especially to evaluate the performance in terms of both space and time of compressed indexing data structures. In this paper, we investigate , the ratio of and of the number of runs of the BWT of the reverse of . Kempa and Kociumaka [FOCS 2020] gave the first non-trivial upper bound as , for any string of length . However, nothing is known about the tightness of this upper bound. We present infinite families of binary strings for which holds, thus giving the first non-trivial lower bound on , the maximum over all strings of length . Our results suggest that is not an ideal measure of the repetitiveness of the string, since the number of repeated factors is invariant between the string and its reverse. We believe that there is a more intricate relationship between the number of runs of the BWT and the string's combinatorial properties.

Paper Structure

This paper contains 3 sections, 2 theorems, 2 equations, 1 table.

Key Result

theorem thmcountertheorem

Let $v$ be a Fibonacci-plus word, and let $|v|=n$. Then $\rho(s) = \Theta(\log n)$.

Theorems & Definitions (4)

  • definition thmcounterdefinition
  • definition thmcounterdefinition
  • theorem thmcountertheorem
  • proposition thmcounterproposition: Some known properties of the Fibonacci words