Abstract:Lempel-Ziv (LZ77) factorization is a fundamental problem in string processing: Greedily partition a given string $T$ from left to right into blocks (called phrases) so that each phrase is either the leftmost occurrence of a letter or the longest prefix of the unprocessed suffix that has another occurrence earlier in $T$. Due to numerous applications, LZ77 factorization is one of the most studied problems on strings. In the 47 years since its inception, several algorithms were developed for different models of computation, including parallel, GPU, external-memory, and quantum. Remarkably, however, the complexity of the most basic variant is still not settled: All existing algorithms in the RAM model run in $\Omega(n)$ time, which is a $\Theta(\log n)$ factor away from the lower bound of $\Omega(n/\log n)$ (following from the necessity to read the input, which takes $\Theta(n/\log n)$ space for $T\in\{0,1\}^{n}$). We present the first $o(n)$-time algorithm for LZ77 factorization, breaking the linear-time barrier present for nearly 50 years. For $T\in\{0,1\}^{n}$, our algorithm runs in $\mathcal{O}(n/\sqrt{\log n})=o(n)$ time and uses the optimal $\mathcal{O}(n/\log n)$ working space. Our algorithm generalizes to $\Sigma=[0..\sigma)$, where $\sigma=n^{\mathcal{O}(1)}$. The runtime and working space then become $\mathcal{O}((n\log\sigma)/\sqrt{\log n})$ and $\mathcal{O}(n/\log_{\sigma} n)$. To obtain our algorithm, we prove a more general result: For any constant $\epsilon\in(0,1)$ and $T\in[0..\sigma)^{n}$, in $\mathcal{O}((n\log\sigma)/\sqrt{\log n})$ time and using $\mathcal{O}(n/\log_{\sigma}n)$ space, we can construct an $\mathcal{O}(n/\log_{\sigma}n)$-size index that, given any $P=T[j..j+\ell)$ (represented as $(j,\ell)$), computes the leftmost occurrence of $P$ in $T$ in $\mathcal{O}(\log^{\epsilon}n)$ time. In other words, we solve the indexing/online variant of the LZ77 problem.

On Abelian Longest Common Factor with and without RLE

Efficient Algorithms for Finding a Longest Common Increasing Subsequence

Near-Optimal Quantum Algorithm for Finding the Longest Common Substring between Run-Length Encoded Strings

A sublinear time quantum algorithm for longest common substring problem between run-length encoded strings

Space Efficient Linear Time Lempel-Ziv Factorization on Constant~Size~Alphabets

A simple linear space algorithm for computing a longest common increasing subsequence

Substring Compression Variations and LZ78-Derivates

Small-space encoding LCE data structure with constant-time queries

Lempel-Ziv (LZ77) Factorization in Sublinear Time

A note on the longest common substring with $k$-mismatches problem

A sub-quadratic algorithm for the longest common increasing subsequence problem

Decompressing Lempel-Ziv Compressed Text

Faster and simpler online/sliding rightmost Lempel-Ziv factorizations

Selective Run-Length Encoding

Faster Space-Efficient STR-IC-LCS Computation

A Note on the Longest Common Compatible Prefix Problem for Partial Words

A special class of solutions of the truncated Hill's equation

Hardness of Longest Common Subsequence for Sequences with Bounded Run-Lengths

Polynomial-time equivalences and refined algorithms for longest common subsequence variants

Improved Lower Bounds on the Expected Length of Longest Common Subsequences