Abstract:Motivation: Modern methods for computation-intensive tasks in sequence analysis (e.g. read mapping, sequence alignment, genome assembly, etc.) often first transform each sequence into a list of short, regular-length seeds so that compact data structures and efficient algorithms can be employed to handle the ever-growing large-scale data. Seeding methods using kmers (substrings of length k) have gained tremendous success in processing sequencing data with low mutation/error rates. However, they are much less effective for sequencing data with high error rates as kmers cannot tolerate errors. Results: We propose SubseqHash, a strategy that uses subsequences, rather than substrings, as seeds. Formally, SubseqHash maps a string of length n to its smallest subsequence of length k, k< n, according to a given order overall length-k strings. Finding the smallest subsequence of a string by enumeration is impractical as the number of subsequences grows exponentially. To overcome this barrier, we propose a novel algorithmic framework that consists of a specifically designed order (termed ABC order) and an algorithm that computes the minimized subsequence under an ABC order in polynomial time. We first show that the ABC order exhibits the desired property and the probability of hash collision using the ABC order is close to the Jaccard index. We then show that SubseqHash overwhelmingly outperforms the substring-based seeding methods in producing high-quality seed-matches for three critical applications: read mapping, sequence alignment, and overlap detection. SubseqHash presents a major algorithmic breakthrough for tackling the high error rates and we expect it to be widely adapted for long-reads analysis.

Ranking and Unranking k-subsequence universal words

$k$-Universality of Regular Languages

Subsequences in Bounded Ranges: Matching and Analysis Problems

Ranking and unranking bordered and unbordered words

Blocksequences of k-local Words

Subsequence Matching and Analysis Problems for Formal Languages

On the Partial Sum of Subword-Counting Sequences

Rollercoasters with Plateaus

Seeding with Minimized Subsequence.

On the shape of subword complexity sequences of finite words

Tight Bounds for the Number of Absent Scattered Factors

Online algorithms for finding distinct substrings with length and multiple prefix and suffix conditions

Absent Subsequences in Words

Efficient algorithms for enumerating maximal common subsequences of two strings

Efficient algorithms for the longest common subsequence in $k$-length substrings

Sorting and Ranking of Self-Delimiting Numbers with Applications to Outerplanar Graph Isomorphism

Minimizing the Minimizers via Alphabet Reordering

Arithmetical subword complexity of automatic sequences

From Exponential to Polynomial Complexity: Efficient Permutation Counting with Subword Constraints

Weakly Consecutive Sequences

Submodularity on Hypergraphs: From Sets to Sequences