Abstract:This study introduces a pioneering approach to automate the creation of search schemes for lossless approximate pattern matching. Search schemes are combinatorial structures that define a series of searches over a partitioned pattern. Each search specifies the processing order of these parts and the cumulative lower and upper bounds on the number of errors in each part of the pattern. Together, these searches ensure the identification of all approximate occurrences of a search pattern within a predefined limit of k errors. While existing literature offers designed schemes for up to k = 4 errors, designing search schemes for larger k values incurs escalating computational costs. Our method integrates a greedy algorithm and a novel Integer Linear Programming (ILP) formulation to design efficient search schemes for up to k = 7 errors. Comparative analyses demonstrate the superiority of our ILP-optimal schemes over alternative strategies in both theoretical and practical contexts. Additionally, we propose a dynamic scheme selection technique tailored to specific search patterns, further enhancing efficiency. Combined, this yields runtime reductions of up to 53% for higher k values. To facilitate search scheme generation, we present Hato, an open-source software tool (AGPL-3.0 license) employing the greedy algorithm and utilizing CPLEX for ILP solving. Furthermore, we introduce Columba 1.2, an open-source lossless read-mapper (AGPL-3.0 license) implemented in C++. Columba surpasses existing state-of-the-art tools by identifying all approximate occurrences of 100,000 Illumina reads (150 bp) in the human reference genome within 24 seconds (maximum edit distance of 4) and 75 seconds (maximum edit distance of 6) using a single CPU core. Notably, our study showcases Columba's capability to align 100,000 reads of length 50, with high error rates and up to an edit distance of 7, in a mere 2 hours and 15 minutes. This achievement is unmatched by other lossless aligners, which require over 3 hours for edit distance 5 alignments. Moreover, Columba exhibits a mapping rate four times higher than that of a lossy tool for this dataset.

NetDPO: (delta, gamma)-approximate pattern matching with gap constraints under one-off condition

NetDAP: (δ, γ) −approximate pattern matching with length constraints

NetNDP: Nonoverlapping (delta, Gamma)-Approximate Pattern Matching.

A Nettree for Approximate Maximal Pattern Matching with Gaps and One-Off Constraint

NETASPNO: Approximate Strict Pattern Matching under Nonoverlapping Condition

Strict Approximate Pattern Matching with General Gaps

Flexible Pattern Matching with Gap-Length and One-Off Conditions.

NetNPG: Nonoverlapping Pattern Matching with General Gap Constraints

Strict Pattern Matching with General Gaps and One-Off Condition

Strict Pattern Matching under Non-Overlapping Condition

Pattern matching with wildcards and gap-length constraints based on a centrality-degree graph

Pattern Matching with Independent Wildcard Gaps

Neighbor-base similarity matching for graphs

NOSEP: Nonoverlapping Sequence Pattern Mining with Gap Constraints.

Mining sequential patterns with periodic wildcard gaps

1/p-Approximate String Matching with Section

Realtime and Robust Object Matching with a Large Number of Templates

Lightweight Pattern Matching Method for DNA Sequencing in Internet of Medical Things

Approximate Repeating Pattern Mining with Gap Requirements

A Comparative Study of Pattern Matching Algorithms on Sequences

Lossless Approximate Pattern Matching: Automated Design of Efficient Search Schemes