Abstract:Background: Sequencing technologies are prone to errors, making error correction (EC) necessary for downstream applications. EC tools need to be manually configured for optimal performance. We find that the optimal parameters (e.g., k-mer size) are both tool- and dataset-dependent. Moreover, evaluating the performance (i.e., Alignment-rate or Gain) of a given tool usually relies on a reference genome, but quality reference genomes are not always available. We introduce Lerna for the automated configuration of k-mer-based EC tools. Lerna first creates a language model (LM) of the uncorrected genomic reads, and then, based on this LM, calculates a metric called the perplexity metric to evaluate the corrected reads for different parameter choices. Next, it finds the one that produces the highest alignment rate without using a reference genome. The fundamental intuition of our approach is that the perplexity metric is inversely correlated with the quality of the assembly after error correction. Therefore, Lerna leverages the perplexity metric for automated tuning of k-mer sizes without needing a reference genome. Results: First, we show that the best k-mer value can vary for different datasets, even for the same EC tool. This motivates our design that automates k-mer size selection without using a reference genome. Second, we show the gains of our LM using its component attention-based transformers. We show the model's estimation of the perplexity metric before and after error correction. The lower the perplexity after correction, the better the k-mer size. We also show that the alignment rate and assembly quality computed for the corrected reads are strongly negatively correlated with the perplexity, enabling the automated selection of k-mer values for better error correction, and hence, improved assembly quality. We validate our approach on both short and long reads. Additionally, we show that our attention-based models have significant runtime improvement for the entire pipeline-18[Formula: see text] faster than previous works, due to parallelizing the attention mechanism and the use of JIT compilation for GPU inferencing. Conclusion: Lerna improves de novo genome assembly by optimizing EC tools. Our code is made available in a public repository at: https://github.com/icanforce/lerna-genomics .

HALC: High throughput algorithm for long read error correction

FLAS: Fast and High-Throughput Algorithm for PacBio Long-Read Self-Correction.

Bi-Level Error Correction for PacBio Long Reads

Scalable long read self-correction and assembly polishing with multiple sequence alignment

Integration of Hybrid and Self-Correction Method Improves the Quality of Long-Read Sequencing Data.

Correcting Illumina sequencing errors for human data

A Parallel Algorithm for Error Correction in High-Throughput Short-Read Data on CUDA-enabled Graphics Hardware.

ResSeq: Enhancing Short-Read Sequencing Alignment by Rescuing Error-Containing Reads

ARAMIS: From systematic errors of NGS long reads to accurate assemblies

Fec: a Fast Error Correction Method Based on Two-Rounds Overlapping and Caching.

DBG2OLC: Efficient Assembly of Large Genomes Using Long Erroneous Reads of the Third Generation Sequencing Technologies

ReadsClean: a new approach to error correction of sequencing reads based on alignments clustering

AlignGraph2: similar genome-assisted reassembly pipeline for PacBio long reads

A Crowdsourcing Method For Correcting Sequencing Errors For The Third-Generation Sequencing Data

Efficient assembly of nanopore reads via highly accurate and intact error correction

Error filtering, pair assembly and error correction for next-generation sequencing reads

Repeat and haplotype aware error correction in nanopore sequencing reads with DeChat

De novo diploid genome assembly using long noisy reads

Lerna: transformer architectures for configuring error correction tools for short- and long-read genome sequencing

Integrating Hi-C links with assembly graphs for chromosome-scale assembly

Telomere-to-Telomere Phased Genome Assembly Using HERRO-Corrected Simplex Nanopore Reads