Abstract:Abstract Background Third-generation sequencing offers some advantages over next-generation sequencing predecessors, but with the caveat of harboring a much higher error rate. Clustering-related sequences is an essential task in modern biology. To accurately cluster sequences rich in errors, error type and frequency need to be accounted for. Levenshtein distance is a well-established mathematical algorithm for measuring the edit distance between words and can specifically weight insertions, deletions and substitutions. However, there are drawbacks to using Levenshtein distance in a biological context and hence has rarely been used for this purpose. We present novel modifications to the Levenshtein distance algorithm to optimize it for clustering error-rich biological sequencing data. Results We successfully introduced a bidirectional frameshift allowance with end-user determined accommodation caps combined with weighted error discrimination. Furthermore, our modifications dramatically improved the computational speed of Levenstein distance. For simulated ONT MinION and PacBio Sequel datasets, the average clustering sensitivity for 3GOLD was 41.45% (S.D. 10.39) higher than Sequence-Levenstein distance, 52.14% (S.D. 9.43) higher than Levenshtein distance, 55.93% (S.D. 8.67) higher than Starcode, 42.68% (S.D. 8.09) higher than CD-HIT-EST and 61.49% (S.D. 7.81) higher than DNACLUST. For biological ONT MinION data, 3GOLD clustering sensitivity was 27.99% higher than Sequence-Levenstein distance, 52.76% higher than Levenshtein distance, 56.39% higher than Starcode, 48% higher than CD-HIT-EST and 70.4% higher than DNACLUST. Conclusion Our modifications to Levenshtein distance have improved its speed and accuracy compared to the classic Levenshtein distance, Sequence-Levenshtein distance and other commonly used clustering approaches on simulated and biological third-generation sequenced datasets. Our clustering approach is appropriate for datasets of unknown cluster centroids, such as those generated with unique molecular identifiers as well as known centroids such as barcoded datasets. A strength of our approach is high accuracy in resolving small clusters and mitigating the number of singletons.

De novo clustering of extensive long-read transcriptome datasets with isONclust3

De novo clustering of long reads by gene from transcriptomics data

Clustering de Novo by Gene of Long Reads from Transcriptomics Data

Accurate, Fast and Lightweight Clustering of de novo Transcriptomes using Fragment Equivalence Classes

Highly efficient clustering of long-read transcriptomic data with GeLuster

De novo clustering of long-read amplicons improves phylogenetic insight into microbiome data

Clustering pipeline for determining consensus sequences in targeted next-generation sequencing

CD-HIT: accelerated for clustering the next-generation sequencing data

Efficient Frequency-Based De Novo Short-Read Clustering for Error Trimming in Next-Generation Sequencing

Defining Loci in Restriction-Based Reduced Representation Genomic Data from Nonmodel Species: Sources of Bias and Diagnostics for Optimal Clustering

Omada: robust clustering of transcriptomes through multiple testing

Gclust:A Parallel Clustering Tool for Microbial Genomic Data

TreQ-CG: Clustering Accelerates High-Throughput Sequencing Read Mapping

SSCC: a novel computational framework for rapid and accurate clustering large single cell RNA-seq data

3GOLD: optimized Levenshtein distance for clustering third-generation sequencing data

SynerClust: a highly scalable, synteny-aware orthologue clustering tool

Nonparametric clustering of RNA-sequencing data

K-mer clustering algorithm using a MapReduce framework: application to the parallelization of the Inchworm module of Trinity

Klumpy: A Tool to Evaluate the Integrity of Long-Read Genome Assemblies and Illusive Sequence Motifs

Minirmd: Accurate and Fast Duplicate Removal Tool for Short Reads Via Multiple Minimizers.

isONform: reference-free transcriptome reconstruction from Oxford Nanopore data