Abstract:Background: Clustering is a fundamental operation in the analysis of biological sequence data. New DNA sequencing technologies have dramatically increased the rate at which we can generate data, resulting in datasets that cannot be efficiently analyzed by traditional clustering methods.This is particularly true in the context of taxonomic profiling of microbial communities through direct sequencing of phylogenetic markers (e.g. 16S rRNA) - the domain that motivated the work described in this paper. Many analysis approaches rely on an initial clustering step aimed at identifying sequences that belong to the same operational taxonomic unit (OTU). When defining OTUs (which have no universally accepted definition), scientists must balance a trade-off between computational efficiency and biological accuracy, as accurately estimating an environment's phylogenetic composition requires computationally-intensive analyses. We propose that efficient and mathematically well defined clustering methods can benefit existing taxonomic profiling approaches in two ways: (i) the resulting clusters can be substituted for OTUs in certain applications; and (ii) the clustering effectively reduces the size of the data-sets that need to be analyzed by complex phylogenetic pipelines (e.g., only one sequence per cluster needs to be provided to downstream analyses). Results: To address the challenges outlined above, we developed DNACLUST, a fast clustering tool specifically designed for clustering highly-similar DNA sequences.Given a set of sequences and a sequence similarity threshold, DNACLUST creates clusters whose radius is guaranteed not to exceed the specified threshold. Underlying DNACLUST is a greedy clustering strategy that owes its performance to novel sequence alignment and k-mer based filtering algorithms.DNACLUST can also produce multiple sequence alignments for every cluster, allowing users to manually inspect clustering results, and enabling more detailed analyses of the clustered data. Conclusions: We compare DNACLUST to two popular clustering tools: CD-HIT and UCLUST. We show that DNACLUST is about an order of magnitude faster than CD-HIT and UCLUST (exact mode) and comparable in speed to UCLUST (approximate mode). The performance of DNACLUST improves as the similarity threshold is increased (tight clusters) making it well suited for rapidly removing duplicates and near-duplicates from a dataset, thereby reducing the size of the data being analyzed through more elaborate approaches.

Heuristic Clustering Method Based on Neighbor-Seeds for 454 Sequencing Data

Two-Stage Clustering (Tsc): A Pipeline For Selecting Operational Taxonomic Units For The High-Throughput Sequencing Of Pcr Amplicons

Subsampled Open-Reference Clustering Creates Consistent, Comprehensive OTU Definitions and Scales to Billions of Sequences

MSClust: A Multi-Seeds based Clustering algorithm for microbiome profiling using 16S rRNA sequence

Clustering 16S Rrna for OTU Prediction: a Method of Unsupervised Bayesian Clustering.

DMSC: A Dynamic Multi-Seeds Method for Clustering 16S Rrna Sequences into OTUs

A Comparison of Methods for Clustering 16s Rrna Sequences into Otus

MtHc: a Motif-Based Hierarchical Method for Clustering Massive 16S Rrna Sequences into OTUs.

EdClust: A Heuristic Sequence Clustering Method with Higher Sensitivity

Comparison of Methods for Picking the Operational Taxonomic Units From Amplicon Sequences

DBH: A de Bruijn graph-based heuristic method for clustering large-scale 16S rRNA sequences into OTUs.

Sequence Clustering in Bioinformatics: an Empirical Study.

Comparison of Methods for Biological Sequence Clustering.

DMclust, a Density-based Modularity Method for Accurate OTU Picking of 16S Rrna Sequences

DNACLUST: accurate and efficient clustering of phylogenetic marker genes

EnteroBase: Hierarchical Clustering of 100,000s of Bacterial Genomes into Species/sub-Species and Populations

Hss-Bin: an Unsupervised Metagenomic Binning Method Based on Hybrid Sequence Feature Recognition and Spectral Clustering

Interpreting 16S metagenomic data without clustering to achieve sub-OTU resolution

HierCC: a Multi-Level Clustering Scheme for Population Assignments Based on Core Genome MLST

SEED: efficient clustering of next-generation sequences.

Biootu: an Improved Method for Simultaneous Taxonomic Assignments and Operational Taxonomic Units Clustering of 16s Rrna Gene Sequences.