Abstract:Abstract Motivation The construction of the compacted de Bruijn graph from collections of reference genomes is a task of increasing interest in genomic analyses. These graphs are increasingly used as sequence indices for short- and long-read alignment. Also, as we sequence and assemble a greater diversity of genomes, the colored compacted de Bruijn graph is being used more and more as the basis for efficient methods to perform comparative genomic analyses on these genomes. Therefore, time- and memory-efficient construction of the graph from reference sequences is an important problem. Results We introduce a new algorithm, implemented in the tool Cuttlefish, to construct the (colored) compacted de Bruijn graph from a collection of one or more genome references. Cuttlefish introduces a novel approach of modeling de Bruijn graph vertices as finite-state automata, and constrains these automata’s state-space to enable tracking their transitioning states with very low memory usage. Cuttlefish is also fast and highly parallelizable. Experimental results demonstrate that it scales much better than existing approaches, especially as the number and the scale of the input references grow. On a typical shared-memory machine, Cuttlefish constructed the graph for 100 human genomes in under 9 h, using ∼29 GB of memory. On 11 diverse conifer plant genomes, the compacted graph was constructed by Cuttlefish in under 9 h, using ∼84 GB of memory. The only other tool completing these tasks on the hardware took over 23 h using ∼126 GB of memory, and over 16 h using ∼289 GB of memory, respectively. Availability and implementation Cuttlefish is implemented in C++14, and is available under an open source license at https://github.com/COMBINE-lab/cuttlefish. Supplementary information Supplementary data are available at Bioinformatics online.

Efficient Graph Based Assembly of Short-Read Sequences on Hybrid Core Architecture

Memory Efficient De Bruijn Graph Construction

Parallel String Graph Construction and Transitive Reduction for De Novo Genome Assembly

Distributed-Memory Parallel Contig Generation for De Novo Long-Read Genome Assembly

Cuttlefish: fast, parallel and low-memory compaction of de Bruijn graphs from large-scale genome collections

Scaling metagenome sequence assembly with probabilistic de Bruijn graphs

HiPGA: A High Performance Genome Assembler for Short Read Sequence Data

Accelerating De Bruijn Graph-Based Genome Assembly for High-Throughput Short Read Data

DBG2OLC: Efficient Assembly of Large Genomes Using Long Erroneous Reads of the Third Generation Sequencing Technologies

Accelerating Irregular Computation in Massive Short Reads Mapping on FPGA Co-Processor

Accelerating massive short reads mapping for next generation sequencing (abstract only).

An efficient algorithm for DNA fragment assembly in MapReduce.

A dynamic hashing approach to build the de bruijn graph for genome assembly

Scalable, ultra-fast, and low-memory construction of compacted de Bruijn graphs with Cuttlefish 2

SeedsGraph: an efficient assembler for next-generation sequencing data

Genome analysis EPGA 2 : memory-efficient de novo assembler

Evaluating De Bruijn Graph Assemblers On 454 Transcriptomic Data

A Hybrid Parallel Strategy Based on String Graph Theory to Improve De Novo DNA Assembly on the TianHe-2 Supercomputer

Accelerating Seed Location Filtering in DNA Read Mapping Using a Commercial Compute-in-SRAM Architecture

Disaggregating Non-Volatile Memory for Throughput-Oriented Genomics Workloads

A Fast Sequence Assembly Method Based on Compressed Data Structures