Abstract:Motivation De Bruijn graph, a fundamental data structure to represent and organize genome sequence, plays important roles in various kinds of sequence analysis tasks such as de novo assembly, high-throughput sequencing (HTS) read alignment, pan-genome analysis, metagenomics analysis, HTS read correction, etc. With the rapid development of HTS data and ever-increasing number of assembled genomes, there is a high demand to construct de Bruijn graph for sequences up to Tera-base-pair level. It is non-trivial since the size of the graph to be constructed could be very large and each graph consists of hundreds of billions of vertices and edges. Current existing approaches may have unaffordable memory footprints to handle such a large de Bruijn graph. Moreover, it also requires the construction approach to handle very large dataset efficiently, even if in a relatively small RAM space. Results We propose a lightweight parallel de Bruijn graph construction approach, de Bruijn Graph Constructor in Scalable Memory (deGSM). The main idea of deGSM is to efficiently construct the Bur-rows-Wheeler Transformation (BWT) of the unipaths of de Bruijn graph in constant RAM space and transform the BWT into the original unitigs. It is mainly implemented by a fast parallel external sorting of k-mers, which allows only a part of k-mers kept in RAM by a novel organization of the k-mers. The experimental results demonstrate that, just with a commonly used machine, deGSM is able to handle very large genome sequence(s), e.g., the contigs (305 Gbp) and scaffolds (1.1 Tbp) recorded in Gen-Bank database and Picea abies HTS dataset (9.7 Tbp). Moreover, deGSM also has faster or comparable construction speed compared with state-of-the-art approaches. With its high scalability and efficiency, deGSM has enormous potentials in many large scale genomics studies. Availability <https://github.com/hitbc/deGSM>. Contact ydwang{at}hit.edu.cn (YW) and bo.liu{at}hit.edu.cn (BL) Supplementary information Supplementary data are available online.

deBGA: read alignment with de Bruijn graph-based seed and extension.

AlignGraph: algorithm for secondary de novo genome assembly guided by closely related references.

Label-guided seed-chain-extend alignment on annotated De Bruijn graphs

CGAP-align: a high performance DNA short read alignment tool.

Fast Variation-Aware Read Alignment with Debga-Vara

Efficient Distributed Parallel Aligning Reads and Reference Genome with Many Repetitive Subsequences Using Compact de Bruijn Graph

Accelerating De Bruijn Graph-Based Genome Assembly for High-Throughput Short Read Data

BGSA: a Bit-Parallel Global Sequence Alignment Toolkit for Multi-Core and Many-Core Architectures.

Debwt: Parallel Construction of Burrows-Wheeler Transform for Large Collection of Genomes with De Bruijn-branch Encoding.

Fast and accurate long-read alignment with Burrows–Wheeler transform

Fast Read Alignment with Incorporation of Known Genomic Variants.

A Bidirectional Fuzzy Index and Approximate Search Algorithm for Next Generation Sequencing

A Short Reads Alignment Algorithm Oriented To Massive Data

The Subread aligner: fast, accurate and scalable read mapping by seed-and-vote

A fast read alignment method based on seed-and-vote for next generation sequencing

EPGA: de novo assembly using the distributions of reads and insert size

An efficient Burrows-Wheeler transform-based aligner for short read mapping

deGSM: memory scalable construction of large scale de Bruijn Graph

Sensitive Long-Indel-Aware Alignment of Sequencing Reads

SaAlign: Multiple DNA/RNA Sequence Alignment and Phylogenetic Tree Construction Tool for Ultra-Large Datasets and Ultra-Long Sequences Based on Suffix Array