Abstract:In metagenomic studies of microbial communities, the short reads come from mixtures of genomes. Read assembly is usually an essential first step for the follow-up studies in metagenomic research. Understanding the power and limitations of various read assembly programs in practice is important for researchers to choose which programs to use in their investigations. Many studies evaluating different assembly programs used either simulated metagenomes or real metagenomes with unknown genome compositions. However, the simulated datasets may not reflect the real complexities of metagenomic samples and the estimated assembly accuracy could be misleading due to the unknown genomes in real metagenomes. Therefore, hybrid strategies are required to evaluate the various read assemblers for metagenomic studies. In this paper, we benchmark the metagenomic read assemblers by mixing reads from real metagenomic datasets with reads from known genomes and evaluating the integrity, contiguity and accuracy of the assembly using the reads from the known genomes. We selected four advanced metagenome assemblers, MEGAHIT, MetaSPAdes, IDBA-UD and Faucet, for evaluation. We showed the strengths and weaknesses of these assemblers in terms of integrity, contiguity and accuracy for different variables, including the genetic difference of the real genomes with the genome sequences in the real metagenomic datasets and the sequencing depth of the simulated datasets. Overall, MetaSPAdes performs best in terms of integrity and continuity at the species-level, followed by MEGAHIT. Faucet performs best in terms of accuracy at the cost of worst integrity and continuity, especially at low sequencing depth. MEGAHIT has the highest genome fractions at the strain-level and MetaSPAdes has the overall best performance at the strain-level. MEGAHIT is the most efficient in our experiments. Availability: The source code is available at https://github.com/ziyewang/MetaAssemblyEval.

MEGAHIT: an ultra-fast single-node solution for large and complex metagenomics assembly via succinct de Bruijn graph

Efficient High-Quality Metagenome Assembly from Long Accurate Reads using Minimizer-space de Bruijn Graphs

Extreme Scale De Novo Metagenome Assembly

Dime: A Novel Framework for De Novo Metagenomic Sequence Assembly

Scaling metagenome sequence assembly with probabilistic de Bruijn graphs

Efficient De Novo Assembly and Recovery of Microbial Genomes from Complex Metagenomes Using a Reduced Set of k-mers

Parallel Read Partitioning for Concurrent Assembly of Metagenomic Data

A De Novo Assembly Method for Metagenomic DNA Reads with Mate Pairs

Benchmarking genome assembly methods on metagenomic sequencing data

Memory Efficient De Bruijn Graph Construction

Assessment of Metagenomic Assemblers Based on Hybrid Reads of Real and Simulated Metagenomic Sequences

High-quality metagenome assembly from long accurate reads with metaMDBG

DBG2OLC: Efficient Assembly of Large Genomes Using Long Erroneous Reads of the Third Generation Sequencing Technologies

MitoFinder: Efficient automated large‐scale extraction of mitogenomic data in target enrichment phylogenomics

Assembling large, complex environmental metagenomes

InteMAP: Integrated metagenomic assembly pipeline for NGS short reads

Scalable telomere-to-telomere assembly for diploid and polyploid genomes with double graph

Utilizing de Bruijn graph of metagenome assembly for metatranscriptome analysis

Distributed-Memory Parallel Contig Generation for De Novo Long-Read Genome Assembly

Fast and accurate short read alignment with hybrid hash-tree data structure

A de novo metagenomic assembly program for shotgun DNA reads.