Abstract:AbstractMetagenomics has in the last decade greatly revolutionized the study of microbial communities. However, the presence of artificial duplicate reads mainly raised from the preparation of metagenomic DNA sequencing library and their impacts on metagenomic assembly and binning have never brought to the attention. Here, we explicitly investigated the effects of duplicate reads on metagenomic assembly and binning, based on analyses of four groups of representative metagenomes with distinct microbiome complexity. Our results showed that deduplication considerably increased the binning yields (by 3.5% to 80%) for most of the metagenomic datasets examined thanks to improved contig length and coverage profiling of metagenome-assembled contigs. Specifically, 411 versus 397, 331 versus 317, 104 versus 88 and 9 versus 5 metagenome-assembled genomes (MAGs) were recovered from MEGAHIT assemblies of bioreactor sludge, surface water, lake sediment, and forest soil metagenomes, respectively. Noticeably, deduplication reduced the computational costs of metagenomic assembly including elapsed time (by 9.0% to 29.9%) and maximum memory requirement (by 4.3% to 37.1%). Collectively, it is recommended to remove duplicate reads in metagenomic data before assembly and binning analyses, particularly for complex environmental samples, such as forest soils examined in this study.ImportanceDuplicated reads are usually considered as technical artefacts. Their presence in metagenomes would theoretically not only introduce bias in the quantitative analysis, but also result in mistakes in coverage profile, leading to negative effects or even failures on metagenomic assembly and binning, as the widely used metagenome assemblers and binners all need coverage information for graph partitioning and assembly binning, respectively. However, this issue was seldomly noticed and its impacts on the downstream key bioinformatic procedures (e.g., assembly and binning) still remained unclear. In this study, we comprehensively evaluated for the first time the impacts of duplicate reads on de novo assembly and binning of real metagenomic datasets by comparing assembly quality, binning yields and the requirements of computational resources with and without the removal of duplicate reads. It was revealed that deduplication considerably increased the binning yields and significantly reduced the computational costs including elapsed time and maximum memory requirement. The results provide empirical reference for more cost-efficient metagenomic analyses in microbiome research.

Identifying and Removing Haplotypic Duplication in Primary Genome Assemblies

misFinder: identify mis-assemblies in an unbiased manner using reference and paired-end reads

Phasing or purging: tackling the genome assembly of a highly heterozygous animal species in the era of high-accuracy long reads

Fast characterization of segmental duplications in genome assemblies

AsmMix: an efficient haplotype-resolved hybrid de novo genome assembling pipeline

Klumpy: A Tool to Evaluate the Integrity of Long-Read Genome Assemblies and Illusive Sequence Motifs

Deduplication Improves Cost-Efficiency and Yields of<i>De novo</i>Assembly and Binning of Shot-Gun Metagenomes in Microbiome Research

Meraculous-2D: Haplotype-sensitive Assembly of Highly Heterozygous genomes

Accurate haplotype-resolved assembly reveals the origin of structural variants for human trios

Identifying the Causes and Consequences of Assembly Gaps Using a Multiplatform Genome Assembly of a Bird-of-paradise.

Highly accurate assembly polishing with DeepPolisher

Detecting Dispersed Duplications in High-Throughput Sequencing Data using a Database-Free Approach.

DEGAP: Dynamic elongation of a genome assembly path

Scalable telomere-to-telomere assembly for diploid and polyploid genomes with double graph

Klumpy: A tool to evaluate the integrity of long‐read genome assemblies and illusive sequence motifs

Gencore: an efficient tool to generate consensus reads for error suppressing and duplicate removing of NGS data

Chromosome-scale, haplotype-resolved assembly of human genomes

Pilon: An Integrated Tool for Comprehensive Microbial Variant Detection and Genome Assembly Improvement

Robust haplotype-resolved assembly of diploid individuals without parental data

Easing genomic surveillance: A comprehensive performance evaluation of long-read assemblers across multi-strain mixture data of HIV-1 and Other pathogenic viruses for constructing a user-friendly bioinformatic pipeline

Haplotype-resolved de novo assembly with phased assembly graphs