Abstract:Background Our understanding of the composition, function, and health implications of human microbiota has been advanced by high-throughput sequencing and the development of new genomic analyses. However, trade-offs among alternative strategies for the acquisition and analysis of sequence data remain understudied. Methods We assessed eight popular taxonomic profiling pipelines; MetaPhlAn2, metaMix, PathoScope 2.0, Sigma, Kraken, ConStrains, Centrifuge and Taxator-tk, against a battery of metagenomic datasets simulated from real data. The metagenomic datasets were modeled on 426 complete or permanent draft genomes stored in the Human Oral Microbiome Database and were designed to simulate various experimental conditions, both in the design of a putative experiment; read length (75–1,000 bp reads), sequence depth (100K–10M), and in metagenomic composition; number of species present (10, 100, 426), species distribution. The sensitivity and specificity of each of the pipelines under various scenarios were measured. We also estimated the relative root mean square error and average relative error to assess the abundance estimates produced by different methods. Additional datasets were generated for five of the pipelines to simulate the presence within a metagenome of an unreferenced species, closely related to other referenced species. Additional datasets were also generated in order to measure computational time on datasets of ever-increasing sequencing depth (up to 6 × 10 7 ). Results Testing of eight pipelines against 144 simulated metagenomic datasets initially produced 1,104 discrete results. Pipelines using a marker gene strategy; MetaPhlAn2 and ConStrains, were overall less sensitive, than other pipelines; with the notable exception of Taxator-tk. This difference in sensitivity was largely made up in terms of runtime, significantly lower than more sensitive pipelines that rely on whole-genome alignments such as PathoScope2.0. However, pipelines that used strategies to speed-up alignment between genomic references and metagenomic reads, such as kmerization, were able to combine both high sensitivity and low run time, as is the case with Kraken and Centrifuge. Absent species genomes in the database mostly led to assignment of reads to the most closely related species available in all pipelines. Our results therefore suggest that taxonomic profilers that use kmerization have largely superseded those that use gene markers, coupling low run times with high sensitivity and specificity. Taxonomic profilers using more time-consuming read reassignment, such as PathoScope 2.0, provided the most sensitive profiles under common metagenomic sequencing scenarios. All the results described and discussed in this paper can be visualized using the dedicated R Shiny application ( https://github.com/microgenomics/HumanMicrobiomeAnalysis ). All of our datasets, pipelines and results are made available through the GitHub repository for future benchmarking.

A Question Seeking for an Answer: Use of T-tube in the Era of Liver Transplantation With Grafts From Extended Criteria Donors and Donors After Cardiac Death.

Intestinal Blastocystis is linked to healthier diets and more favorable cardiometabolic outcomes in 56,989 individuals from 32 countries

Human papilloma virus status and chromosomal imbalances in primary cervical carcinomas and tumour cell lines.

Changes in the Human Gut Microbiota Associated With Colonization by Blastocystis sp. and Entamoeba spp. in Non-Industrialized Populations

Gut microbiome diversity detected by high-coverage 16S and shotgun sequencing of paired stool and colon sample

Investigation of gut microbiota composition in humans carrying blastocystis subtypes 1 and 2 and Entamoeba hartmanni

Characterization of the Gut Microbiome Using 16S or Shotgun Metagenomics

An Introduction to Next Generation Sequencing Bioinformatic Analysis in Gut Microbiome Studies

Presence of Blastocystis in gut microbiota is associated with cognitive traits and decreased executive function

Molecular Identification and Subtype Analysis of Blastocystis sp. Isolates from Wild Mussels (Mytilus edulis) in Northern France

Mind the Gap: New Full-Length Sequences of Blastocystis Subtypes Generated via Oxford Nanopore Minion Sequencing Allow for Comparisons between Full-Length and Partial Sequences of the Small Subunit of the Ribosomal RNA Gene

The impact of antibiotics on the presence of the protozoan anaerobe Blastocystis and the surrounding microbiome: a case study

Nasal Septal Anatomy in Skeletally Mature Patients With Cleft Lip and Palate.

Blastocystis: A Mysterious Member of the Gut Microbiome

Methodology challenges in studying human gut microbiota – effects of collection, storage, DNA extraction and next generation sequencing technologies

How mass spectrometric approaches applied to bacterial identification have revolutionized the study of human gut microbiota

Distinct Human Gut Microbial Taxonomic Signatures Uncovered With Different Sample Processing and Microbial Cell Disruption Methods for Metaproteomic Analysis

Intestinal microbiota analysis of different Blastocystis subtypes and Blastocystis-negative individuals in Taiwan

Evaluation of computational methods for human microbiome analysis using simulated data

Metabolomic Analysis of Human Fecal Microbiota: A Comparison of Feces-Derived Communities and Defined Mixed Communities

Capturing clinically relevant Campylobacter attributes through direct whole genome sequencing of stool