Abstract:Abstract Motivation Microbiome data have proven extremely useful for understanding microbial communities and their impacts in health and disease. Although microbiome analysis methods and standards are evolving rapidly, obtaining meaningful and interpretable results from microbiome studies still requires careful statistical treatment. In particular, many existing and emerging methods for differential abundance (DA) analysis fail to account for the fact that microbiome data are high-dimensional and sparse, compositional, negatively and positively correlated and phylogenetically structured. To better describe microbiome data and improve the power of DA testing, there is still a great need for the continued development of appropriate statistical methodology. Results In this article, we propose a model-based approach for microbiome data transformation, and a phylogenetically informed procedure for DA testing based on the transformed data. First, we extend the Dirichlet-tree multinomial (DTM) to zero-inflated DTM for multivariate modeling of microbial counts, addressing data sparsity and correlation and phylogeny among bacterial taxa. Then, within this framework and using a Bayesian formulation, we introduce posterior mean transformation to convert raw counts into non-zero relative abundances that sum to one, accounting for the compositionality nature of microbiome data. Second, using the transformed data, we propose adaptive analysis of composition of microbiomes (adaANCOM) for DA testing by constructing log-ratios adaptively on the tree for each taxon, greatly reducing the computational complexity of ANCOM in high dimensions. Finally, we present extensive simulation studies, an analysis of HMP data across 18 body sites and 2 visits, and an application to a gut microbiome and malnutrition study, to investigate the performance of posterior mean transformation and adaANCOM. Comparisons with ANCOM and other DA testing procedures show that adaANCOM controls the false discovery rate well, allows for easy interpretation of the results, and is computationally efficient for high-dimensional problems. Availability and implementation The developed R package is available at https://github.com/ZRChao/adaANCOM. For replicability purposes, scripts for our simulations and data analysis are available at https://github.com/ZRChao/Papers_supplementary. Supplementary information Supplementary data are available at Bioinformatics online.

A phylogenetic scan test on Dirichlet-tree multinomial model for microbiome data

Dirichlet-tree multinomial mixtures for clustering microbiome compositions

Transformation and differential abundance analysis of microbiome data incorporating phylogeny

A Model for Paired-Multinomial Data and Its Application to Analysis of Data on a Taxonomic Tree

A Dirichlet‐tree Multinomial Regression Model for Associating Dietary Nutrients with Gut Microorganisms

Mixed Effect Dirichlet-Tree Multinomial for Longitudinal Microbiome Data and Weight Prediction

A nonparametric spatial test to identify factors that shape a microbiome

An integrative Bayesian Dirichlet-multinomial regression model for the analysis of taxonomic abundances in microbiome data

Variable selection for sparse Dirichlet-multinomial regression with an application to microbiome data analysis

An Adaptive Independence Test for Microbiome Community Data.

An Empirical Bayes Approach to Normalization and Differential Abundance Testing for Microbiome Data

Bayesian Modeling of Microbiome Data for Differential Abundance Analysis

Dirichlet distribution parameter estimation with applications in microbiome analyses

Cluster analysis of microbiome data by using mixtures of Dirichlet–multinomial regression models

Sparse tree-based clustering of microbiome data to characterize microbiome heterogeneity in pancreatic cancer

A Small-Sample Multivariate Kernel Machine Test for Microbiome Association Studies

Bayesian graphical compositional regression for microbiome data

mi-Mic: a novel multi-layer statistical test for microbiota-disease associations

phyloMDA: an R package for phylogeny-aware microbiome data analysis

A Powerful Adaptive Microbiome-Based Association Test for Microbial Association Signals with Diverse Sparsity Levels

Testing for differential abundance in compositional counts data, with application to microbiome studies