Abstract:Abstract Motivation Microbiome data have proven extremely useful for understanding microbial communities and their impacts in health and disease. Although microbiome analysis methods and standards are evolving rapidly, obtaining meaningful and interpretable results from microbiome studies still requires careful statistical treatment. In particular, many existing and emerging methods for differential abundance (DA) analysis fail to account for the fact that microbiome data are high-dimensional and sparse, compositional, negatively and positively correlated and phylogenetically structured. To better describe microbiome data and improve the power of DA testing, there is still a great need for the continued development of appropriate statistical methodology. Results In this article, we propose a model-based approach for microbiome data transformation, and a phylogenetically informed procedure for DA testing based on the transformed data. First, we extend the Dirichlet-tree multinomial (DTM) to zero-inflated DTM for multivariate modeling of microbial counts, addressing data sparsity and correlation and phylogeny among bacterial taxa. Then, within this framework and using a Bayesian formulation, we introduce posterior mean transformation to convert raw counts into non-zero relative abundances that sum to one, accounting for the compositionality nature of microbiome data. Second, using the transformed data, we propose adaptive analysis of composition of microbiomes (adaANCOM) for DA testing by constructing log-ratios adaptively on the tree for each taxon, greatly reducing the computational complexity of ANCOM in high dimensions. Finally, we present extensive simulation studies, an analysis of HMP data across 18 body sites and 2 visits, and an application to a gut microbiome and malnutrition study, to investigate the performance of posterior mean transformation and adaANCOM. Comparisons with ANCOM and other DA testing procedures show that adaANCOM controls the false discovery rate well, allows for easy interpretation of the results, and is computationally efficient for high-dimensional problems. Availability and implementation The developed R package is available at https://github.com/ZRChao/adaANCOM. For replicability purposes, scripts for our simulations and data analysis are available at https://github.com/ZRChao/Papers_supplementary. Supplementary information Supplementary data are available at Bioinformatics online.

Proportion-based normalizations outperform compositional data transformations in machine learning applications

Methods for normalizing microbiome data: An ecological perspective

Group-wise normalization in differential abundance analysis of microbiome samples

Normalization Methods for High-Density Oligonucleotide Microarray Data

Compositional transformations can reasonably introduce phenotype-associated values into sparse features

Normality Assessment of Several Quantitative Data Transformation Procedures

Amalgamations are valid in compositional data analysis, can be used in agglomerative clustering, and their logratios have an inverse transformation

On the distribution of isometric log-ratio transformations under extra-multinomial count data

Multi-sample estimation of centered log-ratio matrix in microbiome studies

Transformation and differential abundance analysis of microbiome data incorporating phylogeny

It's All Relative: New Regression Paradigm for Microbiome Compositional Data

Comparison of the effectiveness of different normalization methods for metagenomic cross-study phenotype prediction under heterogeneity

Beyond Normalization: Incorporating Scale Uncertainty in Microbiome and Gene Expression Analysis

Normalizing need not be the norm: count-based math for analyzing single-cell data

Empirical observations on the effects of data transformation in machine learning classification of geological domains

The chiPower transformation: a valid alternative to logratio transformations in compositional data analysis

TaxaNorm: a novel taxa-specific normalization approach for microbiome data

A Logistic Normal Multinomial Regression Model for Microbiome Compositional Data Analysis

Statistical Applications in Genetics and Molecular Biology

Microarray data normalization and transformation

Waste Not, Want Not: Why Rarefying Microbiome Data is Inadmissible