Abstract:BackgroundMicrobiome studies incorporate next-generation sequencing to obtain profiles of microbial communities. Data generated from these experiments are high-dimensional with a rich correlation structure but modest sample sizes. A statistical model that utilizes these microbiome profiles to explain a clinical or biological endpoint needs to tackle high-dimensionality resulting from the very large space of variable configurations. Ensemble models are a class of approaches that can address high-dimensionality by aggregating information across large model spaces. Although such models are popular in fields as diverse as economics and genetics, their performance on microbiome data has been largely unexplored.ResultsWe developed a simulation framework that accurately captures the constraints of experimental microbiome data. Using this setup, we systematically evaluated a selection of both frequentist and Bayesian regression modeling ensembles. These are represented by variants of stability selection in conjunction with elastic net and spike-and-slab Bayesian model averaging (BMA), respectively. BMA ensembles that explore a larger space of models relative to stability selection variants performed better and had lower variability across simulations. However, stability selection ensembles were able to match the performance of BMA in scenarios of low sparsity where several variables had large regression coefficients.ConclusionsGiven a microbiome dataset of interest, we present a methodology to generate simulated data that closely mimics its characteristics in a manner that enables meaningful evaluation of analytical strategies. Our evaluation demonstrates that the largest ensembles yield the strongest performance on microbiome data with modest sample sizes and high-dimensional measurements. We also demonstrate the ability of these ensembles to identify microbiome signatures that are associated with opportunistic Candida albicans colonization during antibiotic exposure. As the focus of microbiome research evolves from pilot to translational studies, we anticipate that our strategy will aid investigators in making evaluation-based decisions for selecting appropriate analytical methods.

A new robust covariance matrix estimation for high‐dimensional microbiome data

Robust Covariance Estimation for High-dimensional Compositional Data with Application to Microbial Communities Analysis

Rank-based correlation matrix estimation for high dimensional microbiome data

Covariance Matrix Estimation for High-Throughput Biomedical Data with Interconnected Communities

Direct covariance matrix estimation with compositional data

Multi-sample Estimation of Bacterial Composition Matrix in Metagenomics Data

Large Covariance Estimation for Compositional Data Via Composition-Adjusted Thresholding

Joint Mean and Covariance Estimation with Unreplicated Matrix-Variate Data

Robust high-dimensional precision matrix estimation

A systematic evaluation of high-dimensional, ensemble-based regression for exploring large model spaces in microbiome analyses

A Zero-Inflated Logistic Normal Multinomial Model for Extracting Microbial Compositions

A Best Linear Empirical Bayes Method for High-Dimensional Covariance Matrix Estimation

Reference-Invariant Inverse Covariance Estimation with Application to Microbial Network Recovery

Multi-sample estimation of centered log-ratio matrix in microbiome studies

Robust Covariance Matrix Estimation for High-Dimensional Compositional Data with Application to Sales Data Analysis

A semi-parametric multiple imputation method for high-sparse, high-dimensional, compositional data

MZINBVA: Variational Approximation for Multilevel Zero-Inflated Negative-Binomial Models for Association Analysis in Microbiome Surveys

Estimation of the number of spiked eigenvalues in a covariance matrix by bulk eigenvalue matching analysis

Optimal Structured Matrix Approximation for Robustness to Incomplete Biosequence Data

Adaptive Thresholding for Sparse Covariance Matrix Estimation

Robust estimation of precision matrices under cellwise contamination