Abstract:Microbial communities analysis is drawing growing attention due to the rapid development of high-throughput sequencing techniques nowadays. The observed data has the following typical characteristics: it is high-dimensional, compositional (lying in a simplex) and even would be leptokurtic and highly skewed due to the existence of overly abundant taxa, which makes the conventional correlation analysis infeasible to study the co-occurrence and co-exclusion relationship between microbial taxa. In this article, we address the challenges of covariance estimation for this kind of data. Assuming the basis covariance matrix lying in a well-recognized class of sparse covariance matrices, we adopt a proxy matrix known as centered log-ratio covariance matrix in the literature, which is approximately indistinguishable from the real basis covariance matrix as the dimensionality tends to infinity. We construct a Median-of-Means (MOM) estimator for the centered log-ratio covariance matrix and propose a thresholding procedure that is adaptive to the variability of individual entries. By imposing a much weaker finite fourth moment condition compared with the sub-Gaussianity condition in the literature, we derive the optimal rate of convergence under the spectral norm. In addition, we also provide theoretical guarantee on support recovery. The adaptive thresholding procedure of the MOM estimator is easy to implement and gains robustness when outliers or heavy-tailedness exist. Thorough simulation studies are conducted to show the advantages of the proposed procedure over some state-of-the-arts methods. At last, we apply the proposed method to analyze a microbiome dataset in human gut. The R script for implementing the method is available at <a class="link-external link-https" href="https://github.com/heyongstat/RCEC" rel="external noopener nofollow">this https URL</a>.

Large Covariance Estimation for Compositional Data Via Composition-Adjusted Thresholding

Sparse basis covariance matrix estimation for high dimensional compositional data via hard thresholding

Robust Covariance Matrix Estimation for High-Dimensional Compositional Data with Application to Sales Data Analysis

Direct covariance matrix estimation with compositional data

Robust Covariance Estimation for High-dimensional Compositional Data with Application to Microbial Communities Analysis

CARE: Large Precision Matrix Estimation for Compositional Data

Two-sample Tests of High-Dimensional Means for Compositional Data

On eigenvalues of sample covariance matrices based on high dimensional compositional data

A new robust covariance matrix estimation for high‐dimensional microbiome data

Large-Dimensional Positive Definite Covariance Estimation for High Frequency Data via Low-rank and Sparse Matrix Decomposition

gCoda: Conditional Dependence Network Inference for Compositional Data.

Variable Selection in Regression with Compositional Covariates

Adaptive Thresholding for Sparse Covariance Matrix Estimation

Multi-level Thresholding Test for High Dimensional Covariance Matrices

Covariance Matrix Estimation for High-Throughput Biomedical Data with Interconnected Communities

Spatial Hyperspheric Models for Compositional Data

Asymptotic Composite Estimation

Adaptive Functional Thresholding for Sparse Covariance Function Estimation in High Dimensions

Compositional Data Network Analysis via Lasso Penalized D-Trace Loss

On testing mean of high dimensional compositional data

High-dimensional count and compositional data analysis in\\ microbiome studies