Abstract:Background: Recent advances in next-generation sequencing (NGS) technology enable researchers to collect a large volume of microbiome data. Microbiome data consist of operational taxonomic unit (OTU) count data characterized by zero-inflation, over-dispersion, and grouping structure among the sample. Currently, statistical testing methods based on generalized linear mixed effect models (GLMM) are commonly performed to identify OTUs that are associated with a phenotype such as human diseases or plant traits. There are a number of limitations for statistical testing methods including these two: (1) the validity of p-value/q-value depends sensitively on the correctness of models, and (2) the statistical significance does not necessarily imply predictivity. Statistic testing methods depend on model correctness and attempt to select ”marginally relevant” features, not the most predictive ones. Predictive analysis using methods such as LASSO is an alternative approach for feature selection. To the best of our knowledge, this approach has not been used widely for analyzing microbiome data. Methodology: We use four synthetic datasets simulated from zero-inflated negative binomial distribution and a real human gut microbiome data to compare the feature selection performance of LASSO with the likelihood ratio test methods applied to GLMMs. We also investigate the performance of cross-validation in estimating the out-of-sample predictivity of selected features in zero-inflated data. Results: Our studies with synthetic datasets show that the feature selection performance of LASSO is remarkably excellent in zero-inflated data and is comparable with the likelihood ratio test applied to the true data generating model. The feature selection performance of LASSO is better when the distributions of counts are more differentiated by the phenotype, which is a categorical variable in our synthetic datasets. In addition, we performed LOOCV on the train set and out-of-sample prediction on the test set. The performance of the cross-validatory (CV) predictive measures are very close to the out-of-sample predictivity measures. This indicates that LOOCV predictive metrics provide honest measures of the predictivity of the features selected by LASSO. Therefore, the CV predictive measures are good guidance for choosing cutoffs (shrinkage parameter $\lambda$) in selecting features with LASSO. By contrast, when wrong models are fitted to a dataset, the differences between the q-values and the actual false discovery rates are huge; hence, their q-values are tremendously misleading for selecting features. Our comparison of LASSO and statistical testing methods (likelihood ratio test in our analysis) in the real dataset shows that small q-values do not necessarily imply high predictivity of the selected OTUs. However, the researchers often use q-values to find the predictors. That is why we need to look at q-values carefully. Conclusions: Statistical testing methods perform greatly in zero-inflated datasets on both synthetic and real…

Enhanced Feature Selection for Microbiome Data Using FLORAL: Scalable Log-ratio Lasso Regression.

EXPLANA: A user-friendly workflow for EXPLoratory ANAlysis and feature selection in cross-sectional and longitudinal microbiome studies

Unbiased Prediction and Feature Selection in High-Dimensional Survival Regression

Longitudinal Microbiome-based Interpretable Machine Learning for Identification of Time-Varying Biomarkers in Early Prediction of Disease Outcomes

A Hybrid Feature Selection Algorithm and Its Application in Bioinformatics

Comparison of Statistical Testing and Predictive Analysis Methods for Feature Selection in Zero-inflated Microbiome Data

GEE-TGDR: A Longitudinal Feature Selection Algorithm and Its Application to lncRNA Expression Profiles for Psoriasis Patients Treated with Immune Therapies

A distributed feature selection pipeline for survival analysis using radiomics in non-small cell lung cancer patients

Robust prediction of colorectal cancer via gut microbiome 16S rRNA sequencing data

SuRF: a New Method for Sparse Variable Selection, with Application in Microbiome Data Analysis

A Novel Feature Selection Method Based on MRMR and Enhanced Flower Pollination Algorithm for High Dimensional Biomedical Data

Robust biomarker screening from gene expression data by stable machine learning-recursive feature elimination methods

Randomized feature selection based semi-supervised latent Dirichlet allocation for microbiome analysis

Abstract 1615: Balanced molecular feature selection unveils universally tumor-lineage informative methylation sites in colorectal cancer

Identifying Diagnostic Biomarkers of Breast Cancer Based on Gene Expression Data and Ensemble Feature Selection

Using Machine Learning Methods to Study Colorectal Cancer Tumor Micro-Environment and Its Biomarkers.

Multi-scale supervised clustering-based feature selection for tumor classification and identification of biomarkers and targets on genomic data

Sparse distance-based learning for simultaneous multiclass classification and feature selection of metagenomic data

Integrative survival analysis of breast cancer with gene expression and DNA methylation data

LRBmat: A Novel Gut Microbial Interaction and Individual Heterogeneity Inference Method for Colorectal Cancer

Generalized Methodology for Radiomic Feature Selection and Modeling in Predicting Clinical Outcomes.