Abstract:Abstract Motivation The automatic discovery of sparse biomarkers that are associated with an outcome of interest is a central goal of bioinformatics. In the context of high-throughput sequencing (HTS) data, and compositional data (CoDa) more generally, an important class of biomarkers are the log-ratios between the input variables. However, identifying predictive log-ratio biomarkers from HTS data is a combinatorial optimization problem, which is computationally challenging. Existing methods are slow to run and scale poorly with the dimension of the input, which has limited their application to low- and moderate-dimensional metagenomic datasets. Results Building on recent advances from the field of deep learning, we present CoDaCoRe, a novel learning algorithm that identifies sparse, interpretable and predictive log-ratio biomarkers. Our algorithm exploits a continuous relaxation to approximate the underlying combinatorial optimization problem. This relaxation can then be optimized efficiently using the modern ML toolbox, in particular, gradient descent. As a result, CoDaCoRe runs several orders of magnitude faster than competing methods, all while achieving state-of-the-art performance in terms of predictive accuracy and sparsity. We verify the outperformance of CoDaCoRe across a wide range of microbiome, metabolite and microRNA benchmark datasets, as well as a particularly high-dimensional dataset that is outright computationally intractable for existing sparse log-ratio selection methods. Availability and implementation The CoDaCoRe package is available at https://github.com/egr95/R-codacore. Code and instructions for reproducing our results are available at https://github.com/cunningham-lab/codacore. Supplementary information Supplementary data are available at Bioinformatics online.

Log-ratio Lasso: Scalable, Sparse Estimation for Log-ratio Models

Average case analysis of Lasso under ultra-sparse conditions

Weighted LASSO for Sparse Recovery with Statistical Prior Support Information

Learning sparse log-ratios for high-throughput sequencing data

Sparsity and smoothness via the fused lasso

Sparse Private LASSO Logistic Regression

Robust adaptive LASSO in high-dimensional logistic regression

New Error Analysis for Lasso

Lasso with Latents: Efficient Estimation, Covariate Rescaling, and Computational-Statistical Gaps

A Fast Solution to the Lasso Problem with Equality Constraints

Ranked Sparsity: A Cogent Regularization Framework for Selecting and Estimating Feature Interactions and Polynomials

A cost-sensitive constrained Lasso

Lasso Regression: Estimation and Shrinkage via Limit of Gibbs Sampling

Weighted Lasso Estimates for Sparse Logistic Regression: Non-Asymptotic Properties with Measurement Errors

Graph-Sparse Logistic Regression

Asymptotic Properties of Lasso+mLS and Lasso+Ridge in Sparse High-Dimensional Linear Regression

A Fast Method for Lasso and Logistic Lasso

Robust Linear Discriminant Analysis Using Ratio Minimization of L1,2-Norms

Robust Fused Lasso Penalized Huber Regression with Nonasymptotic Property and Implementation Studies

Safe Feature Elimination for the LASSO and Sparse Supervised Learning Problems

A Safe Screening Rule for Sparse Logistic Regression