Abstract:High-dimensional data applications often entail the use of various statistical and machine-learning algorithms to identify an optimal signature based on biomarkers and other patient characteristics that predicts the desired clinical outcome in biomedical research. Both the composition and predictive performance of such biomarker signatures are critical in various biomedical research applications. In the presence of a large number of features, however, a conventional regression analysis approach fails to yield a good prediction model. A widely used remedy is to introduce regularization in fitting the relevant regression model. In particular, a L1 penalty on the regression coefficients is extremely useful, and very efficient numerical algorithms have been developed for fitting such models with different types of responses. This L1-based regularization tends to generate a parsimonious prediction model with promising prediction performance, i.e., feature selection is achieved along with construction of the prediction model. The variable selection, and hence the composition of the signature, as well as the prediction performance of the model depend on the choice of the penalty parameter used in the L1 regularization. The penalty parameter is often chosen by K-fold cross-validation. However, such an algorithm tends to be unstable and may yield very different choices of the penalty parameter across multiple runs on the same dataset. In addition, the predictive performance estimates from the internal cross-validation procedure in this algorithm tend to be inflated. In this paper, we propose a Monte Carlo approach to improve the robustness of regularization parameter selection, along with an additional cross-validation wrapper for objectively evaluating the predictive performance of the final model. We demonstrate the improvements via simulations and illustrate the application via a real dataset.

A Perturbation Method for Inference on Regularized Regression Estimates

Expectile regression for analyzing heteroscedasticity in high dimension

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Doubly Robust Semiparametric Inference Using Regularized Calibrated Estimation with High-dimensional Data

Shrinkage-based regularization tests for high-dimensional data with application to gene set analysis

Improving the Robustness of Variable Selection and Predictive Performance of Regularized Generalized Linear Models and Cox Proportional Hazard Models

Estimation of Error Variance in Regularized Regression Models Via Adaptive Lasso

One-Step Regularized Estimator for High-Dimensional Regression Models

Model-assisted inference for treatment effects using regularized calibrated estimation with high-dimensional data

Feature‐specific inference for penalized regression using local false discovery rates

Targeted Inference Involving High-Dimensional Data Using Nuisance Penalized Regression

A General Framework for Robust Testing and Confidence Regions in High-Dimensional Quantile Regression

Efficient Inference on High-Dimensional Linear Models with Missing Outcomes

Optimal Semi-supervised Estimation and Inference for High-dimensional Linear Regression

Regularization Methods for High-Dimensional Instrumental Variables Regression With an Application to Genetical Genomics

Inference in Perturbation Models, Finite Mixtures and Scan Statistics: The Volume-of-Tube Formula

Is Seeing Believing? A Practitioner's Perspective on High-Dimensional Statistical Inference in Cancer Genomics Studies

Inference for possibly misspecified generalized linear models with nonpolynomial-dimensional nuisance parameters

Statistical Inference and Large-scale Multiple Testing for High-dimensional Regression Models

A Regularization-Based Adaptive Test for High-Dimensional Generalized Linear Models

Penalized Sparse Covariance Regression with High Dimensional Covariates