Abstract:High-dimensional data applications often entail the use of various statistical and machine-learning algorithms to identify an optimal signature based on biomarkers and other patient characteristics that predicts the desired clinical outcome in biomedical research. Both the composition and predictive performance of such biomarker signatures are critical in various biomedical research applications. In the presence of a large number of features, however, a conventional regression analysis approach fails to yield a good prediction model. A widely used remedy is to introduce regularization in fitting the relevant regression model. In particular, a L1 penalty on the regression coefficients is extremely useful, and very efficient numerical algorithms have been developed for fitting such models with different types of responses. This L1-based regularization tends to generate a parsimonious prediction model with promising prediction performance, i.e., feature selection is achieved along with construction of the prediction model. The variable selection, and hence the composition of the signature, as well as the prediction performance of the model depend on the choice of the penalty parameter used in the L1 regularization. The penalty parameter is often chosen by K-fold cross-validation. However, such an algorithm tends to be unstable and may yield very different choices of the penalty parameter across multiple runs on the same dataset. In addition, the predictive performance estimates from the internal cross-validation procedure in this algorithm tend to be inflated. In this paper, we propose a Monte Carlo approach to improve the robustness of regularization parameter selection, along with an additional cross-validation wrapper for objectively evaluating the predictive performance of the final model. We demonstrate the improvements via simulations and illustrate the application via a real dataset.

A MODIFIED BIC TUNING PARAMETER SELECTOR FOR SICA-PENALIZED COX REGRESSION MODELS WITH DIVERGING DIMENSIONALITY

Variable Selection for Generalized Varying Coefficient Partially Linear Models with Diverging Number of Parameters

PENALIZED VARIABLE SELECTION PROCEDURE FOR COX MODELS WITH SEMIPARAMETRIC RELATIVE RISK

Tuning parameter selection for penalized likelihood estimation of inverse covariance matrix

Regularization and variable selection for infinite variance autoregressive models

Tuning parameter selection in high dimensional penalized likelihood

Tuning Parameter Selectors for the Smoothly Clipped Absolute Deviation Method.

Sica for Cox'S Proportional Hazards Model with A Diverging Number of Parameters

An ADMM with Continuation Algorithm for Non-Convex SICA-penalized Regression in High Dimensions

Shrinkage Tuning Parameter Selection with A Diverging Number of Parameters

Tuning Parameter Selection in Adaptive LASSO for Quantile Regression with Penal Data

A Primal Dual Active Set with Continuation Algorithm for High-Dimensional Nonconvex SICA-penalized Regression

Variable selection for semiparametric varying-coefficient spatial autoregressive models with a diverging number of parameters

Tuning parameter selection for the adaptive nuclear norm regularized trace regression

Improving the Robustness of Variable Selection and Predictive Performance of Regularized Generalized Linear Models and Cox Proportional Hazard Models

Variable Selection Via Generalized SELO-Penalized Cox Regression Models

Consistent Model Selection Procedure for Random Coefficient INAR Models

Variable Selection Using Penalized Empirical Likelihood

Globally consistent model selection in semi-parametric additive coefficient models

Efficient penalized estimating method in the partially varying-coefficient single-index model

Selection of tuning parameters in bridge regression models via Bayesian information criterion