Abstract:High-dimensional data applications often entail the use of various statistical and machine-learning algorithms to identify an optimal signature based on biomarkers and other patient characteristics that predicts the desired clinical outcome in biomedical research. Both the composition and predictive performance of such biomarker signatures are critical in various biomedical research applications. In the presence of a large number of features, however, a conventional regression analysis approach fails to yield a good prediction model. A widely used remedy is to introduce regularization in fitting the relevant regression model. In particular, a L1 penalty on the regression coefficients is extremely useful, and very efficient numerical algorithms have been developed for fitting such models with different types of responses. This L1-based regularization tends to generate a parsimonious prediction model with promising prediction performance, i.e., feature selection is achieved along with construction of the prediction model. The variable selection, and hence the composition of the signature, as well as the prediction performance of the model depend on the choice of the penalty parameter used in the L1 regularization. The penalty parameter is often chosen by K-fold cross-validation. However, such an algorithm tends to be unstable and may yield very different choices of the penalty parameter across multiple runs on the same dataset. In addition, the predictive performance estimates from the internal cross-validation procedure in this algorithm tend to be inflated. In this paper, we propose a Monte Carlo approach to improve the robustness of regularization parameter selection, along with an additional cross-validation wrapper for objectively evaluating the predictive performance of the final model. We demonstrate the improvements via simulations and illustrate the application via a real dataset.

Latent Variable Selection for Multidimensional Item Response Theory Models via $$L_{1}$$ Regularization

Latent Variable Selection for Multidimensional Item Response Theory Models Via L-1 Regularization

Accelerating L1-penalized expectation maximization algorithm for latent variable selection in multidimensional two-parameter logistic models

Joint Maximum Likelihood Estimation for High-dimensional Exploratory Item Response Analysis

Joint Maximum Likelihood Estimation for High-Dimensional Exploratory Item Factor Analysis

Applying Unidimensional and Multidimensional Item Response Theory Models in Testlet-Based Reading Assessment

A Restricted Latent Class Model with Polytomous Attributes and Respondent-Level Covariates

Multidimensional item response theory models for testlet-based doubly bounded data

A Fused Latent and Graphical Model for Multivariate Binary Data

A Latent Trait Model for Multivariate Longitudinal Data With Two Sources of Measurement Error

Item-Weighted Likelihood Method for Measuring Growth in Longitudinal Study With Tests Composed of Both Dichotomous and Polytomous Items

Robust Measurement Via A Fused Latent and Graphical Item Response Theory Model

Sparse Bayesian Multidimensional Item Response Theory

The Improved EMS Algorithm for Latent Variable Selection in M3PL Model

Improving the Robustness of Variable Selection and Predictive Performance of Regularized Generalized Linear Models and Cox Proportional Hazard Models

Generalized Linear Latent Variable Modeling for Multi-Group Studies

Regularized Variational Estimation for Exploratory Item Factor Analysis

Bayesian Feature Extraction for Two-Part Latent Variable Model with Polytomous Manifestations

Mapping unobserved item-respondent interactions: A latent space item response model with interaction map

Multidimensional Item Response Theory in the Style of Collaborative Filtering

Latent Space Regularization for Recommender Systems.