Abstract:In high-dimensional data modeling, variable selection plays a crucial role in improving predictive accuracy and enhancing model interpretability through sparse representation. Unfortunately, certain variable selection methods encounter challenges such as insufficient model sparsity, high computational overhead, and difficulties in handling large-scale data. Recently, axis-aligned random projection techniques have been applied to address these issues by selecting variables. However, these techniques have seen limited application in handling complex data within the regression framework. In this study, we propose a novel method, sparse partial least squares via axis-aligned random projection, designed for the analysis of high-dimensional data. Initially, axis-aligned random projection is utilized to obtain a sparse loading vector, significantly reducing computational complexity. Subsequently, partial least squares regression is conducted within the subspace of the top-ranked significant variables. The submatrices are iteratively updated until an optimal sparse partial least squares model is achieved. Comparative analysis with some state-of-the-art high-dimensional regression methods demonstrates that the proposed method exhibits superior predictive performance. To illustrate its effectiveness, we apply the method to four cases, including one simulated dataset and three real-world datasets. The results show the proposed method's ability to identify important variables in all four cases.

Variable Selection in High-Dimensional Sparse Multiresponse Linear Regression Models

Faithful Variable Screening for High-Dimensional Convex Regression

Some Aspects of Response Variable Selection and Estimation in Multivariate Linear Regression

Response Best-Subset Selector for Multivariate Regression with High-Dimensional Response Variables

Simultaneous Selection of Predictors and Responses for High Dimensional Multivariate Linear Regression

Variable selection using axis-aligned random projections for partial least-squares regression

Bayesian variable selection in linear regression models with instrumental variables

Forward Variable Selection for Sparse Ultra-High Dimensional Varying Coefficient Models

Variable Selection in High-Dimensional Quantile Varying Coefficient Models

Variable selection for both outcomes and predictors: sparse multivariate principal covariates regression

Variable Selection for High Dimensional Partially Linear Varying Coefficient Errors-in-variables Models

Variable selection for partially linear models via Bayesian subset modeling with diffusing prior

Variable Selection in High-dimensional Partially Linear Models

Ultrahigh dimensional variable selection: beyond the linear model

Sparse partial least squares regression for simultaneous dimension reduction and variable selection

VARIABLE SELECTION IN SPARSE REGRESSION WITH QUADRATIC MEASUREMENTS

Robust exponential squared loss-based variable selection for high-dimensional single-index varying-coefficient model

Sparse Variable Selection on High Dimensional Heterogeneous Data With Tree Structured Responses

Sparse Bayesian Variable Selection in Multinomial Probit Regression Model with Application to High-Dimensional Data Classification

Automatic Variable Selection for High-Dimensional Linear Models with Longitudinal Data

A Transparent and Nonlinear Method for Variable Selection