Abstract:When fitting statistical models, some predictors are often found to be correlated with each other, and functioning together. Many group variable selection methods are developed to select the groups of predictors that are closely related to the continuous or categorical response. These existing methods usually assume the group structures are well known. For example, variables with similar practical meaning, or dummy variables created by categorical data. However, in practice, it is impractical to know the exact group structure, especially when the variable dimensional is large. As a result, the group variable selection results may be selected. To solve the challenge, we propose a two-stage approach that combines a variable clustering stage and a group variable stage for the group variable selection problem. The variable clustering stage uses information from the data to find a group structure, which improves the performance of the existing group variable selection methods. For ultrahigh dimensional data, where the predictors are much larger than observations, we incorporated a variable screening method in the first stage and shows the advantages of such an approach. In this article, we compared and discussed the performance of four existing group variable selection methods under different simulation models, with and without the variable clustering stage. The two-stage method shows a better performance, in terms of the prediction accuracy, as well as in the accuracy to select active predictors. An athlete's data is also used to show the advantages of the proposed method.

Variable Selection for Multivariate Functional Data Via Conditional Correlation Learning

Variable Selection for Multiple Function-on-Function Linear Regression

A Transparent and Nonlinear Method for Variable Selection

Nonlinear Multivariate Function-on-function Regression with Variable Selection

Variable Selection in Functional Linear Concurrent Regression

Variable Selection and Minimax Prediction in High-dimensional Functional Linear Model

A method for variable selection in a multivariate functional linear regression model

Estimation and Variable Selection for Generalized Functional Partially Varying Coefficient Hybrid Models

Variable selection in nonlinear function-on-scalar regression

Bayesian latent factor regression for multivariate functional data with variable selection

A Two-Stage Variable Selection Approach for Correlated High Dimensional Predictors

Functional variable selection via Gram–Schmidt orthogonalization for multiple functional linear regression

Estimation and Model Selection for Nonparametric Function-on-Function Regression

Partially Functional Linear Regression in High Dimensions

Variable Selection Based on Random Vector Functional-Link in Soft Sensor Modeling

Some Aspects of Response Variable Selection and Estimation in Multivariate Linear Regression

Group Variable Selection for Data with Dependent Structures

Regularization and variable selection for data with interdependent structures

A Unified Variable Selection Approach for Varying Coefficient Models

Simultaneous Selection of Predictors and Responses for High Dimensional Multivariate Linear Regression

Variable Selection Using Nonlocal Priors in High-Dimensional Generalized Linear Models With Application to fMRI Data Analysis