Abstract:When fitting statistical models, some predictors are often found to be correlated with each other, and functioning together. Many group variable selection methods are developed to select the groups of predictors that are closely related to the continuous or categorical response. These existing methods usually assume the group structures are well known. For example, variables with similar practical meaning, or dummy variables created by categorical data. However, in practice, it is impractical to know the exact group structure, especially when the variable dimensional is large. As a result, the group variable selection results may be selected. To solve the challenge, we propose a two-stage approach that combines a variable clustering stage and a group variable stage for the group variable selection problem. The variable clustering stage uses information from the data to find a group structure, which improves the performance of the existing group variable selection methods. For ultrahigh dimensional data, where the predictors are much larger than observations, we incorporated a variable screening method in the first stage and shows the advantages of such an approach. In this article, we compared and discussed the performance of four existing group variable selection methods under different simulation models, with and without the variable clustering stage. The two-stage method shows a better performance, in terms of the prediction accuracy, as well as in the accuracy to select active predictors. An athlete's data is also used to show the advantages of the proposed method.

Variable Selection for High Dimensional Gaussian Copula Regression Model: an Adaptive Hypothesis Testing Procedure.

Faithful Variable Screening for High-Dimensional Convex Regression

High Dimensional Gaussian Copula Graphical Model with Fdr Control

Variable Selection in High-Dimensional Error-in-Variables Models Via Controlling the False Discovery Proportion

Testing covariates in high-dimensional regression

A one-covariate-at-a-time multiple testing approach to variable selection in additive models

Variable Selection for High-dimensional Cox Model with Error Rate Control

Penalized Independence Rule for Testing High-Dimensional Hypotheses

Trade-off between predictive performance and FDR control for high-dimensional Gaussian model selection

Variable Selection in High-Dimensional Quantile Varying Coefficient Models

Variable Selection with Copula Entropy

E M ] 2 6 A pr 2 02 2 A One-Covariate-ata-Time Multiple Testing Approach to Variable Selection in Additive Models ∗

False discovery control for penalized variable selections with high-dimensional covariates.

Variable selection in censored quantile regression with high dimensional data

Simulation-Based Hypothesis Testing of High Dimensional Means Under Covariance Heterogeneity

A Two-Stage Variable Selection Approach for Correlated High Dimensional Predictors

Global and Simultaneous Hypothesis Testing for High-Dimensional Logistic Regression Models

High-dimensional variable selection accounting for heterogeneity in regression coefficients across multiple data sources

A One-Covariate-at-a-Time Method for Nonparametric Additive Models

Testing Covariates in High Dimension Linear Regression with Latent Factors

Variable Importance Assessments and Backward Variable Selection for High-Dimensional Data