Abstract:When fitting statistical models, some predictors are often found to be correlated with each other, and functioning together. Many group variable selection methods are developed to select the groups of predictors that are closely related to the continuous or categorical response. These existing methods usually assume the group structures are well known. For example, variables with similar practical meaning, or dummy variables created by categorical data. However, in practice, it is impractical to know the exact group structure, especially when the variable dimensional is large. As a result, the group variable selection results may be selected. To solve the challenge, we propose a two-stage approach that combines a variable clustering stage and a group variable stage for the group variable selection problem. The variable clustering stage uses information from the data to find a group structure, which improves the performance of the existing group variable selection methods. For ultrahigh dimensional data, where the predictors are much larger than observations, we incorporated a variable screening method in the first stage and shows the advantages of such an approach. In this article, we compared and discussed the performance of four existing group variable selection methods under different simulation models, with and without the variable clustering stage. The two-stage method shows a better performance, in terms of the prediction accuracy, as well as in the accuracy to select active predictors. An athlete's data is also used to show the advantages of the proposed method.

Quantile Correlation-based Variable Selection

Screen then select: a strategy for correlated predictors in high-dimensional quantile regression

Variable Selection in High-Dimensional Quantile Varying Coefficient Models

Nonparametric screening for additive quantile regression in ultra-high dimension

Quantile Screening for Ultra-High-dimensional Heterogeneous Data Conditional on Some Variables

Conditional Quantile Correlation Screening Procedure for Ultrahigh-Dimensional Varying Coefficient Models

SCAD‐penalized Quantile Regression for High‐dimensional Data Analysis and Variable Selection

Variable selection in censored quantile regression with high dimensional data

Smoothed Quantile Regression with Factor-Augmented Regularized Variable Selection for High Correlated Data

Quantile-adaptive variable screening in ultra-high dimensional varying coefficient models

A Note on Quantile Feature Screening Via Distance Correlation

Model-Free Feature Screening Via A Modified Composite Quantile Correlation

Screening and Selection for Quantile Regression Using an Alternative Measure of Variable Importance.

Quantile Correlation‐Based Sufficient Variable Screening by Controlling False Discovery Rate

Variable Selection For Ultra-High Dimensional Quantile Regression With Missing Data And Measurement Error

Ultrahigh dimensional variable selection: beyond the linear model

Robust Feature Screening for Varying Coefficient Models Via Quantile Partial Correlation

Empirical Likelihood Based Tests for Detecting the Presence of Significant Predictors in Marginal Quantile Regression

A Two-Stage Variable Selection Approach for Correlated High Dimensional Predictors

Quantile Regression and Variable Selection for Single-Index Varying-Coefficient Models

Incorporating Graphical Structure of Predictors in Sparse Quantile Regression