Abstract:When fitting statistical models, some predictors are often found to be correlated with each other, and functioning together. Many group variable selection methods are developed to select the groups of predictors that are closely related to the continuous or categorical response. These existing methods usually assume the group structures are well known. For example, variables with similar practical meaning, or dummy variables created by categorical data. However, in practice, it is impractical to know the exact group structure, especially when the variable dimensional is large. As a result, the group variable selection results may be selected. To solve the challenge, we propose a two-stage approach that combines a variable clustering stage and a group variable stage for the group variable selection problem. The variable clustering stage uses information from the data to find a group structure, which improves the performance of the existing group variable selection methods. For ultrahigh dimensional data, where the predictors are much larger than observations, we incorporated a variable screening method in the first stage and shows the advantages of such an approach. In this article, we compared and discussed the performance of four existing group variable selection methods under different simulation models, with and without the variable clustering stage. The two-stage method shows a better performance, in terms of the prediction accuracy, as well as in the accuracy to select active predictors. An athlete's data is also used to show the advantages of the proposed method.

E M ] 2 6 A pr 2 02 2 A One-Covariate-ata-Time Multiple Testing Approach to Variable Selection in Additive Models ∗

A one-covariate-at-a-time multiple testing approach to variable selection in additive models

A One-Covariate-at-a-Time Method for Nonparametric Additive Models

Variable selection in high dimensional linear regressions with parameter instability

Variable selection in partially time-varying coefficient models

Variable Selection for High Dimensional Gaussian Copula Regression Model: an Adaptive Hypothesis Testing Procedure.

Variable Selection for Additive Model Via Cumulative Ratios of Empirical Strengths Total

A Unified Variable Selection Approach for Varying Coefficient Models

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

PENALIZED VARIABLE SELECTION PROCEDURE FOR COX MODELS WITH SEMIPARAMETRIC RELATIVE RISK

Two-step estimation of high dimensional additive models

Individualized Multi-directional Variable Selection

Variable Selection in Robust Joint Mean and Covariance Model for Longitudinal Data Analysis

A Two-Stage Variable Selection Approach for Correlated High Dimensional Predictors

Robust Variable Selection Via Nonconcave Penalties with an Upgraded Parsimonious Dynamic Covariance Modeling

Testing covariates in high-dimensional regression

Nonparametric Additive Regression for High-Dimensional Group Testing Data

Variable selection in semiparametric regression modeling

High-dimensional variable selection accounting for heterogeneity in regression coefficients across multiple data sources

Variable selection and estimation for semi-parametric multiple-index models

Variable Selection in High-Dimensional Error-in-Variables Models Via Controlling the False Discovery Proportion