Abstract:Currently, most of the ultra-high-dimensional feature screening methods for categorical data are based on the correlation between covariates and response variables, using some statistics as the screening index to screen important covariates. Thus, with the increasing number of data types and model availability limitations, there may be a potential problem with the existence of a class of unimportant covariates that are also highly correlated with the response variable due to their high correlation with the other covariates. To address this issue, in this paper, we establish a model-free feature screening procedure for binary categorical response variables from the perspective of the contribution of features to classification. The idea is to introduce the Jensen-Shannon divergence to measure the difference between the conditional probability distributions of the covariates when the response variables take on different values. The larger the value of the Jensen-Shannon divergence, the stronger the covariate's contribution to the classification of the response variable, and the more important the covariate is. We propose two kinds of model-free ultra-high-dimensional feature screening methods for binary response data. Meanwhile, the methods are suitable for continuous or categorical covariates. When the numbers of covariate categories are the same, the feature screening is based on traditional Jensen-Shannon divergence. When the numbers of covariate categories are different, the Jensen-Shannon divergence is adjusted using the logarithmic factor of the number of categories. We theoretically prove that the proposed methods have sure screening and ranking consistency properties, and through simulations and real data analysis, we demonstrate that, in feature screening, the approaches proposed in this paper have the advantages of effectiveness, stability, and less computing time compared with an existing method.

Strong Sure Screening of Ultra-high Dimensional Categorical Data

Feature Screening for Ultrahigh Dimensional Categorical Data with Applications

Model-Free Feature Screening for Ultrahigh Dimensional Discriminant Analysis

Category-Adaptive Variable Screening for Ultra-High Dimensional Heterogeneous Categorical Data

Feature Screening for Ultrahigh-dimensional Censored Data with Varying Coefficient Single-index Model

Strong Sure Screening of Ultra-high Dimensional Data with Interaction Effects

A New Robust Model-Free Feature Screening Method for Ultra-High Dimensional Right Censored Data

Ultra-high-dimensional feature screening of binary categorical response data based on Jensen-Shannon divergence

Feature Screening for Nonparametric and Semiparametric Models with Ultrahigh-Dimensional Covariates

Model-free Feature Screening for Ultrahigh Dimensional Censored Regression.

Spearman Rank Correlation Screening for Ultrahigh-dimensional Censored Data

Model-free Feature Screening for Ultrahigh Dimensional Data Via a Pearson Chi-Square Based Index

Efficient Feature Screening for Ultrahigh-Dimensional Varying Coefficient Models

Feature screening for ultrahigh-dimensional binary classification via linear projection

Sure Independence Screening Adjusted for Confounding Covariates with Ultrahigh-dimensional Data

A New Model-Free Feature Screening Procedure for Ultrahigh-Dimensional Interval-Censored Failure Time Data

Partition-based Feature Screening for Categorical Data Via RKHS Embeddings

Robust Variable Screening for Ultrahigh Dimensional

Joint Feature Screening for Ultra-High-dimensional Sparse Additive Hazards Model by the Sparsity-Restricted Pseudo-Score Estimator

A modified mean-variance feature-screening procedure for ultrahigh-dimensional discriminant analysis

Feature Screening in High Dimensional Regression with Endogenous Covariates