Abstract:Information theory has been widely used to evaluate the relevance and redundancy of features in feature selection. The traditional feature selection methods based on information theory focus on classification-specific feature selection. Classification-specific feature selection considers all classes together and therefore may not be able to select a desirable feature subset for a particular class. In contrast, class-specific feature selection can choose an appropriate feature subset for each class. The main goal of this paper is to propose a class-specific feature selection method based on information theory. In this regard, we first develop a class-specific feature evaluation criterion called Class-Specific Maximal Dynamic Correlation Change and Minimal Redundancy (CSMDCCMR), which consists of three items. The first item characterizes the correlation between a candidate feature and a particular class. The second item quantifies the dynamic changes in the relevance of a candidate feature and selected features with respect to a particular class. The third item expresses the redundancy between a candidate feature and selected features with respect to a particular class. We then design a class-specific feature selection algorithm by combining the CSMDCCMR criterion with a sequential forward search strategy, which can be employed to select a suitable feature subset for each class. Finally, we carry out extensive experiments to compare our class-specific feature selection method with nine representative classification-specific feature selection methods based on information theory and six state-of-the-art class-specific feature selection methods. The experimental results show that our class-specific feature selection method achieves better classification performance than these comparison methods.

A Feature Selection Algorithm Combining Within-Class Variance with Correlation Measure

An efficient algorithm for feature selection with feature correlation

Gene Selection Algorithm Based on Correlation Analysis

Improved Feature Selection Algorithm Based on Svm and Correlation

A Variance Minimization Criterion to Feature Selection Using Laplacian Regularization

A kernel-based multivariate feature selection method for microarray data classification.

An improved nonlinear correlation method for feature selection of complex data

A Hybrid Feature Selection Approach by Correlation-Based Filters and SVM-RFE

Class-specific feature selection via maximal dynamic correlation change and minimal redundancy

A new filter feature selection algorithm for classification task by ensembling pearson correlation coefficient and mutual information

Feature selection based on mutual information with correlation coefficient

Feature Selection Method Based on Differential Correlation Information Entropy

Supervised Feature Selection by Preserving Class Correlation

A Feature Selection Method Using Conditional Correlation Dispersion and Redundancy Analysis

An Improved Feature Selection Algorithm Utilizing the Within Category Variance

Feature selection based on network maximal correlation

Improved Kernel Minimum Squared Error Method and Its Implementations

Feature Selection Based on the Measurement of Correlation Information Entropy

A feature selection approach to estimate discrimination capability of feature subset category

Covariance-enhanced Discriminant Analysis.