Abstract:Information theory has been widely used to evaluate the relevance and redundancy of features in feature selection. The traditional feature selection methods based on information theory focus on classification-specific feature selection. Classification-specific feature selection considers all classes together and therefore may not be able to select a desirable feature subset for a particular class. In contrast, class-specific feature selection can choose an appropriate feature subset for each class. The main goal of this paper is to propose a class-specific feature selection method based on information theory. In this regard, we first develop a class-specific feature evaluation criterion called Class-Specific Maximal Dynamic Correlation Change and Minimal Redundancy (CSMDCCMR), which consists of three items. The first item characterizes the correlation between a candidate feature and a particular class. The second item quantifies the dynamic changes in the relevance of a candidate feature and selected features with respect to a particular class. The third item expresses the redundancy between a candidate feature and selected features with respect to a particular class. We then design a class-specific feature selection algorithm by combining the CSMDCCMR criterion with a sequential forward search strategy, which can be employed to select a suitable feature subset for each class. Finally, we carry out extensive experiments to compare our class-specific feature selection method with nine representative classification-specific feature selection methods based on information theory and six state-of-the-art class-specific feature selection methods. The experimental results show that our class-specific feature selection method achieves better classification performance than these comparison methods.

Feature selection using max dynamic relevancy and min redundancy

Dynamic Interaction-Based Feature Selection Algorithm for Maximal Relevance Minimal Redundancy

Feature Selection with Conditional Mutual Information Considering Feature Interaction

A feature selection algorithm based on redundancy analysis and interaction weight

A New Method for Redundancy Analysis in Feature Selection

Feature Selection Considering Two Types of Feature Relevancy and Feature Interdependency.

Feature Redundancy Term Variation for Mutual Information-Based Feature Selection

An Enhanced Feature Selection Algorithm Based on Maximum Relevance Minimum Redundancy and Splicing Strategy1

Class-specific feature selection via maximal dynamic correlation change and minimal redundancy

Feature selection using dynamic weights for classification

Fuzzy Mutual Information Based Min-Redundancy and Max-Relevance Heterogeneous Feature Selection

Feature Selection with Maximal Relevance and Minimal Supervised Redundancy

Fuzzy Entropy Based Max-Relevancy and Min-Redundancy Feature Selection.

A Feature Selection Method Using Conditional Correlation Dispersion and Redundancy Analysis

Feature Selection with Integrated Relevance and Redundancy Optimization

Adaptive Feature Redundancy Minimization

Conditional Mutual Information-Based Feature Selection Algorithm for Maximal Relevance Minimal Redundancy

A multi-objective evolutionary algorithm for feature selection based on mutual information with a new redundancy measure

A General Framework for Auto-Weighted Feature Selection via Global Redundancy Minimization.

Feature Selection by Maximizing Independent Classification Information.