Abstract:Information theory has been widely used to evaluate the relevance and redundancy of features in feature selection. The traditional feature selection methods based on information theory focus on classification-specific feature selection. Classification-specific feature selection considers all classes together and therefore may not be able to select a desirable feature subset for a particular class. In contrast, class-specific feature selection can choose an appropriate feature subset for each class. The main goal of this paper is to propose a class-specific feature selection method based on information theory. In this regard, we first develop a class-specific feature evaluation criterion called Class-Specific Maximal Dynamic Correlation Change and Minimal Redundancy (CSMDCCMR), which consists of three items. The first item characterizes the correlation between a candidate feature and a particular class. The second item quantifies the dynamic changes in the relevance of a candidate feature and selected features with respect to a particular class. The third item expresses the redundancy between a candidate feature and selected features with respect to a particular class. We then design a class-specific feature selection algorithm by combining the CSMDCCMR criterion with a sequential forward search strategy, which can be employed to select a suitable feature subset for each class. Finally, we carry out extensive experiments to compare our class-specific feature selection method with nine representative classification-specific feature selection methods based on information theory and six state-of-the-art class-specific feature selection methods. The experimental results show that our class-specific feature selection method achieves better classification performance than these comparison methods.

Feature selection method based on conditional relevance

Feature Selection with Conditional Mutual Information Considering Feature Interaction

Multi-Label Feature Selection Combining Three Types of Conditional Relevance

Feature Selection Considering the Composition of Feature Relevancy

Feature Selection Method on Imbalanced Text

Feature Selection Considering Two Types of Feature Relevancy and Feature Interdependency.

Feature Selection Considering Weighted Relevancy

Relevance Assignation Feature Selection Method Based on Mutual Information for Machine Learning

An improved conditional relevance and weighted redundancy feature selection method for gene expression data

A Feature Selection Method Using Conditional Correlation Dispersion and Redundancy Analysis

Research on the Multi-Source Causal Feature Selection Method Based on Multiple Causal Relevance

A New Feature Selection Algorithm Based on Relevance, Redundancy and Complementarity.

A New Supervised Feature Selection Method for Pattern Classification.

Class-specific feature selection via maximal dynamic correlation change and minimal redundancy

Feature selection using dynamic weights for classification

Redundant feature selection by conditional linear correlation

Joint Feature Selection Method Based on Relevance and Redundancy

A Selective Bayesian Classifier Based on Change of Class Relevance Influence

Feature Selection with Maximal Relevance and Minimal Supervised Redundancy

Hybrid Feature Selection Using Component Co-Occurrence Based Feature Relevance Measurement