Abstract:Information theory has been widely used to evaluate the relevance and redundancy of features in feature selection. The traditional feature selection methods based on information theory focus on classification-specific feature selection. Classification-specific feature selection considers all classes together and therefore may not be able to select a desirable feature subset for a particular class. In contrast, class-specific feature selection can choose an appropriate feature subset for each class. The main goal of this paper is to propose a class-specific feature selection method based on information theory. In this regard, we first develop a class-specific feature evaluation criterion called Class-Specific Maximal Dynamic Correlation Change and Minimal Redundancy (CSMDCCMR), which consists of three items. The first item characterizes the correlation between a candidate feature and a particular class. The second item quantifies the dynamic changes in the relevance of a candidate feature and selected features with respect to a particular class. The third item expresses the redundancy between a candidate feature and selected features with respect to a particular class. We then design a class-specific feature selection algorithm by combining the CSMDCCMR criterion with a sequential forward search strategy, which can be employed to select a suitable feature subset for each class. Finally, we carry out extensive experiments to compare our class-specific feature selection method with nine representative classification-specific feature selection methods based on information theory and six state-of-the-art class-specific feature selection methods. The experimental results show that our class-specific feature selection method achieves better classification performance than these comparison methods.

Attribute Selection Algorithm using Correlation based on Maximal Connected Subgraph

Feature Selection with Attributes Clustering by Maximal Information Coefficient

Gene Selection Algorithm Based on Correlation Analysis

Novel algorithm for attribute reduction based on mutual-information gain ratio

Incremental Subgraph Feature Selection for Graph Classification.

Top-r Keyword-Based Community Search in Attributed Graphs.

Class-specific feature selection via maximal dynamic correlation change and minimal redundancy

Defragging Subgraph Features for Graph Classification.

A correlation guided genetic algorithm and its application to feature selection

Feature Selection Algorithm Based on Sparse Score and Correlation Analysis

CoHomo: A Cluster-Attribute Correlation Aware Graph Clustering Framework

A Correlation-Redundancy Guided Evolutionary Algorithm and Its Application to High-Dimensional Feature Selection in Classification

Medical Datasets Classification using a Hybrid Genetic Algorithm for Feature Selection based on Pearson Correlation Coefficient

Maximal Correlation Regression

Feature selection based on mutual information with correlation coefficient

Multi-Label Feature Selection Based on High-Order Label Correlation Assumption

Intrusion Classifier Based on Multiple Attribute Selection Algorithms

Multi-Target Feature Selection with Adaptive Graph Learning and Target Correlations

A Feature-Selection Method Based on Graph Symmetry Structure in Complex Networks

Which Algorithm Performs Best: Algorithm Selection for Community Detection.

Multi-label Feature Selection Based on Correlation Label Enhancement