Abstract:<p>Improving classification performance is one of the main challenges in a variety of real-world applications. Unfortunately, classification models are sensitive to undesirable features of data such as redundant and irrelevant features. Feature selection (FS) is a powerful solution to address the negative effect of these features. Among various methods, Feature selection based on mutual information (MI) is an effective method to select the significant features and deny the undesirable ones. Although most of the existing methods can estimate the feature relevancy efficiently, they may find difficulty to estimate the feature redundancy well. This is due to the individual estimation between the candidate feature and the features of pre-selected subset. To address this limitation, this paper introduces a novel feature selection method, called Fuzzy Joint Mutual Information (FJMI). The proposed method also overcomes common limitations as dealing with continuous feature without information loss and returns the best feature subset automatically without a user-defined threshold. To evaluate the effectiveness of the proposed method, FJMI is compared with six conventional and state-of-the-art feature selection methods. The experimental results on 16 benchmark datasets, with moderate size, show a promising improvement by the proposed method in terms of classification performance, feature selection stability, and number of selected features.</p>

Feature Selection Via Adaptive Spectral Clustering Based on Joint Mutual Information

Feature Selection with Conditional Mutual Information Considering Feature Interaction

Feature Selection Based on Data Clustering

An Advanced Hyperspectral Band Selection Approach Based on Mutual Information.

Feature Selection With Dynamic Mutual Information

Feature Selection Based on Fuzzy Joint Mutual Information Maximization

Mic_fs : A Novel Model For Feature Selection By Mutual Information Guided By Clustering

Feature Selection with Attributes Clustering by Maximal Information Coefficient

Feature Selection Using Mutual Information: An Experimental Study

Feature selection and threshold method based on fuzzy joint mutual information

Feature Selection Using Hierarchical Feature Clustering

Input Feature Selection For Sensor Data Mining Based On Mutual Information

Unsupervised Feature Selection with Joint Clustering Analysis.

Fuzzy joint mutual information feature selection based on ideal vector

Improved feature selection based on a mutual information measure for hyperspectral image classification

Mutual Information Criteria for Feature Selection

Feature selection based on Mutual Information in supervised learning

A comparative analysis of mutual information based feature selection for hyperspectral image classification

Feature selection based on survival Cauchy-Schwartz mutual information

A Method of Discriminative Information Preservation and In-Dimension Distance Minimization Method for Feature Selection

Hyperspectral Feature Selection Based on Mutual Information and Nonlinear Correlation Coefficient