Abstract:<p>Improving classification performance is one of the main challenges in a variety of real-world applications. Unfortunately, classification models are sensitive to undesirable features of data such as redundant and irrelevant features. Feature selection (FS) is a powerful solution to address the negative effect of these features. Among various methods, Feature selection based on mutual information (MI) is an effective method to select the significant features and deny the undesirable ones. Although most of the existing methods can estimate the feature relevancy efficiently, they may find difficulty to estimate the feature redundancy well. This is due to the individual estimation between the candidate feature and the features of pre-selected subset. To address this limitation, this paper introduces a novel feature selection method, called Fuzzy Joint Mutual Information (FJMI). The proposed method also overcomes common limitations as dealing with continuous feature without information loss and returns the best feature subset automatically without a user-defined threshold. To evaluate the effectiveness of the proposed method, FJMI is compared with six conventional and state-of-the-art feature selection methods. The experimental results on 16 benchmark datasets, with moderate size, show a promising improvement by the proposed method in terms of classification performance, feature selection stability, and number of selected features.</p>

Input Feature Selection For Sensor Data Mining Based On Mutual Information

Feature Selection with Conditional Mutual Information Considering Feature Interaction

Input Feature Selection Method Based on Feature Set Equivalence and Mutual Information Gain Maximization

Feature selection based on Mutual Information in supervised learning

Feature Selection Based on Data Clustering

A Filter Approach to Feature Selection Based on Mutual Information

An Intrusion Detection Feature Selection Method Based on Improved Mutual Information

Mutual Information Based Feature Selection for Medical Image Retrieval

Higher Order Mutual Information Approximation for Feature Selection

Feature selection and threshold method based on fuzzy joint mutual information

Fuzzy joint mutual information feature selection based on ideal vector

An Advanced Hyperspectral Band Selection Approach Based on Mutual Information.

Feature Selection Using Hierarchical Feature Clustering

Latest CHORUS and NOMAD results

Fuzzy Mutual Information Based Min-Redundancy and Max-Relevance Heterogeneous Feature Selection

Conditional mutual information-based feature selection analyzing for synergy and redundancy

Feature Selection for Monotonic Classification

Estimating Conditional Mutual Information for Dynamic Feature Selection

Feature selection based on mutual information with correlation coefficient

Fuzzy Entropy Based Max-Relevancy and Min-Redundancy Feature Selection.

Feature selection for multi-label classification by maximizing full-dimensional conditional mutual information