Abstract:Minimal-redundancy–maximal-relevance (mRMR) algorithm is a typical feature selection algorithm. To select the feature which has minimal redundancy with the selected features and maximal relevance with the class label, the objective function of mRMR subtracts the average value of mutual information between features from mutual information between features and the class label, and selects the feature with the maximum difference. However, the problem is that the feature with the maximum difference is not always the feature with minimal redundancy maximal relevance. To solve the problem, the objective function of mRMR is first analyzed and a constraint condition that determines whether the objective function can guarantee the effectiveness of the selected features is achieved. Then, for the case where the objective function is not accurate, an idea of equal interval division is proposed and combined with ranking to process the interval of mutual information between features and the class label, and that of the average value of mutual information between features. Finally, a feature selection algorithm based on equal interval division and minimal-redundancy–maximal-relevance (EID–mRMR) is proposed. To validate the performance of EID–mRMR, we compare it with several incremental feature selection algorithms based on mutual information and other feature selection algorithms. Experimental results demonstrate that the EID–mRMR algorithm can achieve better feature selection performance.

A Feature Selection Algorithm Based on Equal Interval Division and Conditional Mutual Information

Feature Selection with Conditional Mutual Information Considering Feature Interaction

A Feature Selection Algorithm Based on Equal Interval Division and Minimal-Redundancy–Maximal-Relevance

Feature Selection Using Mutual Information: An Experimental Study

Feature Selection With Dynamic Mutual Information

A feature subset selection algorithm based on equal interval division and three-way interaction information

Conditional Mutual Information-Based Feature Selection Algorithm for Maximal Relevance Minimal Redundancy

Feature Selection Algorithm Based On Conditional Dynamic Mutual Information

Input Feature Selection Method Based on Feature Set Equivalence and Mutual Information Gain Maximization

Mutual Information Criteria for Feature Selection

Conditional mutual information-based feature selection analyzing for synergy and redundancy

Feature Selection by Maximizing Part Mutual Information

Feature selection based on mutual information with correlation coefficient

Feature Selection Via Adaptive Spectral Clustering Based on Joint Mutual Information

Estimating Conditional Mutual Information for Dynamic Feature Selection

Minimum Joint Mutual Information Loss-based Optimal Feature Selection Algorithm

A feature selection algorithm based on redundancy analysis and interaction weight

A Filter Approach to Feature Selection Based on Mutual Information

Mutual information based feature selection for symbolic interval data

A New Feature Selection Algorithm Based on Mutual Information with Pairwise Constraints

Feature selection based on Mutual Information in supervised learning