Abstract:Minimal-redundancy–maximal-relevance (mRMR) algorithm is a typical feature selection algorithm. To select the feature which has minimal redundancy with the selected features and maximal relevance with the class label, the objective function of mRMR subtracts the average value of mutual information between features from mutual information between features and the class label, and selects the feature with the maximum difference. However, the problem is that the feature with the maximum difference is not always the feature with minimal redundancy maximal relevance. To solve the problem, the objective function of mRMR is first analyzed and a constraint condition that determines whether the objective function can guarantee the effectiveness of the selected features is achieved. Then, for the case where the objective function is not accurate, an idea of equal interval division is proposed and combined with ranking to process the interval of mutual information between features and the class label, and that of the average value of mutual information between features. Finally, a feature selection algorithm based on equal interval division and minimal-redundancy–maximal-relevance (EID–mRMR) is proposed. To validate the performance of EID–mRMR, we compare it with several incremental feature selection algorithms based on mutual information and other feature selection algorithms. Experimental results demonstrate that the EID–mRMR algorithm can achieve better feature selection performance.

Recursive Feature Selection Based on Minimum Redundancy Maximum Relevancy

I-mRMR: Incremental Max-Relevance, and Min-Redundancy Feature Selection

A Feature Selection Algorithm Based on Equal Interval Division and Minimal-Redundancy–Maximal-Relevance

A new improved maximal relevance and minimal redundancy method based on feature subset

Dynamic Interaction-Based Feature Selection Algorithm for Maximal Relevance Minimal Redundancy

MVMR-FS : Non-parametric feature selection algorithm based on Maximum inter-class Variation and Minimum Redundancy

Fuzzy Entropy Based Max-Relevancy and Min-Redundancy Feature Selection.

Improved Measures of Redundancy and Relevance for mRMR Feature Selection

Feature Selection with Maximal Relevance and Minimal Supervised Redundancy

Feature selection using max dynamic relevancy and min redundancy

Feature Redundancy Term Variation for Mutual Information-Based Feature Selection

The Minimum Redundancy-Maximum Relevance Approach to Building Sparse Support Vector Machines

Conditional Mutual Information-Based Feature Selection Algorithm for Maximal Relevance Minimal Redundancy

Feature selection using dynamic weights for classification

Maximum margin and global criterion based-recursive feature selection

The mRMR variable selection method: a comparative study for functional data

A Feature Selection Method Using Conditional Correlation Dispersion and Redundancy Analysis

Deep Learning Based Feature Selection Algorithm for Small Targets Based on mRMR