Abstract:Feature selection based on information theory, which is used to select a group of the most informative features, has extensive application fields such as machine learning, data mining and natural language processing. However, numerous previous methods suffer from two common defects. (1) Feature relevancy is defined without distinguishing candidate feature relevancy and selected feature relevancy. (2) Some interdependent features may be misinterpreted as redundant features. In this study, we propose a feature selection method named Dynamic Relevance and Joint Mutual Information Maximization (DRJMIM) to address these two defects. DRJMIM includes four stages. First, the relevancy is divided into two categories: candidate feature relevancy and selected feature relevancy. Second, according to candidate feature relevancy that is joint mutual information, some redundant features are selected. Third, the redundant features are combined with a dynamic weight to reduce the selection possibility of true redundant features while increasing the false ones. Finally, the most informative and interdependent features are selected and true redundant features are eliminated simultaneously. Furthermore, our method is compared with five competitive feature selection methods on 12 publicly available data sets. The classification results show that DRJMIM performs better than other five methods. Its statistical significance is verified by a paired two-tailed t-test. Meanwhile, DRJMIM obtains few number of selected features when it achieves the highest classification accuracy. (C) 2017 Elsevier Ltd. All rights reserved.

I-mRMR: Incremental Max-Relevance, and Min-Redundancy Feature Selection

A Feature Selection Algorithm Based on Equal Interval Division and Minimal-Redundancy–Maximal-Relevance

A new improved maximal relevance and minimal redundancy method based on feature subset

Recursive Feature Selection Based on Minimum Redundancy Maximum Relevancy

Feature Selection Methods In The Framework Of Mrmr

Feature Selection with Conditional Mutual Information Considering Feature Interaction

Conditional Mutual Information-Based Feature Selection Algorithm for Maximal Relevance Minimal Redundancy

Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy

MVMR-FS : Non-parametric feature selection algorithm based on Maximum inter-class Variation and Minimum Redundancy

Feature Redundancy Term Variation for Mutual Information-Based Feature Selection

Feature selection based on min-redundancy and max-consistency

Improved Measures of Redundancy and Relevance for mRMR Feature Selection

Feature Selection with Maximal Relevance and Minimal Supervised Redundancy

Dynamic Interaction-Based Feature Selection Algorithm for Maximal Relevance Minimal Redundancy

Fuzzy Entropy Based Max-Relevancy and Min-Redundancy Feature Selection.

Multi-label Feature Selection Algorithm Based on Joint Mutual Information of Max-Relevance and Min-Redundancy

Discovering the Representative Subset with Low Redundancy for Hyperspectral Feature Selection

The mRMR variable selection method: a comparative study for functional data

A comparative study of redundant feature detection based feature selection methods

Feature Selection Considering Two Types of Feature Relevancy and Feature Interdependency.