Abstract:Feature selection, which searches for the most representative features in observed data, is critical for health data analysis. Unlike feature extraction, such as PCA and autoencoder based methods, feature selection preserves interpretability, meaning that the selected features provide direct information about certain health conditions (i.e., the label). Thus, feature selection allows domain experts, such as clinicians, to understand the predictions made by machine learning based systems, as well as improve their own diagnostic skills. Mutual information is often used as a basis for feature selection since it measures dependencies between features and labels. In this paper, we introduce a novel mutual information based feature selection (MIBFS) method called SURI, which boosts features with high unique relevant information. We compare SURI to existing MIBFS methods using 3 different classifiers on 6 publicly available healthcare data sets. The results indicate that, in addition to preserving interpretability, SURI selects more relevant feature subsets which lead to higher classification performance. More importantly, we explore the dynamics of mutual information on a public low-dimensional health data set via exhaustive search. The results suggest the important role of unique relevant information in feature selection and verify the principles behind SURI.

Feature selection based on survival Cauchy-Schwartz mutual information

A Filter Approach to Feature Selection Based on Survival Cauchy-Schwartz Mutual Information

Feature Selection with Conditional Mutual Information Considering Feature Interaction

Feature Selection Using Mutual Information: An Experimental Study

A Filter Approach to Feature Selection Based on Mutual Information

Feature Selection With Dynamic Mutual Information

Conditional mutual information-based feature selection analyzing for synergy and redundancy

Feature Selection by Maximizing Part Mutual Information

Feature selection in SVM based on the hybrid of enhanced genetic algorithm and mutual information

Feature Subset Selection Combining Maximal Information Entropy and Maximal Information Coefficient

Mic_fs : A Novel Model For Feature Selection By Mutual Information Guided By Clustering

Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy

Feature Selection Via Adaptive Spectral Clustering Based on Joint Mutual Information

Higher Order Mutual Information Approximation for Feature Selection

Feature selection based on Mutual Information in supervised learning

Class-specific Mutual Information Variation for Feature Selection.

Feature Selection Based on Unique Relevant Information for Health Data

Mutual Information Criteria for Feature Selection

Feature selection based on mutual information with correlation coefficient

A Feature Selection Algorithm Based on Equal Interval Division and Conditional Mutual Information

Latest CHORUS and NOMAD results