Abstract:Recently, multilabel classification algorithms play an increasingly significant role in data mining and machine learning. However, some existing mutual information-based algorithms ignore the influence of the proportions of labels on the correlation degree between features and label sets. Besides, the correlation degree of label sets cannot be accurately measured in most traditional ReliefF algorithms, and the repeated calculation arises from the division of heterogeneous neighbors. To overcome these shortcomings, this paper proposes a multilabel feature selection method using mutual information and improved multilabel ReliefF (ML-ReliefF). First, the proportion of each label is calculated in label space and combined with the mutual information of features and labels to construct a novel correlation degree between features and label sets to preprocess multilabel datasets, which is used to reduce runtime of ML-ReliefF. Second, the mutual information of label sets is introduced into improving accuracy of the correlation degree among label sets. Furthermore, two types of correlation degree for label sets based on ML-ReliefF are developed to divide similar and heterogeneous samples more clearly. Third, a divided method of heterogeneous neighbors is presented to effectively avoid the repeated calculation in ML-ReliefF, and a novel method of feature weighting based on ML-ReliefF is constructed to evaluate the importance of features. Finally, a multilabel feature selection algorithm based on mutual information and ML-ReliefF for multilabel classification is designed to improve the performance of multilabel classification. Experiments under fourteen multilabel datasets show the effectiveness of our algorithm and improve the classification performance for multilabel datasets.

An Improved Multi-label Relief Feature Selection Algorithm for Unbalanced Datasets

An Unsupervised Feature Selection Method Based on Improved ReliefF and Bisecting K-means

ReliefF-based Multi-label Feature Selection

Multilabel Feature Selection Using Mutual Information and ML-ReliefF for Multilabel Classification

Multi-label Learning with Relief-based Label-Specific Feature Selection

Relief-Based Feature Selection: Introduction and Review

Feature Selection using ReliefF Algorithm

Feature Selection for Cross-Scene Hyperspectral Image Classification Using Cross-Domain I-ReliefF

A Semi-Supervised Relief Based Feature Extraction Algorithm

Feature Selection for Cross-Scene Hyperspectral Image Classification Using Cross-Domain ReliefF

An adaption of relief for redundant feature elimination

Research and Application of Data Mining Feature Selection Based on Relief Algorithm

A feature selection approach based on NSGA-II with ReliefF

Improvement Of Relieff Algorithm For Feature Weighting Fingerprint-Based Localization

An relief resource allocation model with equity constraints

Application of Relief in Handwriting Recognition

A hybrid dimension reduction algorithm on ReliefF and APSO

RG-NBEO: a ReliefF guided novel binary equilibrium optimizer with opposition-based S-shaped and V-shaped transfer functions for feature selection

Multi-label feature selection based on stable label relevance and label-specific features

Improved SVM algorithm for imbalanced dataset classification

Label relaxation and shared information for multi-label feature selection