Abstract:Feature selection, as an important pre-processing technique, can efficiently mitigate the issue of “the curse of dimensionality” by selecting discriminative features especially for multi-label learning, a discriminative feature subset can improve the classification accuracy. The existing feature selection methods for multi-label classification address the problem of label ambiguity by with logical labels. However, the significance of each label is often different in many practical applications. Using logical label to train the model may result in unsatisfactory performance due to not considering the importance of related labels with each sample. To address this issue, a novel multi-label feature selection algorithm is proposed with two-step: label enhancement and label correlations-based feature selection with label enhancement. In the step of label enhancement, a framework of label enhancement based on deep forest is utilized to transform the logical label to label distribution, which contains rich semantic information and then guides a more correct exploration of semantic correlations. In the step of feature selection, a novel multi-label feature selection algorithm is proposed based on label distribution data. Firstly, the samples are divided into multiple different clusters by using spectral clustering in the label space. Then, the label correlations can be reflected by multiple different clusters. Finally, the l2,1-norm is used to construct an objective function to achieve multi-label feature selection. Experimental results demonstrate that competitiveness of the proposed algorithm over six state-of-the-art multi-label feature selection algorithms on eighteen benchmark datasets in terms of six widely accepted evaluation metrics.

Feature Selection for Multi-label Learning: A Systematic Literature Review and Some Experimental Evaluations

Label Correlation Guided Feature Selection for Multi-label Learning.

Multi-label feature selection by strongly relevant label gain and label mutual aid

Feature Selection for Multi-Label Classification Using Neighborhood Preservation

Enhanced multi-label feature selection considering label-specific relevant information

Feature selection for multi-label naive Bayes classification

A Feature Selection Method for Multi-Label Text Based on Feature Importance

Multi-label feature selection based on stable label relevance and label-specific features

A Survey on Multi-Label Feature Selection from Perspectives of Label Fusion.

Novel multi-label feature selection via label enhancement and relative maximal discernibility pairs

Embedded feature selection for multi-label learning

An Ensemble Multi-Label Feature Selection Algorithm Based on Information Entropy

A novel feature selection approach with Pareto optimality for multi-label data

ReliefF-based Multi-label Feature Selection

Label Correlations-Based Multi-Label Feature Selection with Label Enhancement

Dynamic multi-label feature selection algorithm based on label importance and label correlation

Multi-label Feature Selection Based on Relative Entropy and Fuzzy Neighborhood Mutual Discrimination Index

Multi-label Feature Selection Based on Correlation Label Enhancement

Multi-label Feature Selection Based on Fuzzy Neighborhood Mutual Discrimination Index

Multi-Label Feature Selection Based on High-Order Label Correlation Assumption

Feature Selection For Multi-Label Learning Using Mutual Information And Ga