Abstract:Feature selection, as an important pre-processing technique, can efficiently mitigate the issue of “the curse of dimensionality” by selecting discriminative features especially for multi-label learning, a discriminative feature subset can improve the classification accuracy. The existing feature selection methods for multi-label classification address the problem of label ambiguity by with logical labels. However, the significance of each label is often different in many practical applications. Using logical label to train the model may result in unsatisfactory performance due to not considering the importance of related labels with each sample. To address this issue, a novel multi-label feature selection algorithm is proposed with two-step: label enhancement and label correlations-based feature selection with label enhancement. In the step of label enhancement, a framework of label enhancement based on deep forest is utilized to transform the logical label to label distribution, which contains rich semantic information and then guides a more correct exploration of semantic correlations. In the step of feature selection, a novel multi-label feature selection algorithm is proposed based on label distribution data. Firstly, the samples are divided into multiple different clusters by using spectral clustering in the label space. Then, the label correlations can be reflected by multiple different clusters. Finally, the l2,1-norm is used to construct an objective function to achieve multi-label feature selection. Experimental results demonstrate that competitiveness of the proposed algorithm over six state-of-the-art multi-label feature selection algorithms on eighteen benchmark datasets in terms of six widely accepted evaluation metrics.

A Simple and Convex Formulation for Multi-label Feature Selection.

Mutual information based multi-label feature selection via constrained convex optimization.

A Fast Feature Selection Method Based on Mutual Information in Multi-label Learning.

A Convex Formulation for Semi-Supervised Multi-Label Feature Selection.

Multi-Label Feature Selection via Label Enhancement and Analytic Hierarchy Process

Enhanced multi-label feature selection considering label-specific relevant information

Multi-label Feature Selection Based on Fuzzy Neighborhood Mutual Discrimination Index

Multiple reference points-based multi-objective feature selection for multi-label learning

Dynamic multi-label feature selection algorithm based on label importance and label correlation

Multi-label Feature Selection Based on Relative Entropy and Fuzzy Neighborhood Mutual Discrimination Index

A novel feature selection approach with Pareto optimality for multi-label data

Multi-label feature selection by strongly relevant label gain and label mutual aid

Multi-label feature selection based on stable label relevance and label-specific features

Multi-label Feature Selection Via Global Relevance and Redundancy Optimization

A Multi-Objective Multi-Label Feature Selection Algorithm Based on Shapley Value

Multi-label feature selection based on fuzzy neighborhood rough sets

Robust Multi-Label Relief Feature Selection Based on Fuzzy Margin Co-Optimization

Label Correlations-Based Multi-Label Feature Selection with Label Enhancement

An Ensemble Multi-Label Feature Selection Algorithm Based on Information Entropy

Novel multi-label feature selection via label enhancement and relative maximal discernibility pairs

A Survey on Multi-Label Feature Selection from Perspectives of Label Fusion.