Abstract:Feature selection, as an important pre-processing technique, can efficiently mitigate the issue of “the curse of dimensionality” by selecting discriminative features especially for multi-label learning, a discriminative feature subset can improve the classification accuracy. The existing feature selection methods for multi-label classification address the problem of label ambiguity by with logical labels. However, the significance of each label is often different in many practical applications. Using logical label to train the model may result in unsatisfactory performance due to not considering the importance of related labels with each sample. To address this issue, a novel multi-label feature selection algorithm is proposed with two-step: label enhancement and label correlations-based feature selection with label enhancement. In the step of label enhancement, a framework of label enhancement based on deep forest is utilized to transform the logical label to label distribution, which contains rich semantic information and then guides a more correct exploration of semantic correlations. In the step of feature selection, a novel multi-label feature selection algorithm is proposed based on label distribution data. Firstly, the samples are divided into multiple different clusters by using spectral clustering in the label space. Then, the label correlations can be reflected by multiple different clusters. Finally, the l2,1-norm is used to construct an objective function to achieve multi-label feature selection. Experimental results demonstrate that competitiveness of the proposed algorithm over six state-of-the-art multi-label feature selection algorithms on eighteen benchmark datasets in terms of six widely accepted evaluation metrics.

Independent Feature and Label Components for Multi-label Classification

Multi-View Correlated Feature Learning by Uncovering Shared Component.

Two-Stage Label Embedding Via Neural Factorization Machine for Multi-Label Classification

Exploring Common and Label-Specific Features for Multi-Label Learning with Local Label Correlations

Joint Multilabel Classification and Feature Selection Based on Deep Canonical Correlation Analysis

MULFE: Multi-Label Learning via Label-Specific Feature Space Ensemble

Multi-label Feature Selection Based on Correlation Label Enhancement

Learning common and label-specific features for multi-Label classification with correlation information

Label Correlations-Based Multi-Label Feature Selection with Label Enhancement

Label Correlations Variation for Robust Multi-Label Feature Selection

Semi-Supervised Multi-Label Feature Selection by Preserving Feature-Label Space Consistency

Label Correlation Guided Feature Selection for Multi-label Learning.

Multi-label text classification via joint learning from label embedding and label correlation

Multi-label Learning with Label-Specific Features by Resolving Label Correlations.

Toward Embedding-Based Multi-Label Feature Selection with Label and Feature Collaboration

Joint Label-Specific Features and Correlation Information for Multi-Label Learning.

Multi-Label Feature Selection Via Positive or Negative Correlation.

Feature-induced Labeling Information Enrichment for Multi-Label Learning

Multi-Label Feature Selection Based on High-Order Label Correlation Assumption

Multi-Label Low-dimensional Embedding with Missing Labels

MULTI-LABEL IMAGE RECOGNITION WITH JOINT CLASS-AWARE MAP DISENTANGLING AND LABEL CORRELATION EMBEDDING