Abstract:Binary relevance (BR) is a well-known framework for multi-label classification. It decomposes multi-label classification into binary (one-vs-rest) classification subproblems, one for each label. The BR approach is a simple and straightforward way for multi-label classification, but it still has several drawbacks. First, it does not consider label correlations. Second, each binary classifier may suffer from the issue of class-imbalance. Third, it can become computationally unaffordable for data sets with many labels. Several remedies have been proposed to solve these problems by exploiting label correlations between labels and performing label space dimension reduction. Meanwhile, inconsistency, another potential drawback of BR, is often ignored by researchers when they construct multi-label classification models. Inconsistency refers to the phenomenon that if an example belongs to more than one class label, then during the binary training stage, it can be considered as both positive and negative example simultaneously. This will mislead binary classifiers to learn suboptimal decision boundaries. In this paper, we seek to solve this problem by learning label specific features for each label. We assume that each label is only associated with a subset of features from the original feature set, and any two strongly correlated class labels can share more features with each other than two uncorrelated or weakly correlated ones. The proposed method can be applied as a feature selection method for multi-label learning and a general strategy to improve multi-label classification algorithms comprising a number of binary classifiers. Comparison with the state-of-the-art approaches manifests competitive performance of our proposed method.

Dual dimensionality reduction on instance-level and feature-level for multi-label data

Multilabel Dimensionality Reduction Via Dependence Maximization.

Multi-label feature selection by strongly relevant label gain and label mutual aid

Semi-Supervised Multi-Label Dimensionality Reduction Learning by Instance and Label Correlations

Enhanced multi-label feature selection considering label-specific relevant information

Novel multi-label feature selection via label enhancement and relative maximal discernibility pairs

Dimensionality Reduction for Hierarchical Multi-Label Classification: A Systematic Mapping Study

Parallel dual-channel multi-label feature selection

A Divide-and-Conquer Approach for Large-Scale Multi-label Learning

Semi-Supervised Dimension Reduction for Multi-Label Classification

Semi-Supervised Dual Relation Learning for Multi-Label Classification

Feature Reduction Using Locally Linear Embedding and Distance Metric Learning

Learning Label Specific Features for Multi-label Classification.

ReliefF-based Multi-label Feature Selection

Sparse low-redundancy multilabel feature selection based on dynamic local structure preservation and triple graphs exploration

Feature Selection for Multi-Label Classification Using Neighborhood Preservation

Multilabel Classification Using Low-Rank Decomposition

Dynamic multi-label feature selection algorithm based on label importance and label correlation

Multi-Label Feature Selection via Label Enhancement and Analytic Hierarchy Process

Nonparametric Discriminant Multi-Manifold Learning for Dimensionality Reduction

Label Correlation Guided Feature Selection for Multi-label Learning.