Abstract:Binary relevance (BR) is a well-known framework for multi-label classification. It decomposes multi-label classification into binary (one-vs-rest) classification subproblems, one for each label. The BR approach is a simple and straightforward way for multi-label classification, but it still has several drawbacks. First, it does not consider label correlations. Second, each binary classifier may suffer from the issue of class-imbalance. Third, it can become computationally unaffordable for data sets with many labels. Several remedies have been proposed to solve these problems by exploiting label correlations between labels and performing label space dimension reduction. Meanwhile, inconsistency, another potential drawback of BR, is often ignored by researchers when they construct multi-label classification models. Inconsistency refers to the phenomenon that if an example belongs to more than one class label, then during the binary training stage, it can be considered as both positive and negative example simultaneously. This will mislead binary classifiers to learn suboptimal decision boundaries. In this paper, we seek to solve this problem by learning label specific features for each label. We assume that each label is only associated with a subset of features from the original feature set, and any two strongly correlated class labels can share more features with each other than two uncorrelated or weakly correlated ones. The proposed method can be applied as a feature selection method for multi-label learning and a general strategy to improve multi-label classification algorithms comprising a number of binary classifiers. Comparison with the state-of-the-art approaches manifests competitive performance of our proposed method.

A General Framework for Multi-Label Learning Towards Class Correlations and Class Imbalance.

Learning Label Specific Features for Multi-label Classification.

Multi-label classification with weak labels by learning label correlation and label regularization

Improving Multi-Label Learning by Modeling Local Label and Feature Correlations

Multi-Label Learning by Exploiting Label Correlations with LDA

Multi-Label Learning with Global and Local Label Correlation

Enhancing Binary Relevance For Multi-Label Learning With Controlled Label Correlations Exploitation

Towards Class-Imbalance Aware Multi-Label Learning

Joint Label-Specific Features and Correlation Information for Multi-Label Learning.

Multi-Label Bayesian Active Learning with Inter-Label Relationships

Complementary to Multiple Labels: A Correlation-Aware Correction Approach

Multi-label Learning Based on Label-Specific Features and Local Pairwise Label Correlation.

Calibrated Multi-label Classification with Label Correlations

Generalization Analysis for Multi-Label Learning

Learning Label Correlations for Multi-Label Online Passive Aggressive Classification Algorithm

Multi-label classification method based on correlation-constrained matrix factorization

Learning common and label-specific features for multi-Label classification with correlation information

Joint Multi-Label Classification and Label Correlations with Missing Labels and Feature Selection

Learning Low-Rank Label Correlations for Multi-label Classification with Missing Labels

Multi-Label Learning by Exploiting Label Correlations Locally

Common Subspace Based Multi-Label Learning Method