Abstract:Multi-label classification studies the task where each example belongs to multiple labels simultaneously. As a representative method, Ranking Support Vector Machine (Rank-SVM) aims to minimize the Ranking Loss and can also mitigate the negative influence of the class-imbalance issue. However, due to its stacking-style way for thresholding, it may suffer error accumulation and thus reduces the final classification performance. Binary Relevance (BR) is another typical method, which aims to minimize the Hamming Loss and only needs one-step learning. Nevertheless, it might have the class-imbalance issue and does not take into account label correlations. To address the above issues, we propose a novel multi-label classification model, which joints Ranking support vector machine and Binary Relevance with robust Low-rank learning (RBRL). RBRL inherits the ranking loss minimization advantages of Rank-SVM, and thus overcomes the disadvantages of BR suffering the class-imbalance issue and ignoring the label correlations. Meanwhile, it utilizes the hamming loss minimization and one-step learning advantages of BR, and thus tackles the disadvantages of Rank-SVM including another thresholding learning step. Besides, a low-rank constraint is utilized to further exploit high-order label correlations under the assumption of low dimensional label space. Furthermore, to achieve nonlinear multi-label classifiers, we derive the kernelization RBRL. Two accelerated proximal gradient methods (APG) are used to solve the optimization problems efficiently. Extensive comparative experiments with several state-of-the-art methods illustrate a highly competitive or superior performance of our method RBRL.

Instance-Ranking: A New Perspective to Consider the Instance Dependency for Classification

A Bayesian Network nearest k-labels method for Multi-label classification

RW.KNN: a proposed random walk KNN algorithm for multi-label classification.

Label Distribution Learning-Enhanced Dual-KNN for Text Classification

A K-Nearest Neighbor Based Algorithm for Multi-Label Classification.

Multi-objective Evolutionary Instance Selection for Multi-label Classification

A Multiclass Classification Approach to Label Ranking

Top-K Pairwise Ranking: Bridging the Gap Among Ranking-Based Measures for Multi-Label Classification

A Debiased Nearest Neighbors Framework for Multi-Label Text Classification

Multi-label Classification using Labels as Hidden Nodes

Joint Ranking SVM and Binary Relevance with Robust Low-Rank Learning for Multi-Label Classification

A Manifold Learning-Based Multi-Instance Regression Algorithm

Exploiting Instance Relationship For Effective Extreme Multi-Label Learning

Learning Top-k Classification with Label Ranking

Multiple-instance Ranking: Learning to Rank Images for Image Retrieval

Online Multi-Label Classification under Noisy and Changing Label Distribution

Address Instance-level Label Prediction in Multiple Instance Learning

ML-KNN: A lazy learning approach to multi-label learning

Multi-Label Classification of Research Papers Using Multi-Label K-Nearest Neighbour Algorithm

Top-k learning to rank: labeling, ranking and evaluation.

Adaptive Weighted Ranking-Oriented Label Distribution Learning