Abstract:This work focuses on the problem of multi-label learning with missing labels (MLML), which aims to label each test instance with multiple class labels given training instances that have an incomplete/partial set of these labels. The key point to handle missing labels is propagating the label information from provided labels to missing labels, through a dependency graph that each label of each instance is treated as a node. We build this graph by utilizing different types of label dependencies. Specifically, the instance-level similarity is served as undirected edges to connect the label nodes across different instances and the semantic label hierarchy is used as directed edges to connect different classes. This base graph is referred to as the mixed dependency graph, as it includes both undirected and directed edges. Furthermore, we present another two types of label dependencies to connect the label nodes across different classes. One is the class co-occurrence, which is also encoded as undirected edges. Combining with the base graph, we obtain a new mixed graph, called MG-CO (mixed graph with co-occurrence). The other is the sparse and low rank decomposition of the whole label matrix, to embed high-order dependencies over all labels. Combining with the base graph, the new mixed graph is called as MG-SL (mixed graph with sparse and low rank decomposition). Based on MG-CO and MG-SL, we propose two convex transductive formulations of the MLML problem, denoted as MLMG-CO and MLMG-SL, respectively. Two important applications, including image annotation and tag based image retrieval, can be jointly handled using our proposed methods. Experiments on benchmark datasets show that our methods give significant improvements in performance and robustness to missing labels over the state-of-the-art methods.

Three-Way Decisions Based Multi-label Learning Algorithm with Label Dependency

Instance-Ranking: A New Perspective to Consider the Instance Dependency for Classification

Label Distribution Learning with Noisy Labels Via Three-Way Decisions

Enhancing multi-label classification by modeling dependencies among labels.

Joint Learning of Multi-Label Classification and Label Correlations

Three-teaching: A Three-Way Decision Framework to Handle Noisy Labels

A Co-Training Approach for Sequential Three-Way Decisions

Multi-Label Low-dimensional Embedding with Missing Labels

Label Dependencies-Aware Set Prediction Networks for Multi-Label Text Classification

LCBM: A Multi-View Probabilistic Model for Multi-Label Classification

Multi-Label Bayesian Active Learning with Inter-Label Relationships

Multi-label Learning with Missing Labels using Mixed Dependency Graphs

Capturing Correlations of Multiple Labels: A Generative Probabilistic Model for Multi-Label Learning

A Multi Label Learning Method Using Affinity Propagation and Support Vector Machine

Multi-label Classification using Labels as Hidden Nodes

Multi-label text classification via joint learning from label embedding and label correlation

Joint Label-Specific Features and Correlation Information for Multi-Label Learning.

Deep Dependency Networks for Multi-Label Classification

Determined Multi-Label Learning via Similarity-Based Prompt

Nearest Labelset Using Double Distances for Multi-label Classification

Multi-Label Learning by Exploiting Label Correlations with LDA