Abstract:In multi-task learning, we often encounter the case when the presence of labels across samples exhibits irregular patterns: samples can be fully labeled, partially labeled or unlabeled. Taking drug analysis as an example, multiple toxicity properties of a drug molecule may not be concurrently available due to experimental limitations. It triggers a demand for a new training and inference mechanism that could accommodate irregularly present labels and maximize the utility of any available label information. In this work, we focus on the two-label learning task, and propose a novel training and inference framework, Dual-Label Learning (DLL). The DLL framework formulates the problem into a dual-function system, in which the two functions should simultaneously satisfy standard supervision, structural duality and probabilistic duality. DLL features a dual-tower model architecture that explicitly captures the information exchange between labels, aimed at maximizing the utility of partially available labels in understanding label correlation. During training, label imputation for missing labels is conducted as part of the forward propagation process, while during inference, labels are regarded as unknowns of a bivariate system of equations and are solved jointly. Theoretical analysis guarantees the feasibility of DLL, and extensive experiments are conducted to verify that by explicitly modeling label correlation and maximizing the utility of available labels, our method makes consistently better predictions than baseline approaches by up to a 10% gain in F1-score or MAPE. Remarkably, our method provided with data at a label missing rate as high as 60% can achieve similar or even better results than baseline approaches at a label missing rate of only 10%.

Gemini: A Dual-Task Co-training Model for Partial Label Learning.

AsyCo: An Asymmetric Dual-task Co-training Model for Partial-label Learning

Dual Enhancement for Multi-Label Learning with Missing Labels

Partial Label Learning with a Partner.

Network Cooperation with Progressive Disambiguation for Partial Label Learning

Meta Objective Guided Disambiguation for Partial Label Learning

Multi-graph Embedding for Partial Label Learning.

Complementary Classifier Induced Partial Label Learning

Large Margin Partial Label Machine

Partial Multi-label Learning with Label and Feature Collaboration

Self-distillation and self-supervision for partial label learning

Dual-Label Learning With Irregularly Present Labels

Partial Label Learning with Semantic Label Representations

Partial label learning with heterogeneous domain adaptation

Can Label-Specific Features Help Partial-Label Learning?

Candidate-aware Selective Disambiguation Based on Normalized Entropy for Instance-dependent Partial-label Learning.

Partial Label Learning with Noisy Side Information

Learning from Multi-Dimensional Partial Labels.

Mixed Blessing: Class-Wise Embedding guided Instance-Dependent Partial Label Learning

Partial-label Learning with Mixed Closed-set and Open-set Out-of-candidate Examples

Feature space and label space selection based on Error-correcting output codes for partial label learning