AsyCo: An Asymmetric Dual-task Co-training Model for Partial-label Learning

Beibei Li,Yiyuan Zheng,Beihong Jin,Tao Xiang,Haobo Wang,Lei Feng

2024-07-21

Abstract:Partial-Label Learning (PLL) is a typical problem of weakly supervised learning, where each training instance is annotated with a set of candidate labels. Self-training PLL models achieve state-of-the-art performance but suffer from error accumulation problem caused by mistakenly disambiguated instances. Although co-training can alleviate this issue by training two networks simultaneously and allowing them to interact with each other, most existing co-training methods train two structurally identical networks with the same task, i.e., are symmetric, rendering it insufficient for them to correct each other due to their similar limitations. Therefore, in this paper, we propose an asymmetric dual-task co-training PLL model called AsyCo, which forces its two networks, i.e., a disambiguation network and an auxiliary network, to learn from different views explicitly by optimizing distinct tasks. Specifically, the disambiguation network is trained with self-training PLL task to learn label confidence, while the auxiliary network is trained in a supervised learning paradigm to learn from the noisy pairwise similarity labels that are constructed according to the learned label confidence. Finally, the error accumulation problem is mitigated via information distillation and confidence refinement. Extensive experiments on both uniform and instance-dependent partially labeled datasets demonstrate the effectiveness of AsyCo. The code is available at <a class="link-external link-https" href="https://github.com/libeibeics/AsyCo" rel="external noopener nofollow">this https URL</a>.

Machine Learning,Artificial Intelligence,Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

### What problem does this paper attempt to solve?

This paper primarily addresses the issue of error accumulation in Partial-Label Learning (PLL). Specifically:

1. **Background and Challenges**:
- Partial-Label Learning is a weakly supervised learning method where each training instance has a candidate label set that includes the true label.
- Although self-training PLL models perform well, they suffer from the problem of error accumulation, where misclassified instances lead to a decline in model performance.

2. **Limitations of Existing Methods**:
- Co-training can alleviate the error accumulation problem by having two networks collaborate with each other, but most existing co-training methods use dual-network architectures with the same structure and task, resulting in insufficient complementarity and difficulty in effectively correcting each other's errors.

3. **Proposed Method**:
- This paper proposes an asymmetric dual-task co-training model called AsyCo, which optimizes different tasks so that the two networks learn from different perspectives.
- Specifically, it includes:
- A Disambiguation Network for learning label confidence.
- An Auxiliary Network that uses supervised learning to train on generated noisy similarity labels.
- Further alleviation of the error accumulation problem is achieved through Information Distillation and Confidence Refinement.

In summary, this paper aims to solve the error accumulation problem in Partial-Label Learning by using the asymmetric dual-task co-training model AsyCo, thereby improving the model's performance on partial-label data.