Appeal: Allow Mislabeled Samples the Chance to be Rectified in Partial Label Learning

Chongjie Si,Xuehui Wang,Yan Wang,Xiaokang Yang,Wei Shen
2024-03-28
Abstract:In partial label learning (PLL), each instance is associated with a set of candidate labels among which only one is ground-truth. The majority of the existing works focuses on constructing robust classifiers to estimate the labeling confidence of candidate labels in order to identify the correct one. However, these methods usually struggle to identify and rectify mislabeled samples. To help these mislabeled samples "appeal" for themselves and help existing PLL methods identify and rectify mislabeled samples, in this paper, we propose the first appeal-based PLL framework. Specifically, we introduce a novel partner classifier and instantiate it predicated on the implicit fact that non-candidate labels of a sample should not be assigned to it, which is inherently accurate and has not been fully investigated in PLL. Furthermore, a novel collaborative term is formulated to link the base classifier and the partner one. During each stage of mutual supervision, both classifiers will blur each other's predictions through a blurring mechanism to prevent overconfidence in a specific label. Extensive experiments demonstrate that the appeal and disambiguation ability of several well-established stand-alone and deep-learning based PLL approaches can be significantly improved by coupling with this learning paradigm.
Machine Learning
What problem does this paper attempt to address?
The paper primarily aims to address a key issue in Partial Label Learning (PLL), which is how to correct mislabeled samples (i.e., correct wrongly labeled samples). In PLL, each instance is associated with a set of candidate labels, among which only one label is the true ground-truth label. Most existing methods focus on building robust classifiers to estimate the annotation confidence of candidate labels to identify the correct label. However, these methods often struggle to identify and correct mislabeled samples. To help these mislabeled samples "appeal" and assist existing PLL methods in identifying and correcting these samples, the authors propose the first appeal-based PLL framework. Specifically, they introduce a new auxiliary classifier, designed based on the implicit fact that non-candidate labels should not be assigned to samples. Additionally, a new collaboration term is proposed to connect the base classifier and the auxiliary classifier. During each mutual supervision phase, the two classifiers blur each other's predictions through a fuzzy mechanism to prevent overconfidence in specific labels. Experimental results show that incorporating this learning paradigm into several established independent and deep learning-based PLL methods can significantly enhance their appeal and deblurring capabilities.