Generate and adjust: a novel framework for semi-supervised pedestrian attribute recognition

Xuebo Shan,Peixi Peng,Yunpeng Zhai,Chong Zhang,Tiejun Huang,Yonghong Tian

DOI: https://doi.org/10.1109/ICMEW53276.2021.9455965

2021-01-01

Abstract:Conventional pedestrian attribute recognition methods typically rely on the assumption that enough well-labeled training samples are available. However, it is hard to be satisfied due to the unaffordable cost of human annotation, especially on big surveillance data. To address this problem, we propose a novel task - semi-supervised pedestrian attribute recognition (Semi-PAR), in which only a few limited labeled data and plenty of unlabeled data are available during training. We tackle the Semi-PAR problem by presenting a novel semi-supervised learning framework. In this framework, a PAR network is firstly designed to extract attribute-specific features, and adopts a similarity graph-based algorithm to generate pseudo-labels. Then we utilize the relationship of each attribute to modify the pseudo-labels, and feed them back to the PAR network to guide the training. Finally, a harmonic confidence loss is introduced to diminish the impact of harmful pseudo-labels. Experiments on three widely-used datasets verify the superiority of our method.