CenterMatch: A Center Matching Method for Semi-supervised Facial Expression Recognition.

Linhuang Wang,Xin Kang,Satoshi Nakagawa,Fuji Ren

DOI: https://doi.org/10.1007/978-981-99-8537-1_30

2024-01-01

Abstract:The label uncertainty in large-scale qualitative facial expression datasets, caused by low-quality images and subjective annotations, combined with the high similarity between facial expression categories, makes facial expression recognition (FER) more challenging compared to traditional classification tasks. To address this problem, this paper proposes a new method called CenterMatch for semi-supervised facial expression recognition. Our approach sets class centers in a high-dimensional space and independent adaptive confidence thresholds for each category. As the positions of class centers are continuously updated by high-quality sample features, the confidence thresholds for each category adapt accordingly. Subsequently, high-confidence unlabeled samples are selected and assigned high-quality pseudo-labels, effectively suppressing label uncertainty. Additionally, we introduce a distance loss to constrain the updating direction of class centers, encouraging them to move away from each other and overcome the challenge of high similarity between expression categories. Experimental results demonstrate that our model outperforms other semi-supervised learning methods by adaptively adjusting confidence thresholds based on the learning status and difficulty of different categories, achieving a favorable balance between the quality and quantity of pseudo-labels. Furthermore, our approach exhibits excellent performance on multiple widely-used challenging in-the-world datasets, confirming its effectiveness and generalizability.