Exploring Expression-related Self-supervised Learning for Affective Behaviour Analysis

Fanglei Xue,Yifan Sun,Yi Yang
2023-03-19
Abstract:This paper explores an expression-related self-supervised learning (SSL) method (ContraWarping) to perform expression classification in the 5th Affective Behavior Analysis in-the-wild (ABAW) competition. Affective datasets are expensive to annotate, and SSL methods could learn from large-scale unlabeled data, which is more suitable for this task. By evaluating on the Aff-Wild2 dataset, we demonstrate that ContraWarping outperforms most existing supervised methods and shows great application potential in the affective analysis area. Codes will be released on: <a class="link-external link-https" href="https://github.com/youqingxiaozhua/ABAW5" rel="external noopener nofollow">this https URL</a>.
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?