Two-Aspect Information Interaction Model for ABAW4 Multi-task Challenge

Hong‐Bo Sun,Liancun Zheng,Bin Liu,Jianhua Tao,Li Sun,Cong Cai,Ya‐Ling He
DOI: https://doi.org/10.1007/978-3-031-25075-0_13
2023-01-01
Abstract:The task of ABAW is to predict frame-level emotion descriptors from videos: discrete emotional state; valence and arousal; and action units. In this paper, we propose the solution to the Multi-Task Learning (MTL) Challenge of the 4th Affective Behavior Analysis in-the-wild (ABAW) competition. Although researchers have proposed several approaches and achieved promising results in ABAW, current works in this task rarely consider interactions between different emotion descriptors. To this end, we propose a novel end to end architecture to achieve full integration of different types of information. Experimental results demonstrate the effectiveness of our proposed solution. Code are available at https://github.com/Swiftsss/ECCV2022MTL .
What problem does this paper attempt to address?