Automatic Recognition and Analysis of Academic Emotions Based on Facial Expressions during Online Learning Environments

Yaping Xu,Yaqian Zheng,Keru Li,Yanyan Li
DOI: https://doi.org/10.1145/3629296.3629350
2023-01-01
Abstract:Emotions can significantly affect the learning effect. The affective states of students can be automatically recognized through behavioral cues using machine learning techniques. However, in the field of education, researchers mainly focus on the detection and analysis of basic emotions and pay little attention to learning-centered emotions. The reason for this phenomenon is the lack of datasets labeled with academic emotions. To address this shortcoming, a spontaneous facial dataset was constructed in this study through actual online learning activities. Then, the convolutional neural networks were used to train the academic emotion recognition models based on the dataset. Finally, the optimal model was selected to recognize and analyze the academic emotions of two groups of students with different academic achievements, and the emotional changes of two of them were observed. The results show that the average accuracy of academic emotion recognition is 79%. When analyzing the affective states of the two groups of students, it is found that the high-achiever group has a higher proportion of positive emotions and less neutral emotions, while the proportion of negative emotions is basically the same in the two groups of learners. In addition, the emotional evolution process of different achievement learners showed obvious differences. This study provides technical support for applications such as supporting accurate online intervention, constructing perfect learner portraits, and mining online learning behaviors.
What problem does this paper attempt to address?