Abstract:Online Learning Environments (OLEs) have become essential in global education, especially during and after the COVID-19 pandemic. However, OLEs face a challenge in recognizing student emotions, hindering educators' ability to provide effective support. To address this issue, researchers emphasize the importance of a balanced dataset and a precise model for academic emotion detection in OLEs. However, the widely-used DAiSEE dataset is imbalanced and contains videos captured in well-lit environments. However, real-time observations reveal students' diverse lighting conditions and proximity to cameras. Consequently, models trained on DAiSEE dataset exhibit poor accuracy. In response, this work suggests a customized DAiSEE dataset and proposes the Xception-based transfer learned model and AffectXception model. Our customization process involves selectively extracting single-label frames with intensity levels 2 or 3 from the original DAiSEE dataset. To enhance dataset diversity and tackle the issue of dataset imbalance, we meticulously apply data augmentation techniques on these extracted frames. This results in frames that showcase variations in lighting, both low and high, as well as diverse camera perspectives. As a result, the customized DAiSEE dataset is now well-balanced and exceptionally suitable for training deep learning models to detect academic emotions in online learners. Then we trained and tested both proposed models on this dataset. The AffectXception model outperforms existing models, achieving significant improvements. For Boredom, Engagement, Confusion, and Frustration, it attains accuracy rates of 77%, 79.28%, 83.76%, and 91.87%, respectively. Additionally, we evaluate the AffectXception model on the Online Learning Spontaneous Facial Expression Database (OL-SFED), obtaining competitive results across various emotion classes. This work empowers educators to adjust their content and delivery methods based on learners' emotional states, resulting in more effective and informative online sessions. As OLEs continue to play a crucial role in education, our approach enhances their capacity to address students' emotional needs.

Study on the Distance Learners’ Academic Emotions Using Online Learning Behavior Data

A Case Study of Learning Action and Emotion from a Perspective of Learning Analytics

The impact of Online and Offline Learning motivation on learning performance: the mediating role of positive academic emotion

Influences of Learning Emotion on Learning Outcome in Online Teaching Mode

Are students happier the more they learn? – Research on the influence of course progress on academic emotion in online learning

An empirical study on learners’ learning emotion and learning effect in offline learning environment

What factors can support students' deep learning in the online environment: The mediating role of learning self-efficacy and positive academic emotions?

Prediction of College Students' Classroom Learning Effect Considering Positive Learning Emotion

Affective E-Learning: Using "emotional" Data to Improve Learning in Pervasive Learning Environment

A Multimodal Intelligent Emotion Perception Framework by Data-driven and Knowledge-guided

A Framework of Online Learning and Experiment System Based on Affective Computing

Emotion Recognition of College Students' Online Learning Engagement Based on Deep Learning

Personalized Online Education Learning Strategies Based on Transfer Learning Emotion Classification Model

Emotion generation method in online physical education teaching based on data mining of teacher-student interactions

Affective State Analysis During Online Learning Based on Learning Behavior Data

A Study on Emotion Analysis for Online Learning Based on Students' Feedback via Social Networks

Interaction and learning engagement in online learning: The mediating roles of online learning self-efficacy and academic emotions

Detecting Academic Affective States of Learners in Online Learning Environments Using Deep Transfer Learning

A study on the mechanisms of teachers' academic emotions and motivational beliefs on learning engagement in the context of online training

Research on Online Learner Modeling and Course Recommendation Based on Emotional Factors

An E-learner's Emotion Model of Text Using: I. Fundamental Issues for a DDE Model