Multimodal Learning Engagement Assessment System: An Innovative Approach to Optimizing Learning Engagement
Chuangqi LiXinying WengYifan LiTianxin Zhanga College of Computer and Information Engineering,Henan Normal University,Xinxiang,Henan,Chinab Key Laboratory of Artificial Intelligence and Personalized Learning in Education of Henan Province,Xinxiang,Henan,Chinac School of Journalism and Communication,Gannan Normal University,Gan Zhou Shi,Jiang Xi Sheng,ChinaChuangqi Li is currently studying computer science and technology at the School of Computer and Information Engineering,Henan Normal University,China. His research interests include the intersection of deep learning,computer vision,artificial intelligence,and education,as well as medicine.Xinying Weng is currently pursuing a degree in Internet of Things Engineering at the College of Computer and Information Engineering,Henan Normal University. Her research interests include artificial intelligence,deep learning,and machine learning.Yifan Li is currently pursuing her undergraduate studies at the School of Computer and Information Engineering,Henan Normal University. Her research interests lie in the field of artificial intelligence and emotion recognition.Tianxin Zhang is a postgraduate student at the School of Journalism and Communication,Gannan Normal University. She has a background in education and computing,with a focus on issues in the field of AI educational applications and digital educational resources.
DOI: https://doi.org/10.1080/10447318.2024.2338616
IF: 4.92
2024-04-18
International Journal of Human-Computer Interaction
Abstract:In the realm of global smart education, optimizing classroom learning efficiency is paramount. This study harnesses cutting-edge technology to delve into learning engagement dynamics. Leveraging the XGBoost model, 468 facial and bodily features are captured in real-time, offering insights into student behavior. The ResNet neural transformation network and PNP algorithm discern facial expressions, body movements, and head rotation angles. Through a fuzzy comprehensive evaluation method, proportions of these factors are delineated for objective assessment. Empirical validation involves scrutinizing final exam scores of 234 college students. Comparative analyses reveal a significant correlation between classroom participation and performance (p-value = 0.034). Results underscore the impact of real-time judgment on learning efficiency and highlight the potency of multimodal fusion in assessing engagement comprehensively. Practical application validates system effectiveness, offering insights for educational stakeholders and contributing to the evolution of smart education.
computer science, cybernetics,ergonomics