Abstract:Summary The ability of facial expression recognition, the ability to decipher human emotions from facial features, and we can judge the emotional state of human beings by analysing facial expressions. Empowered by this technology, the related research of student sentiment analysis has become a focal point in the realm of educational technology. Teachers can now read the emotional state of their students and estimate the effectiveness of their teaching strategies, enabling them to implement appropriate intervention techniques to enhance teaching outcomes. However, facial expression recognition techniques are currently limited by their shortcomings. Network performance degradation and loss of feature information are key issues that hinder the effectiveness of sentiment analysis of student feedback. To overcome these limitations, in this paper, we propose RFMNet, a novel network model based on deep learning theory. RFMNet, with its higher extraction capability, is designed to accurately analyse student expressions. It introduces a relation‐aware global attention (RGA) module, which facilitates the integration of more discriminative expression features in the image, leading to more refined sentiment analysis. This innovative model also employs a Mish activation function and a focal loss function. The Mish activation function is of particular interest because it helps to avoid the loss of feature information due to neuron deactivation when the ReLU gradient is . This approach results in a more robust and accurate facial expression recognition model. Our model was tested on the FERPlus public dataset. The model achieved an average recognition accuracy of 89.62%, which is a testament to its performance in decoding the facial expressions of students. This precision allows for intelligent processing of teaching information and real‐time feedback, enabling teachers to adapt their teaching strategies to better suit the needs of their students.

Online teaching emotion analysis based on GRU and nonlinear transformer algorithm

Emotion recognition and achievement prediction for foreign language learners under the background of network teaching

A Method for Analyzing Learning Sentiment Based on Classroom Time-Series Images

Evaluation of Online Teaching Quality Based on Facial Expression Recognition

An Online Education Effect Assessing Method Based on YOLOv8 and Vision Transformer

Emotion-Aware Transformer Encoder for Empathetic Dialogue Generation

Classifying Emotions and Engagement in Online Learning Based on a Single Facial Expression Recognition Neural Network

Multimodal Emotion Recognition and State Analysis of Classroom Video and Audio Based on Deep Neural Network

Exploring multimodal data analysis for emotion recognition in teachers’ teaching behavior based on LSTM and MSCNN

Classroom Student Emotions Classification from Facial Expressions and Speech Signals using Deep Learning

Automated Assessment of Encouragement and Warmth in Classrooms Leveraging Multimodal Emotional Features and ChatGPT

A Teacher and Student Facial Expression Recognition Model Based on Classroom Teaching Videos

Student Sentiment Analysis and Classroom Feedback Prediction Using Deep Learning

A facial and vocal emotion recognition system based on deep learning

Learning Modality-Fused Representation Based on Transformer for Emotion Analysis

Neuro or Symbolic? Fine-tuned Transformer with Unsupervised LDA Topic Clustering for Text Sentiment Analysis

Exploring AI Facial Recognition for Real-time Emotion Detection: Assessing Student Engagement in Online Learning Environments

EmT: A Novel Transformer for Generalized Cross-subject EEG Emotion Recognition

A novel relation‐aware global attention network for sentiment analysis of students in the wisdom classroom

Design of an Online Education Evaluation System Based on Multimodal Data of Learners.

A Simple and Interactive Transformer for Fine-Grained Emotion Detection