Abstract:Classroom environment is a competent platform for the students to learn and improve their understanding of the subject. An instructor’s primary responsibility lies in managing the students in a way they feel interested and focused during the class. With the aid of automated systems based on artificial intelligence, an instructor can get feedback on the students’ attention span in the class by monitoring their emotions using learning algorithms that can prove to be effective to improve the teaching style of the instructor that can in turn have positive effects on the class. In this paper, we propose an LSTM recurrent neural network trained on an emotional corpus database to extract the speech features and convolutional neural networks trained on the FER2013 facial emotion recognition database were used to predict the speech and facial emotions of the students respectively, in real-time. The live video and audio sequence of the students captured is fed to the learned model to classify the emotions individually. Once the emotions such as anger, sadness, happiness, surprise, fear, disgust and neutral were identified, a decision-making mechanism was used to analyze the predicted emotions and choose the overall group emotion by virtue of the highest peak value achieved. This research approach has the potential to be deployed in video conferences, online classes etc. This implementation proposal should effectively improve the classification accuracy and the relatability of the detected student emotions and facilitate in the design of sophisticated automated learning systems that can be a valuable tool in evaluating both the students and the instructors. The adapted research methodologies and their results are discussed and found to perform suggestively better than the other research works used in the comparison

A Deep Learning-Based Approach for Adaptive Virtual Learning with Human Facial Emotion Detection

Facial emotion recognition based real-time learner engagement detection system in online learning context using deep learning models

Enhancing Student Engagement in Online Learning through Facial Expression Analysis and Complex Emotion Recognition using Deep Learning

Deep Learning-Based Interactive Dashboard for Enhancing Online Classroom Experience Through Student Emotion Analysis

A facial and vocal emotion recognition system based on deep learning

Implementation of an adaptive E-learning platform with facial emotion recognition

An optimized deep convolutional neural network for adaptive learning using feature fusion in multimodal data

Classroom Student Emotions Classification from Facial Expressions and Speech Signals using Deep Learning

Application of Deep Learning on Student Engagement in e-learning environments

A Deep Learning-based Emotion Recognition System for Interactive E-Learning

CNN for Facial Emotion Recognition in Online Learning Platforms to Identify Learner Engagement

A multimodal facial cues based engagement detection system in e-learning context using deep learning approach

Artificial intelligence based cognitive state prediction in an e-learning environment using multimodal data

Exploring AI Facial Recognition for Real-time Emotion Detection: Assessing Student Engagement in Online Learning Environments

Revolutionizing online education: Advanced facial expression recognition for real-time student progress tracking via deep learning model

Advances and Application of Facial Expression and Learning Emotion Recognition in Classroom

Facial Recognition System to Detect Student Emotions and Cheating in Distance Learning

Real Time Emotion Analysis Using Deep Learning for Education, Entertainment, and Beyond

Classifying Emotions and Engagement in Online Learning Based on a Single Facial Expression Recognition Neural Network

Evaluation of Online Teaching Quality Based on Facial Expression Recognition

Student Emotion Recognition Using Computer Vision as an Assistive Technology for Education