Abstract:Lack of supervision is a particularly challenging problem in E-learning or distance learning environments. A wide range of research efforts and technologies have been explored to alleviate its impact by monitoring students engagement, such as emotion or learning behaviors. However, the current research still lacks multi-dimensional computational measures for analyzing learners engagement from the interactions that occur in digital learning environment. In this paper, we propose an integrated framework to identify learning engagement from three facets: affect, behavior and cognitive state, which are conveyed by learners facial expressions, eye movement behaviors and the overall performance during short video learning session. To recognize the three states of learners, three channel data is recorded: 1) video/image sequence captured by camera; 2) eye movement information from a non-intrusive and cost-effective eye tracker; and 3) click stream data from mouse. Based on these modalities, a multi-channel data fusion strategy is designed that concatenates time series features of three channels in the same time segment to predict course learning performance. We also presented a new method to make the self-reported annotations more reliable without using external observers verification. To validate the approach and methods, 46 participants were invited to attend a representative on-line course that consists of short videos in our designed learning environment. The results demonstrated the effectiveness of the proposed framework and methods in monitoring learning engagement. More importantly, a prototype system was developed to detect learners emotional and eye behavioral engagement in real-time as well as predict the learning performance of learners after they had completed each short video course.

Harnessing Transparent Learning Analytics for Individualized Support through Auto-detection of Engagement in Face-to-Face Collaborative Learning

Learning Analytics in Collaborative Learning Supported by Slack: from the Perspective of Engagement.

Towards Personalized Instruction: Co-designing a Teacher-Centered Dashboard for Learning Engagement Analysis in Blended Learning Environments.

Using Learning Analytics to Support Engagement in Collaborative Writing

An automated group learning engagement analysis and feedback approach to promoting collaborative knowledge building, group performance, and socially shared regulation in CSCL

The Three-Iterative Design and Implementation of a Student-Facing Social Learning Analytics Tool

Using learning analytics to provide personalized recommendations for finding peers

Heterogenous Network Analytics of Small Group Teamwork: Using Multimodal Data to Uncover Individual Behavioral Engagement Strategies

An Integrated Observing Technic for Collaborative Learning: The Multimodal Learning Analytics Based on the Video Coding and EEG Data Mining

Learning Analytics for Online Discussions

Learning Analytics for Online Discussions: Embedded and Extracted Approaches

Recognizing Multidimensional Engagement of E-Learners Based on Multi-Channel Data in E-Learning Environment.

Data-driven Online Learning Engagement Detection via Facial Expression and Mouse Behavior Recognition Technology

Attentive or Not? Toward a Machine Learning Approach to Assessing Students’ Visible Engagement in Classroom Instruction

Informing learning design in online education using learning analytics of student engagement

Using AI-empowered Assessments and Personalized Recommendations to Promote Online Collaborative Learning Performance

Revealing Networks: Understanding Effective Teacher Practices in AI-Supported Classrooms using Transmodal Ordered Network Analysis

Collaboration Analysis Using Deep Learning

MDNN: Predicting Student Engagement Via Gaze Direction and Facial Expression in Collaborative Learning

Effects of personalised feedback approach on knowledge building, emotions, co-regulated behavioural patterns and cognitive load in online collaborative learning

Integrating AI and Learning Analytics for Data-Driven Pedagogical Decisions and Personalized Interventions in Education