Exploring Interactions and Regulations in Collaborative Learning: An Interdisciplinary Multimodal Dataset

Yante Li,Yang Liu,KhÁnh Nguyen,Henglin Shi,Eija Vuorenmaa,Sanna Jarvela,Guoying Zhao

DOI: https://doi.org/10.48550/arXiv.2210.05419

2022-10-11

Abstract:Collaborative learning is an educational approach that enhances learning through shared goals and working together. Interaction and regulation are two essential factors related to the success of collaborative learning. Since the information from various modalities can reflect the quality of collaboration, a new multimodal dataset with cognitive and emotional triggers is introduced in this paper to explore how regulations affect interactions during the collaborative process. Specifically, a learning task with intentional interventions is designed and assigned to high school students aged 15 years old (N=81) in average. Multimodal signals, including video, Kinect, audio, and physiological data, are collected and exploited to study regulations in collaborative learning in terms of individual-participant-single-modality, individual-participant-multiple-modality, and multiple-participant-multiple-modality. Analysis of annotated emotions, body gestures, and their interactions indicates that our multimodal dataset with designed treatments could effectively examine moments of regulation in collaborative learning. In addition, preliminary experiments based on baseline models suggest that the dataset provides a challenging in-the-wild scenario, which could further contribute to the fields of education and affective computing.

Computer Vision and Pattern Recognition,Databases

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how the interaction and regulation mechanisms affect the learning effect during the collaborative learning process. Specifically, the authors designed a collaborative learning task that includes cognitive triggers and emotional triggers, and collected a multi - modal dataset, including video, Kinect data, audio, and physiological signals, to explore the influence of these triggers on the interaction among participants and their regulatory role in the collaborative process. By analyzing the annotated emotions, body postures and their interactions, the researchers hope to verify that this multi - modal dataset can effectively examine the regulatory moments in collaborative learning and make valuable contributions to the fields of education and affective computing. The main research questions of the paper can be summarized as follows: 1. **The relationship between interaction and regulation**: Research on how different types of regulation (such as cognitive regulation and emotional regulation) affect the interaction patterns of participants in collaborative learning. 2. **The application of multi - modal data**: Explore the application value of multi - modal data (including facial video, Kinect data, audio, and physiological signals) in analyzing collaborative learning interactions. 3. **The effect of external interventions**: Evaluate the specific effects of the designed triggers (cognitive triggers and emotional triggers) on emotional changes and interaction patterns in the collaborative learning process. Through the answers to these questions, researchers hope to provide new insights into the theory and practice of collaborative learning and promote the development of related technologies.

Exploring Interactions and Regulations in Collaborative Learning: An Interdisciplinary Multimodal Dataset

Many are the ways to learn identifying multi-modal behavioral profiles of collaborative learning in constructivist activities

An Integrated Observing Technic for Collaborative Learning: The Multimodal Learning Analytics Based on the Video Coding and EEG Data Mining

A First Step in Using Machine Learning Methods to Enhance Interaction Analysis for Embodied Learning Environments

Automatically Detecting Confusion and Conflict During Collaborative Learning Using Linguistic, Prosodic, and Facial Cues

Bridging learning sciences, machine learning and affective computing for understanding cognition and affect in collaborative learning

From Complexity to Parsimony: Integrating Latent Class Analysis to Uncover Multimodal Learning Patterns in Collaborative Learning

Regulation of emotions in project-based collaborative learning: an empirical study in academic English classrooms

Multimodal learning analytics of collaborative patterns during pair programming in higher education

Understanding Student Engagement Based on Multimodal Data in Different Types of Agent-Based Collaborative Learning Contexts

Exploring Fluctuations in Collaborative Engagement: How Do Cognitive and Socio-Emotional Interaction Intertwine in Online Collaborative Learning?

Heterogenous Network Analytics of Small Group Teamwork: Using Multimodal Data to Uncover Individual Behavioral Engagement Strategies

An Advanced Learning Environment Aided by Recognition of Multi-modal Social Signals

MUTLA: A Large-Scale Dataset for Multimodal Teaching and Learning Analytics

Exploring the Behavioral Patterns of Co-regulation in Mobile Computer-Supported Collaborative Learning.

Multimodal data indicators for capturing cognitive, motivational, and emotional learning processes: A systematic literature review

A Multimodal Intelligent Emotion Perception Framework by Data-driven and Knowledge-guided

Collaborative Learning Quality Classification Through Physiological Synchrony Recorded by Wearable Biosensors

Exploring What Synchronized Physiological Arousal Can Reveal about the Social Regulatory Process in a Collaborative Argumentation Activity.

Multimodal Methods for Analyzing Learning and Training Environments: A Systematic Literature Review

The Role of Functional Near-Infrared Spectroscopy in Collaborative Research: A systematic Review