Multimodal Physiological Analysis of Cognitive Affective Effect of Immersive Learning in Virtual Reality

Yu Li,Yang Shen
DOI: https://doi.org/10.1145/3644523.3644549
2023-10-13
Abstract:This paper used videos to assess the impact of emotion on learners‘ attention, and employed a Continuous Performance Test (CPT) task to evaluate the effectiveness of physiological signal pattern recognition, all under immersive virtual reality environment. A total of eighteen subjects were recruited for this study, and they were shown four videos with different emotional tendencies. After watching each video, the subjects were required to complete a mood scale and a CPT task. Simultaneously, EEG and PPG data were collected from the participants. This study found that the valence and arousal of emotions have an impact on attention, and that there are distinct physiological patterns that can be used to measure attention. In the future, it is hopefully captured through learners' multimodal data for computation to quantitatively assess learners' attention levels, providing effective means for status evaluation in learning analytics.
Psychology,Computer Science
What problem does this paper attempt to address?