Current State of Educational Reform and Approaches to Active Learning in NIT, Gifu College

Nobuyuki Ogawa,Akira Shimizu

DOI: https://doi.org/10.1016/j.procs.2016.08.185

2016-10-01

Abstract:

What problem does this paper attempt to address?

Differential Brain Activation for Four Emotions in VR-2D and VR-3D Modes

Chuanrui Zhang,Lei Su,Shuaicheng Li,Yunfa Fu

DOI: https://doi.org/10.3390/brainsci14040326

IF: 3.333

2024-03-29

Brain Sciences

Abstract:Similar to traditional imaging, virtual reality (VR) imagery encompasses nonstereoscopic (VR-2D) and stereoscopic (VR-3D) modes. Currently, Russell's emotional model has been extensively studied in traditional 2D and VR-3D modes, but there is limited comparative research between VR-2D and VR-3D modes. In this study, we investigate whether Russell's emotional model exhibits stronger brain activation states in VR-3D mode compared to VR-2D mode. By designing an experiment covering four emotional categories (high arousal–high pleasure (HAHV), high arousal–low pleasure (HALV), low arousal–low pleasure (LALV), and low arousal–high pleasure (LAHV)), EEG signals were collected from 30 healthy undergraduate and graduate students while watching videos in both VR modes. Initially, power spectral density (PSD) computations revealed distinct brain activation patterns in different emotional states across the two modes, with VR-3D videos inducing significantly higher brainwave energy, primarily in the frontal, temporal, and occipital regions. Subsequently, Differential entropy (DE) feature sets, selected via a dual ten-fold cross-validation Support Vector Machine (SVM) classifier, demonstrate satisfactory classification accuracy, particularly superior in the VR-3D mode. The paper subsequently presents a deep learning-based EEG emotion recognition framework, adeptly utilizing the frequency, spatial, and temporal information of EEG data to improve recognition accuracy. The contribution of each individual feature to the prediction probabilities is discussed through machine-learning interpretability based on Shapley values. The study reveals notable differences in brain activation states for identical emotions between the two modes, with VR-3D mode showing more pronounced activation.

neurosciences
Emotional effect of cinematic VR compared with traditional 2D film

Ni Ding,Wen Zhou,Anthony Y.H. Fung

DOI: https://doi.org/10.1016/j.tele.2018.04.003

IF: 9.14

2018-09-01

Telematics and Informatics

Abstract:Virtual reality (VR) has been increasingly applied in filmmaking in recent years. The integration of film and VR is becoming an important breakthrough for traditional films. This new types of film, named cinematic virtual reality (CVR), provides immersive VR experience where individual users can immerse themselves in synthetic world experience in 360° (Mateer, 2017). However, the characteristics and influence of this new digital media on human emotion is far from clear. In this study, we conducted an experiment to investigate the different emotional effects of CVR by comparing with a traditional two-dimensional (2D) film from two critical aspects: subjective emotional experience and real-time objective physiological reaction. Our results first revealed that the subjective experience and the physiological reaction showed significantly stronger emotional effect in the CVR condition than in the 2D condition. Upon further observation, we found that four emotions (excitement, nervousness, hostility, and jitteriness) are more closely correlated with the CVR than with the traditional 2D film. Real-time analysis of skin temperature shows a faster and steadier decline in the CVR group than in the 2D group. Finally, we summarized the causality of the effect by analyzing the characteristics of CVR. Our study suggests that CVR is an effective medium that induces stronger emotional experience and physiological reaction than traditional 2D film can. The design of the VR environment in CVR, as a key feature in the narrative of a film story, has an important influence on the emotional processing of the audience.

information science & library science
A High-Density EEG Study Investigating the Neural Correlates of Continuity Editing Theory in VR Films

Wanqiu Cheng,Xuefei Wang,Jiahui Zou,Mingxuan Li,Feng Tian

DOI: https://doi.org/10.3390/s23135886

2023-06-25

Abstract:This paper presents a cognitive psychology experiment to explore the differences between 2D and virtual reality (VR) film editing techniques. We recruited sixteen volunteers to view a range of different display modes and edit types of experimental material. An electroencephalogram (EEG) was recorded simultaneously while the participants watched. Subjective results showed that the VR mode reflects higher load scores, particularly in the effort dimension. Different editing types have no effect on subjective immersion scores. The VR mode elicited stronger EEG energy, with differences concentrated in the occipital, parietal, and central regions. On the basis of this, visual evoked potential (VEP) analyses were conducted, and the results indicated that VR mode triggered greater spatial attention, while editing in 2D mode induced stronger semantic updating and active understanding. Furthermore, we found that while the effect of different edit types in both display modes is similar, cross-axis editing triggered greater cognitive violations than continuity editing, which could serve as scientific theoretical support for the development of future VR film editing techniques.
Neurophysiological and Subjective Analysis of VR Emotion Induction Paradigm

Ming Li,Junjun Pan,Yang Gao,Yang Shen,Fang Luo,Ju Dai,Aimin Hao,Hong Qin

DOI: https://doi.org/10.1109/tvcg.2022.3203099

IF: 5.2

2022-10-26

IEEE Transactions on Visualization and Computer Graphics

Abstract:The ecological validity of emotion-inducing scenarios is essential for emotion research. In contrast to the classical passive induction paradigm, immersive VR fully engages the psychological and physiological components of the subject, which is considered an ecologically valid paradigm for studying emotion. Several studies investigate the emotional responses to different VR tasks or games using subjective scales. However, little research regards VR as an eliciting material, especially when systematically analyzing emotional processes in VR from a neurophysiological perspective. To fill this gap and scientifically evaluate VR's ability to be used as an active method for emotion elicitation, we investigate the dynamic relationship between explicit information (subjective evaluations) and implicit information (objective neurophysiological data). A total of 28 participants are enlisted to watch eight VR videos while their SAM/IPQ scores and EEG data are recorded simultaneously. In ecologically valid scenarios, the subjective results demonstrate that VR has significant advantages for evoking emotion in arousal-valence. This conclusion is backed by our examination of objective neurophysiological evidence that VR videos effectively induce high-arousal emotions. In addition, we obtain features of critical channels and frequency oscillations associated with emotional valence, thereby validating previous research in more lifelike circumstances. In particular, we discover hemispheric asymmetry in the occipital region under high and low emotional arousal, which adds to our understanding of neural features and the dynamics of emotional arousal. As a result, we successfully integrate EEG and VR to demonstrate that VR is more pragmatic for evoking natural feelings and is beneficial for emotional research. Our research has set a precedent for new methodologies of using VR induction paradigms to acquire a more reliable explanation of affective computing.

computer science, software engineering
A High-Density EEG Study Investigating VR Film Editing and Cognitive Event Segmentation Theory

Feng Tian,Hui Wang,Wanqiu Cheng,Wenrui Zhang,Yingjie Li

DOI: https://doi.org/10.3390/s21217176

2021-10-28

Abstract:This paper introduces a cognitive psychological experiment that was conducted to analyze how traditional film editing methods and the application of cognitive event segmentation theory perform in virtual reality (VR). Thirty volunteers were recruited and asked to watch a series of short VR videos designed in three dimensions: time, action (characters), and space. Electroencephalograms (EEG) were recorded simultaneously during their participation. Subjective results show that any of the editing methods used would lead to an increased load and reduced immersion. Furthermore, the cognition of event segmentation theory also plays an instructive role in VR editing, with differences mainly focusing on frontal, parietal, and central regions. On this basis, visual evoked potential (VEP) analysis was performed, and the standardized low-resolution brain electromagnetic tomography algorithm (sLORETA) traceability method was used to analyze the data. The results of the VEP analysis suggest that shearing usually elicits a late event-related potential component, while the sources of VEP are mainly the frontal and parietal lobes. The insights derived from this work can be used as guidance for VR content creation, allowing VR image editing to reveal greater richness and unique beauty.
Direct comparison of virtual reality and 2D delivery on sense of presence, emotional and physiological outcome measures

Caroline Kuhne,Eda D. Kecelioglu,Steven Maltby,Rebecca J. Hood,Brendon Knott,Elizabeth Ditton,Frederick Rohan Walker,Murielle G. Kluge

DOI: https://doi.org/10.3389/frvir.2023.1211001

2023-08-17

Frontiers in Virtual Reality

Abstract:Introduction: Virtual-reality (VR) technology has, over the last decade, quickly expanded from gaming into other sectors including training, education, and wellness. One of the most popular justifications for the use of VR over 2D is increased immersion and engagement. However, very little fundamental research has been produced evaluating the comparative impact of immersive VR on the user’s cognitive, physiological, and emotional state. Methods: A within-subject cross-over study design was used to directly compare VR and 2D screen delivery of different subject matter content. Both physiological and self-report data were collected for scenes containing calming nature environments, aggressive social confrontations, and neutral content. Results: Compared to 2D, the VR delivery resulted in a higher sense of presence, higher ratings of engagement, fun, and privacy. Confrontational scenes were rated as more tense whilst calming scenes were rated as more relaxing when presented in VR compared to 2D. Physiological data indicated that the scenes promoted overall states of arousal and relaxation in accordance with the scene subject matter (both VR and 2D). However, heart rate (HR) and galvanic skin response (GSR) were consistently higher throughout the VR delivery condition compared to 2D, including responses during scenes of neutral and calming subject matter. Discussion: This discrepancy between emotional and physiological responses for calming and neutral content in VR suggest an elevated arousal response driven by VR immersion that is independent of the emotional and physiological responses to the subject matter itself. These findings have important implications for those looking to develop and utilize VR technology as a training and educational tool as they provide insights into the impact of immersion on the user.
Investigating the Relationship between Momentary Emotion Self-reports and Head and Eye Movements in HMD-based 360° VR Video Watching

Tong Xue,Abdallah El Ali,Gangyi Ding,Pablo Cesar

DOI: https://doi.org/10.1145/3411763.3451627

2021-05-08

Abstract:Inferring emotions from Head Movement (HM) and Eye Movement (EM) data in 360° Virtual Reality (VR) can enable a low-cost means of improving users’ Quality of Experience. Correlations have been shown between retrospective emotions and HM, as well as EM when tested with static 360° images. In this early work, we investigate the relationship between momentary emotion self-reports and HM/EM in HMD-based 360° VR video watching. We draw on HM/EM data from a controlled study (N=32) where participants watched eight 1-minute 360° emotion-inducing video clips, and annotated their valence and arousal levels continuously in real-time. We analyzed HM/EM features across fine-grained emotion labels from video segments with varying lengths (5-60s), and found significant correlations between HM rotation data, as well as some EM features, with valence and arousal ratings. We show that fine-grained emotion labels provide greater insight into how HM/EM relate to emotions during HMD-based 360° VR video watching.
Linking brain–heart interactions to emotional arousal in immersive virtual reality

A. Fourcade,F. Klotzsche,S. M. Hofmann,A. Mariola,V. V. Nikulin,A. Villringer,M. Gaebler

DOI: https://doi.org/10.1111/psyp.14696

2024-10-16

Psychophysiology

Abstract:The subjective experience of emotions is linked to the contextualized perception and appraisal of changes in bodily (e.g., heart) activity. Increased emotional arousal has been related to attenuated high‐frequency heart rate variability (HF‐HRV), lower EEG parieto‐occipital alpha power, and higher heartbeat‐evoked potential (HEP) amplitudes. We studied emotional arousal‐related brain–heart interactions using immersive virtual reality (VR) for naturalistic yet controlled emotion induction. Twenty‐nine healthy adults (13 women, age: 26 ± 3) completed a VR experience that included rollercoasters while EEG and ECG were recorded. Continuous emotional arousal ratings were collected during a video replay immediately after. We analyzed emotional arousal‐related changes in HF‐HRV as well as in BHIs using HEPs. Additionally, we used the oscillatory information in the ECG and the EEG to model the directional information flows between the brain and heart activity. We found that higher emotional arousal was associated with lower HEP amplitudes in a left fronto‐central electrode cluster. While parasympathetic modulation of the heart (HF‐HRV) and parieto‐occipital EEG alpha power were reduced during higher emotional arousal, there was no evidence for the hypothesized emotional arousal‐related changes in bidirectional information flow between them. Whole‐brain exploratory analyses in additional EEG (delta, theta, alpha, beta and gamma) and HRV (low‐frequency, LF, and HF) frequency bands revealed a temporo‐occipital cluster, in which higher emotional arousal was linked to decreased brain‐to‐heart (i.e., gamma→HF‐HRV) and increased heart‐to‐brain (i.e., LF‐HRV → gamma) information flow. Our results confirm previous findings from less naturalistic experiments and suggest a link between emotional arousal and brain–heart interactions in temporo‐occipital gamma power.

psychology, experimental,physiology,neurosciences, biological
Multimodal Assessment of Changes in Physiological Indicators when Presenting a Video Fragment on Screen (2D) versus a VR (3D) Environment

Elena Kriklenko,Anastasia Kovaleva,Aleksei Klimenko,Usman Dukuev,Sergey Pertsov

DOI: https://doi.org/10.1155/2022/5346128

2022-11-28

Behavioural Neurology

Abstract:The increasing role of virtual environments in society, especially in the context of the pandemic and evolving metaverse technologies, requires a closer study of the physiological state of humans using virtual reality (VR) for entertainment, work, or learning. Despite the fact that many physiological reactions to the content presented in various modalities under VR conditions have already been described, often these studies do not reflect the full range of changes in the physiological reactions that occur to a person during their immersion in the virtual world. This study was designed to find and compare the most sensitive physiological indicators that change when viewing an emotionally intense video fragment in standard format on screen and in virtual reality conditions (in a VR helmet). The research methodology involved randomly presenting a group of subjects with visual content—a short video clip—first on screen (2D) and then in a virtual reality helmet (3D). A special feature of this study is the use of multimodal physiological state assessment throughout the content presentation, in conjunction with psychological testing of the study participants before and after the start of the study. It has been discovered that the most informative physiological indicators reflecting the subjects’ condition under virtual reality conditions were changes in theta rhythm amplitude, skin conductance, standard deviation of normal RR-intervals (SDRR), and changes in photoplethysmogram (PPG). The study results suggest that in the process of immersion in a virtual environment, the participants develop a complex functional state, different from the state when watching on screen, which is characterised by the restructuring of autonomic regulation and activation of emotion structures of the brain.

clinical neurology
Heart rate variability analysis for the assessment of immersive emotional arousal using virtual reality: Comparing real and virtual scenarios

Javier Marín-Morales,Juan Luis Higuera-Trujillo,Jaime Guixeres,Carmen Llinares,Mariano Alcañiz,Gaetano Valenza

DOI: https://doi.org/10.1371/journal.pone.0254098

IF: 3.7

2021-07-01

PLoS ONE

Abstract:Many affective computing studies have developed automatic emotion recognition models, mostly using emotional images, audio and videos. In recent years, virtual reality (VR) has been also used as a method to elicit emotions in laboratory environments. However, there is still a need to analyse the validity of VR in order to extrapolate the results it produces and to assess the similarities and differences in physiological responses provoked by real and virtual environments. We investigated the cardiovascular oscillations of 60 participants during a free exploration of a real museum and its virtualisation viewed through a head-mounted display. The differences between the heart rate variability features in the high and low arousal stimuli conditions were analysed through statistical hypothesis testing; and automatic arousal recognition models were developed across the real and the virtual conditions using a support vector machine algorithm with recursive feature selection. The subjects’ self-assessments suggested that both museums elicited low and high arousal levels. In addition, the real museum showed differences in terms of cardiovascular responses, differences in vagal activity, while arousal recognition reached 72.92% accuracy. However, we did not find the same arousal-based autonomic nervous system change pattern during the virtual museum exploration. The results showed that, while the direct virtualisation of a real environment might be self-reported as evoking psychological arousal, it does not necessarily evoke the same cardiovascular changes as a real arousing elicitation. These contribute to the understanding of the use of VR in emotion recognition research; future research is needed to study arousal and emotion elicitation in immersive VR.

multidisciplinary sciences
Linking brain-heart interactions to emotional arousal in immersive virtual reality

A. Fourcade,F. Klotzsche,S. M. Hofmann,A. Mariola,V. V. Nikulin,A. Villringer,M. Gaebler

DOI: https://doi.org/10.1101/2024.01.04.574165

2024-01-04

Abstract:The subjective experience of emotions is rooted in the contextualized perception of changes in bodily (e.g., heart) activity. Increased emotional arousal (EA) has been related to lower high- frequency heart rate variability (HF-HRV), lower EEG parieto-occipital alpha power, and higher heartbeat-evoked potential (HEP) amplitudes. We studied EA-related brain-heart interactions (BHIs) using immersive virtual reality (VR) for naturalistic yet controlled emotion induction. 29 healthy adults (13 women, age: 26±3) completed a VR experience that included rollercoasters while EEG and ECG were recorded. Continuous EA ratings were collected during a video replay immediately after. We analyzed EA-related changes in HF-HRV as well as in BHIs using HEPs and directional functional BHI modeling. Higher EA was associated with lower HEP amplitudes in a left fronto-central electrode cluster. While parasympathetic modulation of the heart (HF-HRV) and parieto-occipital EEG alpha power were reduced during higher EA, there was no evidence for the hypothesized EA-related changes in bidirectional information flow between them. Whole-brain exploratory analyses in additional EEG (delta, theta, alpha, beta and gamma) and HRV (low-frequency, LF, and HF) frequency bands indicated a temporo-occipital cluster, in which higher EA was linked to decreased brain-to-heart (gamma→HF-HRV) and increased heart-to-brain (LF-HRV→gamma) information flow. Our results confirm previous findings from less naturalistic experiments and suggest EA-related BHI changes in temporo-occipital gamma power.

Neuroscience
Exploring empathic engagement in immersive media: An EEG study on mu rhythm suppression in VR

Jong-Hyun Lee,Sung Eun Lee,Young-Sung Kwon

DOI: https://doi.org/10.1371/journal.pone.0303553

IF: 3.7

2024-05-18

PLoS ONE

Abstract:This study investigates the influence of immersive media, particularly Virtual Reality (VR), on empathic responses, in comparison to traditional television (TV), using electroencephalography (EEG). We employed mu rhythm suppression as a measurable neural marker to gauge empathic engagement, as its increase generally signifies heightened empathic responses. Our findings exhibit a greater mu rhythm suppression in VR conditions compared to TV conditions, suggesting a potential enhancement in empathic responses with VR. Furthermore, our results revealed that the strength of empathic responses was not confined to specific actions depicted in the video clips, underscoring the possibility of broader implications. This research contributes to the ongoing discourse on the effects of different media environments on empathic engagement, particularly emphasizing the unique role of immersive technologies such as VR. It invites further investigation into how such technologies can shape and potentially enhance the empathic experience.

multidisciplinary sciences
A comparative analysis of face and object perception in 2D laboratory and virtual reality settings: insights from induced oscillatory responses

Schöne, Benjamin

DOI: https://doi.org/10.1007/s00221-024-06935-3

2024-10-13

Experimental Brain Research

Abstract:In psychophysiological research, the use of Virtual Reality (VR) for stimulus presentation allows for the investigation of how perceptual processing adapts to varying degrees of realism. Previous time-domain studies have shown that perceptual processing involves modality-specific neural mechanisms, as evidenced by distinct stimulus-locked components. Analyzing induced oscillations across different frequency bands can provide further insights into neural processes that are not strictly phase-locked to stimulus onset. This study uses a simple perceptual paradigm presenting images of faces and cars on both a standard 2D monitor and in an immersive VR environment. To investigate potential modality-dependent differences in attention, cognitive load, and task-related post-movement processing, the induced alpha, theta and beta band responses are compared between the two modalities. No evidence was found for differences in stimulus-dependent attention or task-related post-movement processing between the 2D conditions and the realistic virtual conditions in electrode space, as posterior alpha suppression and re-synchronization of centro-parietal beta did not differ between conditions. However, source analysis revealed differences in the attention networks engaged during 2D and 3D perception. Midfrontal theta was significantly stronger in laboratory conditions, indicating higher cognitive load than in the VR environment. Exploratory analysis of posterior theta showed stronger responses in VR, possibly reflecting the processing of depth information provided only by the 3D material. In addition, the theta response seems to be generated by distinct neuronal sources under realistic virtual conditions indicating enhanced involvement of semantic information processing and social cognition.

neurosciences
Enhanced Attention Using Head-mounted Virtual Reality

Gang Li,Joaquin A Anguera,Samirah V Javed,Muḥammad Adeel Khan,Guoxing Wang,Adam Gazzaley,Joaquin A. Anguera,Samirah V. Javed

DOI: https://doi.org/10.1162/jocn_a_01560

2020-08-01

Journal of Cognitive Neuroscience

Abstract:Abstract Some evidence suggests that experiencing a given scenario using virtual reality (VR) may engage greater attentional resources than experiencing the same scenario on a 2D computer monitor. However, the underlying neural processes associated with these VR-related effects, especially those pertaining to current consumer-friendly head-mounted displays of virtual reality (HMD-VR), remain unclear. Here, two experiments were conducted to compare task performance and EEG-based neural metrics captured during a perceptual discrimination task presented on two different viewing platforms. Forty participants (20–25 years old) completed this task using both an HMD-VR and traditional computer monitor in a within-group, randomized design. Although Experiment I (n = 20) was solely behavioral in design, Experiment II (n = 20) utilized combined EEG recordings to interrogate the neural correlates underlying potential performance differences across platforms. These experiments revealed that (1) there was no significant difference in the amount of arousal measured between platforms and (2) selective attention abilities in HMD-VR environment were enhanced from both a behavioral and neural perspective. These findings suggest that the allocation of attentional resources in HMD-VR may be superior to approaches more typically used to assess these abilities (e.g., desktop/laptop/tablet computers with 2D screens).

psychology, experimental,neurosciences
Multimodal Physiological Analysis of Cognitive Affective Effect of Immersive Learning in Virtual Reality

Yu Li,Yang Shen

DOI: https://doi.org/10.1145/3644523.3644549

2023-10-13

Abstract:This paper used videos to assess the impact of emotion on learners‘ attention, and employed a Continuous Performance Test (CPT) task to evaluate the effectiveness of physiological signal pattern recognition, all under immersive virtual reality environment. A total of eighteen subjects were recruited for this study, and they were shown four videos with different emotional tendencies. After watching each video, the subjects were required to complete a mood scale and a CPT task. Simultaneously, EEG and PPG data were collected from the participants. This study found that the valence and arousal of emotions have an impact on attention, and that there are distinct physiological patterns that can be used to measure attention. In the future, it is hopefully captured through learners' multimodal data for computation to quantitatively assess learners' attention levels, providing effective means for status evaluation in learning analytics.

Psychology,Computer Science
EEG-based emotion recognition in an immersive virtual reality environment: From local activity to brain network features

Minchang Yu,Shasha Xiao,Minlei Hua,Hui Wang,Xi Chen,Feng Tian,Yingjie Li

DOI: https://doi.org/10.1016/j.bspc.2021.103349

IF: 5.1

2022-02-01

Biomedical Signal Processing and Control

Abstract:Emotion electroencephalography (EEG) datasets play a significant role in EEG-based emotion recognition research, providing a platform for comparisons of different emotion recognition methods. Most datasets used 2D images or videos as mood induction procedures (MIPs); however, considering the differences in EEG dynamics between 2D and 3D environments, experimental research based on 2D MIPs may have poor results being applied in a real 3D world. In this paper, we (1) developed a new emotion EEG dataset, virtual reality (VR) emotional EEG dataset (VREED), which used 3D VR videos as MIPs; and (2) Presented a baseline for the performance of negative/positive emotion classification in the new dataset. The best average accuracy of 73.77% ± 2.01% was obtained by using the combination of theta (4–8 Hz), alpha (8–13 Hz), beta (13–30 Hz), and gamma (30–49 Hz) relative power features. Additionally, we observed that occipital and frontal regions played a more critical role than other regions in emotion processing from Spearman correlation analysis and feature selection. This new VR emotion EEG dataset will be publicly available, and we encourage other researchers to evaluate their emotion classification methods on the VREED.

engineering, biomedical
Comparing emotional states induced by 360$^{\circ}$ videos via head-mounted display and computer screen

Jan-Niklas Voigt-Antons,Eero Lehtonen,Andres Pinilla Palacios,Danish Ali,Tanja Kojić,Sebastian Möller

DOI: https://doi.org/10.48550/arXiv.2004.01532

2020-04-03

Abstract:In recent years 360$^{\circ}$ videos have been becoming more popular. For traditional media presentations, e.g., on a computer screen, a wide range of assessment methods are available. Different constructs, such as perceived quality or the induced emotional state of viewers, can be reliably assessed by subjective scales. Many of the subjective methods have only been validated using stimuli presented on a computer screen. This paper is using 360$^{\circ}$ videos to induce varying emotional states. Videos were presented 1) via a head-mounted display (HMD) and 2) via a traditional computer screen. Furthermore, participants were asked to rate their emotional state 1) in retrospect on the self-assessment manikin scale and 2) continuously on a 2-dimensional arousal-valence plane. In a repeated measures design, all participants (N = 18) used both presentation systems and both rating systems. Results indicate that there is a statistically significant difference in induced presence due to the presentation system. Furthermore, there was no statistically significant difference in ratings gathered with the two presentation systems. Finally, it was found that for arousal measures, a statistically significant difference could be found for the different rating methods, potentially indicating an underestimation of arousal ratings gathered in retrospect for screen presentation. In the future, rating methods such as a 2-dimensional arousal-valence plane could offer the advantage of enabling a reliable measurement of emotional states while being more embedded in the experience itself, enabling a more precise capturing of the emotional states.

Multimedia,Human-Computer Interaction
Multimodal Physiological Analysis of Impact of Emotion on Cognitive Control in VR

Ming Li,Junjun Pan,Yu Li,Yang Gao,Hong Qin,Yang Shen

DOI: https://doi.org/10.1109/TVCG.2024.3372101

Abstract:Cognitive control is often perplexing to elucidate and can be easily influenced by emotions. Understanding the individual cognitive control level is crucial for enhancing VR interaction and designing adaptive and self-correcting VR/AR applications. Emotions can reallocate processing resources and influence cognitive control performance. However, current research has primarily emphasized the impact of emotional valence on cognitive control tasks, neglecting emotional arousal. In this study, we comprehensively investigate the influence of emotions on cognitive control based on the arousal-valence model. A total of 26 participants are recruited, inducing emotions through VR videos with high ecological validity and then performing related cognitive control tasks. Leveraging physiological data including EEG, HRV, and EDA, we employ classification techniques such as SVM, KNN, and deep learning to categorize cognitive control levels. The experiment results demonstrate that high-arousal emotions significantly enhance users' cognitive control abilities. Utilizing complementary information among multi-modal physiological signal features, we achieve an accuracy of 84.52% in distinguishing between high and low cognitive control. Additionally, time-frequency analysis results confirm the existence of neural patterns related to cognitive control, contributing to a better understanding of the neural mechanisms underlying cognitive control in VR. Our research indicates that physiological signals measured from both the central and autonomic nervous systems can be employed for cognitive control classification, paving the way for novel approaches to improve VR/AR interactions.
Nature in the Heart and Mind of the Beholder: Psycho-Emotional and EEG Differences in Perception of Virtual Nature Due to Gender

Artem Davidov,Olga Razumnikova,Maxim Bakaev

DOI: https://doi.org/10.3390/vision7020030

2023-04-03

Vision

Abstract:Natural environment experiences in virtual reality (VR) can be a feasible option for people unable to connect with real nature. Existing research mostly focuses on health and emotional advantages of the “virtual nature” therapy, but studies of its neuropsychological effects related to visual perception are rare. In our experiment, 20 subjects watched nature-related video content in VR headsets (3D condition) and on a computer screen (2D condition). In addition to the gender factor, we considered the individual Environmental Identity Index (EID) and collected the self-assessment of the emotional state per the components of Valence, Arousal, and Dominance in each experimental condition. Besides the psychometric data, we also registered brainwave activity (EEG) and analyzed it with the 7 frequency bands. For EID, which was considerably higher in women, we found significant positive correlation with Valence (i.e., beneficial effect of the natural stimuli on the psycho-emotional status). At the same time, the analysis of the EEG data suggests a considerable impact of the VR immersion itself, with higher relaxation alpha effect in 3D vs. 2D condition in men. The novel and most pronounced effect of the gender factor was found in the relation between the EID and the EEG powers in the high-frequency bands—that is, positive correlation of these variables in women (0.64 < Rs < 0.74) but negative correlation in men (−0.66 < Rs < −0.72). Our results imply individually different and gender-dependent effects of the natural stimulus in VR. Correspondingly, the video and VR content development should consider this and aim to provide a user characteristics-tailored experience.
An Empirical Study of Geography Learning on Students’ Emotions and Motivation in Immersive Virtual Reality

Yang Shen,Zhaoxue Wang,Ming Li,Jing Yuan,Yunchao Gu

DOI: https://doi.org/10.3389/feduc.2022.831619

2022-02-23

Frontiers in Education

Abstract:This paper assesses the impact of emotional arousal on learning through a virtual reality video of geography immersion learning. Validity was measured with traditional questionnaire data and using electroencephalography (EEG). Twenty-four human subjects were recruited and presented with eight geography immersive learning videos with different affective tendencies. EEG data of the subjects were collected while they were watching the videos. After the video watching, subjects were requested to fill in an emotion scale, a learning motivation scale, and a mind flow experience. The results of the study show that VR video learning materials can well induce the positive and negative emotions of the subjects. Compared with negative emotions, the alpha band power in the frontal lobe of the brain, beta and gamma bands in the temporal lobe region is significantly higher under positive emotions. In addition, the results of the subjective scales indicate that subjects have stronger intrinsic motivations and better flow experiences under positive emotions. However, there was no significant difference for the immersion under positive and negative emotions. Our findings demonstrate the usability of teaching virtual reality situational geography stories and the broad value of using this teaching method for future instruction.

Current State of Educational Reform and Approaches to Active Learning in NIT, Gifu College

Differential Brain Activation for Four Emotions in VR-2D and VR-3D Modes

Emotional effect of cinematic VR compared with traditional 2D film

A High-Density EEG Study Investigating the Neural Correlates of Continuity Editing Theory in VR Films

Neurophysiological and Subjective Analysis of VR Emotion Induction Paradigm

A High-Density EEG Study Investigating VR Film Editing and Cognitive Event Segmentation Theory

Direct comparison of virtual reality and 2D delivery on sense of presence, emotional and physiological outcome measures

Investigating the Relationship between Momentary Emotion Self-reports and Head and Eye Movements in HMD-based 360° VR Video Watching

Linking brain–heart interactions to emotional arousal in immersive virtual reality

Multimodal Assessment of Changes in Physiological Indicators when Presenting a Video Fragment on Screen (2D) versus a VR (3D) Environment

Heart rate variability analysis for the assessment of immersive emotional arousal using virtual reality: Comparing real and virtual scenarios

Linking brain-heart interactions to emotional arousal in immersive virtual reality

Exploring empathic engagement in immersive media: An EEG study on mu rhythm suppression in VR

A comparative analysis of face and object perception in 2D laboratory and virtual reality settings: insights from induced oscillatory responses

Enhanced Attention Using Head-mounted Virtual Reality

Multimodal Physiological Analysis of Cognitive Affective Effect of Immersive Learning in Virtual Reality

EEG-based emotion recognition in an immersive virtual reality environment: From local activity to brain network features

Comparing emotional states induced by 360$^{\circ}$ videos via head-mounted display and computer screen

Multimodal Physiological Analysis of Impact of Emotion on Cognitive Control in VR

Nature in the Heart and Mind of the Beholder: Psycho-Emotional and EEG Differences in Perception of Virtual Nature Due to Gender

An Empirical Study of Geography Learning on Students’ Emotions and Motivation in Immersive Virtual Reality