Abstract:Embodied cognition explores the intricate interaction between the brain, body, and the surrounding environment. The advancement of mobile devices, such as immersive interactive computing and wireless electroencephalogram (EEG) devices, has presented new challenges and opportunities for studying embodied cognition. To address how mobile technology within immersive hybrid settings affects embodied cognition, we propose a target detection multitask incorporating mixed body movement interference and an environmental distraction light signal. We aim to investigate human embodied cognition in immersive projector-based augmented reality (IPAR) scenarios using wireless EEG technology. We recruited and engaged fifteen participants in four multitasking conditions: standing without distraction (SND), walking without distraction (WND), standing with distraction (SD), and walking with distraction (WD). We pre-processed the EEG data using Independent Component Analysis (ICA) to isolate brain sources and K-means clustering to categorize Independent Components (ICs). Following that, we conducted time-frequency and correlation analyses to identify neural dynamics changes associated with multitasking. Our findings reveal a decline in behavioral performance during multitasking activities. We also observed decreases in alpha and beta power in the frontal and motor cortex during standing target search tasks, decreases in theta power, and increases in alpha power in the occipital lobe during multitasking. We also noted perturbations in theta band power during distraction tasks. Notably, physical movement induced more significant fluctuations in the frontal and motor cortex than distractions from social environment light signals. Particularly in scenarios involving walking and multitasking, there was a noticeable reduction in beta suppression. Our study underscores the importance of brain-body collaboration in multitasking scenarios, where the simultaneous engagement of the body and brain in complex tasks highlights the dynamic nature of cognitive processes within the framework of embodied cognition. Furthermore, integrating immersive augmented reality technology into embodied cognition research enhances our understanding of the interplay between the body, environment, and cognitive functions, with profound implications for advancing human-computer interaction and elucidating cognitive dynamics in multitasking.

Reaction Time as a Proxy for Presence in Mixed Reality with Distraction

Tap into Reality: Understanding the Impact of Interactions on Presence and Reaction Time in Mixed Reality

Investigating the Correlation Between Presence and Reaction Time in Mixed Reality

Human reaction time in a mixed reality environment

The Effects of Immersion and Real-World Distractions on Virtual Social Interactions

Understanding the Impact of the Reality-Virtuality Continuum on Visual Search Using Fixation-Related Potentials and Eye Tracking Features

Exploring Embodied Cognition and Brain Dynamics under Multi-tasks Target Detection in Immerse Projector-based Augmented Reality (IPAR) Scenarios

Measuring and Predicting Multisensory Reaction Latency: A Probabilistic Model for Visual-Auditory Integration

Measuring Attentional Distraction in Children With ADHD Using Virtual Reality Technology With Eye-Tracking

Classification of Internal and External Distractions in an Educational VR Environment Using Multimodal Features

The impact of visual and auditory distractions on the performance of neurodiverse students in virtual reality (VR) environments

Prolonged exposure to mixed reality alters task performance in the unmediated environment

Spatial Presence in Mixed Realities–Considerations About the Concept, Measures, Design, and Experiments

Searching Across Realities: Investigating ERPs and Eye-Tracking Correlates of Visual Search in Mixed Reality

Distraction impact of concurrent conversation on event-related potential based brain-computer interfaces

Breaking presence in Immersive Virtual Reality toward behavioral and emotional engagement

The Effect of Context Switching, Focal Switching Distance, Binocular and Monocular Viewing, and Transient Focal Blur on Human Performance in Optical See-Through Augmented Reality

Quantifying Social Presence in Mixed Reality: A Contemporary Review of Techniques and Innovations

Effects of implied social presence and interaction on attention in a virtual setting

Towards electrophysiological measurement of presence in virtual reality through auditory oddball stimuli

Manipulating Bodily Presence Affects Cross-Modal Spatial Attention: A Virtual-Reality-Based ERP Study