Abstract:Embodied cognition explores the intricate interaction between the brain, body, and the surrounding environment. The advancement of mobile devices, such as immersive interactive computing and wireless electroencephalogram (EEG) devices, has presented new challenges and opportunities for studying embodied cognition. To address how mobile technology within immersive hybrid settings affects embodied cognition, we propose a target detection multitask incorporating mixed body movement interference and an environmental distraction light signal. We aim to investigate human embodied cognition in immersive projector-based augmented reality (IPAR) scenarios using wireless EEG technology. We recruited and engaged fifteen participants in four multitasking conditions: standing without distraction (SND), walking without distraction (WND), standing with distraction (SD), and walking with distraction (WD). We pre-processed the EEG data using Independent Component Analysis (ICA) to isolate brain sources and K-means clustering to categorize Independent Components (ICs). Following that, we conducted time-frequency and correlation analyses to identify neural dynamics changes associated with multitasking. Our findings reveal a decline in behavioral performance during multitasking activities. We also observed decreases in alpha and beta power in the frontal and motor cortex during standing target search tasks, decreases in theta power, and increases in alpha power in the occipital lobe during multitasking. We also noted perturbations in theta band power during distraction tasks. Notably, physical movement induced more significant fluctuations in the frontal and motor cortex than distractions from social environment light signals. Particularly in scenarios involving walking and multitasking, there was a noticeable reduction in beta suppression. Our study underscores the importance of brain-body collaboration in multitasking scenarios, where the simultaneous engagement of the body and brain in complex tasks highlights the dynamic nature of cognitive processes within the framework of embodied cognition. Furthermore, integrating immersive augmented reality technology into embodied cognition research enhances our understanding of the interplay between the body, environment, and cognitive functions, with profound implications for advancing human-computer interaction and elucidating cognitive dynamics in multitasking.

Leveraging Hyperscanning EEG and VR Omnidirectional Treadmill to Explore Inter-Brain Synchrony in Collaborative Spatial Navigation

Bidirectional understanding and cooperation: interbrain neural synchronization during social navigation

Inter-Brain Network Underlying Turn-Based Cooperation and Competition: A Hyperscanning Study Using Near-Infrared Spectroscopy

A New Research Trend in Social Neuroscience: Towards an Interactive-Brain Neuroscience

An Analytical Approach for Naturalistic Cooperative and Competitive EEG-Hyperscanning Data: A Proof-of-Concept Study

Neural Correlates of Cooperation During Interactive Visuomotor Task: an Fnirs Hyperscanning Study

Team-work, Team-brain: Exploring synchrony and team interdependence in a nine-person drumming task via multiparticipant hyperscanning and inter-brain network topology with fNIRS

Cooperation with partners of differing social experience: An fNIRS-based hyperscanning study

Alpha Modulation in Parietal and Retrosplenial Cortex Correlates with Navigation Performance

Mobile brain/body imaging of landmark‐based navigation with high‐density EEG

Dynamic inter-brain synchrony in real-life inter-personal cooperation: A functional near-infrared spectroscopy hyperscanning study

Coordination Elicits Synchronous Brain Activity Between Co-actors: Frequency Ratio Matters

Structural and Functional Neural Correlates of Spatial Navigation: a Combined Voxel-Based Morphometry and Functional Connectivity Study.

The Underlying neural mechanisms of interpersonal situations on collaborative ability: A hyperscanning study using functional near-infrared spectroscopy

Exploring Embodied Cognition and Brain Dynamics under Multi-tasks Target Detection in Immerse Projector-based Augmented Reality (IPAR) Scenarios

Inter-Brain Synchrony in Open-Ended Collaborative Learning: An fNIRS-Hyperscanning Study

Exploring Inter-Brain Electroencephalogram Patterns for Social Cognitive Assessment During Jigsaw Puzzle Solving

Increased Interbrain Synchronization and Neural Efficiency of the Frontal Cortex to Enhance Human Coordinative Behavior: A Combined Hyper-tES and fNIRS Study

A Collaborative Brain-Computer Interface for Improving Human Performance

Neuronal Oscillatory Signatures of Joint Attention and Intersubjectivity in Arrhythmic Coaction

'The Mind' promotes brain synchronization: an ecological evaluation of brain synchronization in co-operative tasks