Exploring Embodied Cognition and Brain Dynamics under Multi-tasks Target Detection in Immerse Projector-based Augmented Reality (IPAR) Scenarios

Congying He,Yu-Yi Chen,Chun-Ren Phang,I-Ping Chen,Shey-Cherng Tzou,Tzyy-Ping Jung,Li-Wei Ko

DOI: https://doi.org/10.1109/TNSRE.2024.3442241

2024-08-12

Abstract:Embodied cognition explores the intricate interaction between the brain, body, and the surrounding environment. The advancement of mobile devices, such as immersive interactive computing and wireless electroencephalogram (EEG) devices, has presented new challenges and opportunities for studying embodied cognition. To address how mobile technology within immersive hybrid settings affects embodied cognition, we propose a target detection multitask incorporating mixed body movement interference and an environmental distraction light signal. We aim to investigate human embodied cognition in immersive projector-based augmented reality (IPAR) scenarios using wireless EEG technology. We recruited and engaged fifteen participants in four multitasking conditions: standing without distraction (SND), walking without distraction (WND), standing with distraction (SD), and walking with distraction (WD). We pre-processed the EEG data using Independent Component Analysis (ICA) to isolate brain sources and K-means clustering to categorize Independent Components (ICs). Following that, we conducted time-frequency and correlation analyses to identify neural dynamics changes associated with multitasking. Our findings reveal a decline in behavioral performance during multitasking activities. We also observed decreases in alpha and beta power in the frontal and motor cortex during standing target search tasks, decreases in theta power, and increases in alpha power in the occipital lobe during multitasking. We also noted perturbations in theta band power during distraction tasks. Notably, physical movement induced more significant fluctuations in the frontal and motor cortex than distractions from social environment light signals. Particularly in scenarios involving walking and multitasking, there was a noticeable reduction in beta suppression. Our study underscores the importance of brain-body collaboration in multitasking scenarios, where the simultaneous engagement of the body and brain in complex tasks highlights the dynamic nature of cognitive processes within the framework of embodied cognition. Furthermore, integrating immersive augmented reality technology into embodied cognition research enhances our understanding of the interplay between the body, environment, and cognitive functions, with profound implications for advancing human-computer interaction and elucidating cognitive dynamics in multitasking.