Real-time estimation of EEG-based engagement in different tasks

Angela Natalizio,Sebastian Sieghartsleitner,Leonhard Schreiner,Martin Walchshofer,Antonio Esposito,Josef Scharinger,Harald Pretl,Pasquale Arpaia,Marco Parvis,Jordi Solé-Casals,Marc Sebastián-Romagosa,Rupert Ortner,Christoph Guger
DOI: https://doi.org/10.1088/1741-2552/ad200d
IF: 5.043
2024-01-20
Journal of Neural Engineering
Abstract:Objective: Recent trends in brain-computer interface (BCI) research concern the passive monitoring of brain activity, which aim to monitor a wide variety of cognitive states. Engagement is such a cognitive state, which is of interest in contexts such as learning, entertainment or rehabilitation. This study proposes a novel approach for real-time estimation of engagement during different tasks using electroencephalography (EEG). Approach: Twenty-three healthy subjects participated in the BCI experiment. A modified version of the d2 test was used to elicit engagement. Within-subject classification models which discriminate between engaging and resting states were trained based on EEG recorded during a d2 test based paradigm. The EEG was recorded using eight electrodes and the classification model was based on Filter-Bank Common Spatial Patterns and a Linear Discriminant Analysis. The classification models were evaluated in cross-task applications, namely when playing Tetris at different speeds (i.e., slow, medium, fast) and when watching two videos (i.e., advertisement and landscape video). Additionally, subjects' perceived engagement was quantified using a questionnaire. Main results: The models achieved a classification accuracy of 90 % on average when tested on an independent d2 test paradigm recording. Subjects' perceived and estimated engagement were found to be greater during the advertisement compared to the landscape video (p = 0.025 and p < 0.001, respectively); greater during medium and fast compared to slow Tetris speed (p < 0.001, respectively); not different between medium and fast Tetris speeds. Additionally, a common linear relationship was observed for perceived and estimated engagement (r rm = 0.44, p < 0.001). Finally, theta and alpha band powers were investigated, which respectively increased and decreased during more engaging states. Significance: This study proposes a task-specific EEG engagement estimation model with cross-task capabilities, offering a framework for real-world applications.
engineering, biomedical,neurosciences
What problem does this paper attempt to address?
The paper attempts to address the problem of real-time estimation of EEG-based engagement across different tasks. Specifically, the goal of the research is to develop a new method to monitor the level of engagement in real-time through EEG when individuals perform various tasks. This method particularly focuses on how to estimate engagement across tasks in practical applications, thereby providing technical support for personalized adaptive systems in fields such as education, medical rehabilitation, and entertainment. The research background points out that engagement is a positive state encompassing multiple dimensions such as workload state, attention, motivation, interest, and emotion. Its measurement is of great significance for improving therapeutic outcomes, optimizing educational platforms, and enhancing gaming experiences. Traditional methods of engagement assessment mainly rely on self-report questionnaires, interviews, and direct observation. In recent years, biological signals such as skin conductance response, heart rate, and EEG have been used for indirect engagement assessment. Among these, EEG is considered one of the most promising technologies for engagement assessment due to its ability to provide rich information about psychological states. To achieve this goal, the research team designed a classification model based on Filter-Bank Common Spatial Patterns (FB-CSP) and Linear Discriminant Analysis (LDA) to distinguish between engagement and rest states. In the experiments, participants first completed two modified versions of the d2 test paradigm to train and validate the classification model. Subsequently, the model was applied to different tasks, including playing Tetris at different speeds and watching two types of videos (advertisements and landscape videos), to evaluate its generalization ability across different tasks. Additionally, the study also surveyed participants' subjective perception of engagement through questionnaires and conducted a comparative analysis with the engagement estimated by the model. In summary, this study aims to develop an EEG technology framework capable of real-time, accurate estimation of individual engagement across various task scenarios, providing support for practical applications.