Abstract:Abstract Objective. To date, most research on electroencephalography (EEG)-based mental workload detection for passive brain-computer interface (pBCI) applications has focused on identifying the overall level of cognitive resources required, such as whether the workload is high or low. We propose, however, that being able to determine the specific type of cognitive resources being used, such as visual or auditory, would also be useful. This would enable the pBCI to take more appropriate action to reduce the overall level of cognitive demand on the user. For example, if a high level of workload was detected and it is determined that the user is primarily engaged in visual information processing, then the pBCI could cause some information to be presented aurally instead. In our previous work we showed that EEG could be used to differentiate visual from auditory processing tasks when the level of processing is high, but the two modalities could not be distinguished when the level of cognitive processing demand was very low. The current study aims to build on this work and move toward the overall objective of developing a pBCI that is capable of predicting both the level and the type of cognitive resources being used. Approach. Fifteen individuals undertook carefully designed visual and auditory tasks while their EEG data was being recorded. In this study, we incorporated a more diverse range of sensory processing conditions including not only single-modality conditions (i.e. those requiring one of either visual or auditory processing) as in our previous study, but also dual-modality conditions (i.e. those requiring both visual and auditory processing) and no-task/baseline conditions (i.e. when the individual is not engaged in either visual or auditory processing). Main results. Using regularized linear discriminant analysis within a hierarchical classification algorithm, the overall cognitive demand was predicted with an accuracy of more than 86%, while the presence or absence of visual and auditory sensory processing were each predicted with an accuracy of approximately 70%. Significance. The findings support the feasibility of establishing a pBCI that can determine both the level and type of attentional resources required by the user at any given moment. This pBCI could assist in enhancing safety in hazardous jobs by triggering the most effective and efficient adaptation strategies when high workload conditions are detected.

Electroencephalography (EEG) classification of cognitive tasks based on task engagement index

Real-time estimation of EEG-based engagement in different tasks

Classification for Different Mental Tasks Based on EEG Signals

The Automatic Detection of Cognition Using EEG and Facial Expressions

An AMCMD Approach for Robust EEG Signal Classification: Unraveling Neurophysiological Insights and BCI Applications

Sustained Attention States Recognition with EEG and Eye-Tracking in the GradCPT.

An Extended Computer Aided Diagnosis System for Robust BCI Applications

EEG-Based Prediction of Cognitive Load in Intelligence Tests

Efficacy of Measuring Engagement during Computer-Based Training with Low-Cost Electroencephalogram (EEG) Sensor Outputs

Mental task classification for brain computer interface application

Monitoring Alert and Drowsy States by Modeling EEG Source Nonstationarity

EEG BASED COGNITIVE WORKLOAD CLASSIFICATION DURING NASA MATB-II MULTITASKING

EEG-based Mental Workload Recognition Related to Multitasking

EEG-based hierarchical classification of level of demand and modality of auditory and visual sensory processing

Mental Task Classification Based on Approximate Entropy of EEG

Analyzing Brain Activity During Learning Tasks with EEG and Machine Learning

Monitoring Working Memory Load during Computer-Based Tasks with EEG Pattern Recognition Methods

Study on Brain Computer Interface Based on Cognitive Task

Analysis of Complex Cognitive Task and Pattern Recognition Using Distributed Patterns of EEG Signals with Cognitive Functions

Scalp Electroencephalogram-Derived Involvement Indexes during a Working Memory Task Performed by Patients with Epilepsy

Neural Networks Meet Neural Activity: Utilizing EEG for Mental Workload Estimation