Abstract:Abstract Objective. To date, most research on electroencephalography (EEG)-based mental workload detection for passive brain-computer interface (pBCI) applications has focused on identifying the overall level of cognitive resources required, such as whether the workload is high or low. We propose, however, that being able to determine the specific type of cognitive resources being used, such as visual or auditory, would also be useful. This would enable the pBCI to take more appropriate action to reduce the overall level of cognitive demand on the user. For example, if a high level of workload was detected and it is determined that the user is primarily engaged in visual information processing, then the pBCI could cause some information to be presented aurally instead. In our previous work we showed that EEG could be used to differentiate visual from auditory processing tasks when the level of processing is high, but the two modalities could not be distinguished when the level of cognitive processing demand was very low. The current study aims to build on this work and move toward the overall objective of developing a pBCI that is capable of predicting both the level and the type of cognitive resources being used. Approach. Fifteen individuals undertook carefully designed visual and auditory tasks while their EEG data was being recorded. In this study, we incorporated a more diverse range of sensory processing conditions including not only single-modality conditions (i.e. those requiring one of either visual or auditory processing) as in our previous study, but also dual-modality conditions (i.e. those requiring both visual and auditory processing) and no-task/baseline conditions (i.e. when the individual is not engaged in either visual or auditory processing). Main results. Using regularized linear discriminant analysis within a hierarchical classification algorithm, the overall cognitive demand was predicted with an accuracy of more than 86%, while the presence or absence of visual and auditory sensory processing were each predicted with an accuracy of approximately 70%. Significance. The findings support the feasibility of establishing a pBCI that can determine both the level and type of attentional resources required by the user at any given moment. This pBCI could assist in enhancing safety in hazardous jobs by triggering the most effective and efficient adaptation strategies when high workload conditions are detected.

Estimating cognitive workload using a commercial in-ear EEG headset

Assessing focus through ear-EEG: a comparative study between conventional cap EEG and mobile in- and around-the-ear EEG systems

In-Ear SpO2 for Classification of Cognitive Workload

EEG-TNet: an End-To-End Brain Computer Interface Framework for Mental Workload Estimation

Evaluation of Mental Workload in Working Memory Tasks with Different Information Types Based on EEG.

Using EEG Signals to Assess Workload during Memory Retrieval in a Real-world Scenario

EEG-based hierarchical classification of level of demand and modality of auditory and visual sensory processing

Application of quantitative EEG analysis to workload assessment in an advanced aircraft simulator

Optimized electroencephalogram and functional near-infrared spectroscopy-based mental workload detection method for practical applications

Assessment of Mental Workload Based on Multi-Physiological Signals

Real-time estimation of EEG-based engagement in different tasks

EEG/fNIRS Based Workload Classification Using Functional Brain Connectivity and Machine Learning

EEG-Based Mental Workload Assessment in a Simulated Flight Task Using Single-Channel Brain Rhythm Sequence

Mental workload assessment by monitoring brain, heart, and eye with six biomedical modalities during six cognitive tasks

Mental workload estimation with electroencephalogram signals by combining multi-space deep models

An Evaluation of the EEG alpha-to-theta and theta-to-alpha band Ratios as Indexes of Mental Workload

Unobtrusive measurement of cognitive load and physiological signals in uncontrolled environments

EEG-Based Prediction of Cognitive Load in Intelligence Tests

Mental Workload Classification Based on Ignored Auditory Probes and Spatial Covariance