Abstract:While the term task load (TL) refers to external task demands, the amount of work, or the number of tasks to be performed, mental workload (MWL) refers to the individual's effort, mental capacity, or cognitive resources utilized while performing a task. MWL in multitasking scenarios is often closely linked with the quantity of tasks a person is handling within a given timeframe. In this study, we challenge this hypothesis from the perspective of electroencephalography (EEG) using a deep learning approach. We conducted an EEG experiment with 50 participants performing NASA Multi-Attribute Task Battery II (MATB-II) under 4 different task load levels. We designed a convolutional neural network (CNN) to help with two distinct classification tasks. In one setting, the CNN was used to classify EEG segments based on their task load level. In another setting, the same CNN architecture was trained again to detect the presence of individual MATB-II subtasks. Results show that, while the model successfully learns to detect whether a particular subtask is active in a given segment (i.e., to differentiate between different subtasks-related EEG patterns), it struggles to differentiate between the two highest levels of task load (i.e., to distinguish MWL-related EEG patterns). We speculate that the challenge comes from two factors: first, the experiment was designed in a way that these two highest levels differed only in the quantity of work within a given timeframe; and second, the participants' effective adaptation to increased task demands, as evidenced by low error rates. Consequently, this indicates that under such conditions in multitasking, EEG may not reflect distinct enough patterns to differentiate higher levels of task load.

What problem does this paper attempt to address?

This paper aims to address the issues of mental workload (MWL) classification and task detection in multi-task scenarios. Specifically, the researchers explore the mental workload of individuals under different task load levels through EEG experiments combined with deep learning methods. ### Research Background and Objectives - **Significance of Mental Workload**: Understanding and managing the psychological resources of operators in high-risk and safety-critical fields is crucial for ensuring their performance and safety. - **Challenges in Multi-tasking**: When operators handle multiple tasks simultaneously, mental workload becomes complex, especially in distinguishing between different task load levels. - **Application of EEG**: EEG can directly measure brain activity and provide real-time insights into cognitive processes, but traditional frequency band analysis methods are limited in multi-task scenarios. ### Specific Research Questions - **Task Load Classification**: Design a Convolutional Neural Network (CNN) to classify EEG segments and distinguish them based on their corresponding task load levels. - **Subtask Detection**: Train the same CNN architecture to detect the presence or absence of specific MATB-II subtasks. ### Experimental Design - **Participants**: A total of 50 healthy participants took part in the experiment. - **Task Setup**: The NASA Multi-Attribute Task Battery II (MATB-II) was used for the experiment, with four different task load levels set (passive observation, low load, medium load, high load). - **Data Collection**: EEG signals were recorded using wireless EEG devices with a sampling frequency of 500 Hz. ### Key Findings - **Subtask Detection**: The model successfully identified the presence or absence of various subtasks, indicating that EEG signals can effectively distinguish different subtasks. - **Task Load Classification**: The model performed well in distinguishing the lowest two task load levels (passive observation and low load) but struggled to differentiate between the highest two task load levels (medium load and high load). - **Reason Analysis**: The highest two task load levels only differed in the number of tasks, and participants adapted well to the increased task demands, making it challenging to distinguish between these two levels. Through this study, the authors aim to verify whether EEG can provide sufficiently clear patterns to distinguish different levels of task load in multi-tasking scenarios. The results show that under certain conditions, EEG may not be sufficient to differentiate higher task load levels.

Mental Workload Classification and Tasks Detection in Multitasking: Deep Learning Insights from EEG Study

EEG workload estimation for simultaneous task using deep learning algorithm

Classification of mental workload with EEG analysis by using effective connectivity and a hybrid model of CNN and LSTM

Identification of Cognitive Workload during Surgical Tasks with Multimodal Deep Learning

Modeling cognitive load as a self-supervised brain rate with electroencephalography and deep learning

Cross-Task Consistency of Electroencephalography-Based Mental Workload Indicators: Comparisons Between Power Spectral Density and Task-Irrelevant Auditory Event-Related Potentials

EEG-Based Mental Workload Assessment in a Simulated Flight Task Using Single-Channel Brain Rhythm Sequence

Subject-Specific Cognitive Workload Classification Using EEG-Based Functional Connectivity and Deep Learning

Mental workload recognition using ECG and machine learning in simulated flight tasks

Enhanced Accuracy for Multiclass Mental Workload Detection Using Long Short-Term Memory for Brain–Computer Interface

Multilevel Feature Fusion With 3D Convolutional Neural Network for EEG-Based Workload Estimation

Monitoring Working Memory Load during Computer-Based Tasks with EEG Pattern Recognition Methods

EEG-Based Person Identification during Escalating Cognitive Load

Topological EEG-Based Functional Connectivity Analysis for Mental Workload State Recognition

Classification of mental workload using brain connectivity and machine learning on electroencephalogram data

Mental Workload Estimation with Electroencephalogram Signals by Combining Multi-Space Deep Models

Cross-Participant EEG-Based Assessment of Cognitive Workload Using Multi-Path Convolutional Recurrent Neural Networks

Letter in response to the manuscript IJC-D-11-02627 entitled "The appropriate number of endpoints to keep validity for Cox proportional hazard analysis".

Detection of multitask mental workload using gamma band power features

Taking a Deeper Look at the Brain: Predicting Visual Perceptual and Working Memory Load From High-Density fNIRS Data