Abstract:Cognitive workload is a crucial factor in tasks involving dynamic decision-making and other real-time and high-risk situations. Neuroimaging techniques have long been used for estimating cognitive workload. Given the portability, cost-effectiveness and high time-resolution of EEG as compared to fMRI and other neuroimaging modalities, an efficient method of estimating an individual’s workload using EEG is of paramount importance. Multiple cognitive, psychiatric and behavioral phenotypes have already been known to be linked with “functional connectivity”, i.e., correlations between different brain regions. In this work, we explored the possibility of using different model-free functional connectivity metrics along with deep learning in order to efficiently classify the cognitive workload of the participants. To this end, 64-channel EEG data of 19 participants were collected while they were doing the traditional n-back task. These data (after pre-processing) were used to extract the functional connectivity features, namely Phase Transfer Entropy (PTE), Mutual Information (MI) and Phase Locking Value (PLV). These three were chosen to do a comprehensive comparison of directed and non-directed model-free functional connectivity metrics (allows faster computations). Using these features, three deep learning classifiers, namely CNN, LSTM and Conv-LSTM were used for classifying the cognitive workload as low (1-back), medium (2-back) or high (3-back). With the high inter-subject variability in EEG and cognitive workload and recent research highlighting that EEG-based functional connectivity metrics are subject-specific, subject-specific classifiers were used. Results show the state-of-the-art multi-class classification accuracy with the combination of MI with CNN at 80.87%, followed by the combination of PLV with CNN (at 75.88%) and MI with LSTM (at 71.87%). The highest subject specific performance was achieved by the combinations of PLV with Conv-LSTM, and PLV with CNN with an accuracy of 97.92%, followed by the combination of MI with CNN (at 95.83%) and MI with Conv-LSTM (at 93.75%). The results highlight the efficacy of the combination of EEG-based model-free functional connectivity metrics and deep learning in order to classify cognitive workload. The work can further be extended to explore the possibility of classifying cognitive workload in real-time, dynamic and complex real-world scenarios.

Assessment of cognitive workload using simultaneous EEG and fNIRS: A comparison of feature combinations

Optimized electroencephalogram and functional near-infrared spectroscopy-based mental workload detection method for practical applications

Measuring Cognitive Workload Using Multimodal Sensors

Subject-Specific Cognitive Workload Classification Using EEG-Based Functional Connectivity and Deep Learning

Classification of mental workload using brain connectivity and machine learning on electroencephalogram data

Mental workload assessment by monitoring brain, heart, and eye with six biomedical modalities during six cognitive tasks

An Evaluation of the EEG alpha-to-theta and theta-to-alpha band Ratios as Indexes of Mental Workload

Evaluating the performance of the cognitive workload model with subjective endorsement in addition to EEG

EEG BASED COGNITIVE WORKLOAD CLASSIFICATION DURING NASA MATB-II MULTITASKING

Enhancing Cognitive Workload Classification Using Integrated LSTM Layers and CNNs for fNIRS Data Analysis

Combining and comparing EEG, peripheral physiology and eye-related measures for the assessment of mental workload

Mental workload classification using convolutional neural networks based on fNIRS-derived prefrontal activity

Exploring cognitive load through neuropsychological features: an analysis using fNIRS-eye tracking

EEG-Based Multiclass Workload Identification Using Feature Fusion and Selection

Application of quantitative EEG analysis to workload assessment in an advanced aircraft simulator

Assessment of Mental Workload Based on Multi-Physiological Signals

Mental workload estimation with electroencephalogram signals by combining multi-space deep models

Mental workload recognition using ECG and machine learning in simulated flight tasks

In-Ear SpO2 for Classification of Cognitive Workload

Classification of mental workload with EEG analysis by using effective connectivity and a hybrid model of CNN and LSTM