Abstract:Cognitive workload is a crucial factor in tasks involving dynamic decision-making and other real-time and high-risk situations. Neuroimaging techniques have long been used for estimating cognitive workload. Given the portability, cost-effectiveness and high time-resolution of EEG as compared to fMRI and other neuroimaging modalities, an efficient method of estimating an individual’s workload using EEG is of paramount importance. Multiple cognitive, psychiatric and behavioral phenotypes have already been known to be linked with “functional connectivity”, i.e., correlations between different brain regions. In this work, we explored the possibility of using different model-free functional connectivity metrics along with deep learning in order to efficiently classify the cognitive workload of the participants. To this end, 64-channel EEG data of 19 participants were collected while they were doing the traditional n-back task. These data (after pre-processing) were used to extract the functional connectivity features, namely Phase Transfer Entropy (PTE), Mutual Information (MI) and Phase Locking Value (PLV). These three were chosen to do a comprehensive comparison of directed and non-directed model-free functional connectivity metrics (allows faster computations). Using these features, three deep learning classifiers, namely CNN, LSTM and Conv-LSTM were used for classifying the cognitive workload as low (1-back), medium (2-back) or high (3-back). With the high inter-subject variability in EEG and cognitive workload and recent research highlighting that EEG-based functional connectivity metrics are subject-specific, subject-specific classifiers were used. Results show the state-of-the-art multi-class classification accuracy with the combination of MI with CNN at 80.87%, followed by the combination of PLV with CNN (at 75.88%) and MI with LSTM (at 71.87%). The highest subject specific performance was achieved by the combinations of PLV with Conv-LSTM, and PLV with CNN with an accuracy of 97.92%, followed by the combination of MI with CNN (at 95.83%) and MI with Conv-LSTM (at 93.75%). The results highlight the efficacy of the combination of EEG-based model-free functional connectivity metrics and deep learning in order to classify cognitive workload. The work can further be extended to explore the possibility of classifying cognitive workload in real-time, dynamic and complex real-world scenarios.

Ternary-task Convolutional Bidirectional Neural Turing Machine for Assessment of EEG-based Cognitive Workload

Transfer learning-based EEG analysis of visual attention and working memory on motor cortex for BCI

Learning Spatial–Spectral–Temporal EEG Features With Recurrent 3D Convolutional Neural Networks for Cross-Task Mental Workload Assessment

EEG-TNet: an End-To-End Brain Computer Interface Framework for Mental Workload Estimation

Cross-Participant EEG-Based Assessment of Cognitive Workload Using Multi-Path Convolutional Recurrent Neural Networks

Classification of mental workload with EEG analysis by using effective connectivity and a hybrid model of CNN and LSTM

Neural Networks Meet Neural Activity: Utilizing EEG for Mental Workload Estimation

Cross-task cognitive workload recognition using a dynamic residual network with attention mechanism based on neurophysiological signals

Subject-Specific Cognitive Workload Classification Using EEG-Based Functional Connectivity and Deep Learning

Multilevel Feature Fusion With 3D Convolutional Neural Network for EEG-Based Workload Estimation

SCVCNet: Sliding cross-vector convolution network for cross-task and inter-individual-set EEG-based cognitive workload recognition

Mental Workload Classification and Tasks Detection in Multitasking: Deep Learning Insights from EEG Study

Cross-Task Cognitive Load Classification with Identity Mapping-Based Distributed CNN and Attention-Based RNN Using Gabor Decomposed Data Images

Deep long short-term memory structures model temporal dependencies improving cognitive workload estimation

EEG/fNIRS Based Workload Classification Using Functional Brain Connectivity and Machine Learning

EEG Based Dynamic Functional Connectivity Analysis in Mental Workload Tasks With Different Types of Information

Spectral and Temporal Feature Learning with Two-Stream Neural Networks for Mental Workload Assessment

Identifying stable EEG patterns over time for mental workload recognition using transfer DS-CNN framework

Cognitive Analysis of Working Memory Load from Eeg, by a Deep Recurrent Neural Network

Cross-Task Mental Workload Recognition Based on EEG Tensor Representation and Transfer Learning

Cross-Task Cognitive Workload Recognition Based on EEG and Domain Adaptation