Abstract:Cognitive workload is a crucial factor in tasks involving dynamic decision-making and other real-time and high-risk situations. Neuroimaging techniques have long been used for estimating cognitive workload. Given the portability, cost-effectiveness and high time-resolution of EEG as compared to fMRI and other neuroimaging modalities, an efficient method of estimating an individual’s workload using EEG is of paramount importance. Multiple cognitive, psychiatric and behavioral phenotypes have already been known to be linked with “functional connectivity”, i.e., correlations between different brain regions. In this work, we explored the possibility of using different model-free functional connectivity metrics along with deep learning in order to efficiently classify the cognitive workload of the participants. To this end, 64-channel EEG data of 19 participants were collected while they were doing the traditional n-back task. These data (after pre-processing) were used to extract the functional connectivity features, namely Phase Transfer Entropy (PTE), Mutual Information (MI) and Phase Locking Value (PLV). These three were chosen to do a comprehensive comparison of directed and non-directed model-free functional connectivity metrics (allows faster computations). Using these features, three deep learning classifiers, namely CNN, LSTM and Conv-LSTM were used for classifying the cognitive workload as low (1-back), medium (2-back) or high (3-back). With the high inter-subject variability in EEG and cognitive workload and recent research highlighting that EEG-based functional connectivity metrics are subject-specific, subject-specific classifiers were used. Results show the state-of-the-art multi-class classification accuracy with the combination of MI with CNN at 80.87%, followed by the combination of PLV with CNN (at 75.88%) and MI with LSTM (at 71.87%). The highest subject specific performance was achieved by the combinations of PLV with Conv-LSTM, and PLV with CNN with an accuracy of 97.92%, followed by the combination of MI with CNN (at 95.83%) and MI with Conv-LSTM (at 93.75%). The results highlight the efficacy of the combination of EEG-based model-free functional connectivity metrics and deep learning in order to classify cognitive workload. The work can further be extended to explore the possibility of classifying cognitive workload in real-time, dynamic and complex real-world scenarios.

Pattern Classification of Instantaneous Cognitive Task-Load Through Gmm Clustering, Laplacian Eigenmap, and Ensemble Svms

Identification of Temporal Variations in Mental Workload Using Locally-Linear-embedding-based EEG Feature Reduction and Support-Vector-machine-based Clustering and Classification Techniques

Sustained Attention States Recognition with EEG and Eye-Tracking in the GradCPT.

Recognizing Cognitive Load by a Hybrid Spatio-Temporal Causal Model from Multivariate Physiological Data

Recognition of Mental Workload Levels under Complex Human–Machine Collaboration by Using Physiological Features and Adaptive Support Vector Machines

Cognitive Load Prediction from Multimodal Physiological Signals Using Multiview Learning.

Neurophysiological Feature-Based Detection of Mental Workload by Ensemble Support Vector Machines

Estimating Systemic Cognitive States from a Mixture of Physiological and Brain Signals

Individual-Specific Classification of Mental Workload Levels Via an Ensemble Heterogeneous Extreme Learning Machine for EEG Modeling

Characterisation of Cognitive Load Using Machine Learning Classifiers of Electroencephalogram Data

Classifying Human Operator Functional State Based on Electrophysiological and Performance Measures and Fuzzy Clustering Method.

Recognition of Cognitive Task Load Levels Using Single Channel EEG and Stacked Denoising Autoencoder

Subject-Specific Cognitive Workload Classification Using EEG-Based Functional Connectivity and Deep Learning

Identifying changes in human operator mental workload by locally linear embedding and support vector clustering approaches

Recognition of mental workload levels by combining adaptive exponential feature smoothing and locality preservation projection techniques

Machine Learning models for the Identification of Cognitive Tasks using Autonomic Reactions from Heart Rate Variability and Electrodermal Activity

Evaluating the performance of the cognitive workload model with subjective endorsement in addition to EEG

Assessing the Effects of Various Physiological Signal Modalities on Predicting Different Human Cognitive States

Classification of EEG Signals Using a Multiple Kernel Learning Support Vector Machine.

A Mental Workload Classification Method Based on GCN Modified by Squeeze-and-Excitation Residual

Predictive Modeling of Human Operator Cognitive State Via Sparse and Robust Support Vector Machines.