Abstract:Cognitive workload is a crucial factor in tasks involving dynamic decision-making and other real-time and high-risk situations. Neuroimaging techniques have long been used for estimating cognitive workload. Given the portability, cost-effectiveness and high time-resolution of EEG as compared to fMRI and other neuroimaging modalities, an efficient method of estimating an individual’s workload using EEG is of paramount importance. Multiple cognitive, psychiatric and behavioral phenotypes have already been known to be linked with “functional connectivity”, i.e., correlations between different brain regions. In this work, we explored the possibility of using different model-free functional connectivity metrics along with deep learning in order to efficiently classify the cognitive workload of the participants. To this end, 64-channel EEG data of 19 participants were collected while they were doing the traditional n-back task. These data (after pre-processing) were used to extract the functional connectivity features, namely Phase Transfer Entropy (PTE), Mutual Information (MI) and Phase Locking Value (PLV). These three were chosen to do a comprehensive comparison of directed and non-directed model-free functional connectivity metrics (allows faster computations). Using these features, three deep learning classifiers, namely CNN, LSTM and Conv-LSTM were used for classifying the cognitive workload as low (1-back), medium (2-back) or high (3-back). With the high inter-subject variability in EEG and cognitive workload and recent research highlighting that EEG-based functional connectivity metrics are subject-specific, subject-specific classifiers were used. Results show the state-of-the-art multi-class classification accuracy with the combination of MI with CNN at 80.87%, followed by the combination of PLV with CNN (at 75.88%) and MI with LSTM (at 71.87%). The highest subject specific performance was achieved by the combinations of PLV with Conv-LSTM, and PLV with CNN with an accuracy of 97.92%, followed by the combination of MI with CNN (at 95.83%) and MI with Conv-LSTM (at 93.75%). The results highlight the efficacy of the combination of EEG-based model-free functional connectivity metrics and deep learning in order to classify cognitive workload. The work can further be extended to explore the possibility of classifying cognitive workload in real-time, dynamic and complex real-world scenarios.

Cross-subject Brain Functional Connectivity Analysis for Multi-task Cognitive State Evaluation

In silico vs. Over the Clouds: On-the-Fly Mental State Estimation of Aircraft Pilots, Using a Functional Near Infrared Spectroscopy Based Passive-BCI

Brainnetformer: Decoding Brain Cognitive States with Spatial-Temporal Cross Attention

EEG Based Dynamic Functional Connectivity Analysis in Mental Workload Tasks With Different Types of Information

Mapping cognitive brain functions at scale

Decoding Subject-Driven Cognitive States from EEG Signals for Cognitive Brain–Computer Interface

Subject-Specific Cognitive Workload Classification Using EEG-Based Functional Connectivity and Deep Learning

Task-induced Brain Connectivity Promotes the Detection of Individual Differences in Brain-Behavior Relationships

Brain Connectivity Variation Topography Associated with Working Memory.

Study on Brain Computer Interface Based on Cognitive Task

Use of multimodal physiological signals to explore pilots’ cognitive behaviour during flight strike task performance

Connectome-based prediction modeling of cognitive control using functional and structural connectivity

Discriminative Analysis of Brain Functional Connectivity Patterns for Mental Fatigue Classification

A Joint Analysis of Multi-Paradigm fMRI Data With Its Application to Cognitive Study

Mental Workload Drives Different Reorganizations of Functional Cortical Connectivity Between 2D and 3D Simulated Flight Experiments

Assessing the Effects of Various Physiological Signal Modalities on Predicting Different Human Cognitive States

Brain biomarkers based assessment of cognitive workload in pilots under various task demands

Development of a novel machine learning-based approach for brain function assessment and integrated software solution

Brain Connectivity Evaluation During Selective Attention Using EEG-based Brain-Computer Interface

On a Gamified Brain-Computer Interface for Cognitive Training of Spatial Working Memory

An EEG-fNIRS neurovascular coupling analysis method to investigate cognitive-motor interference.