Abstract:Abstract Background Mental workload is a critical consideration in complex man–machine systems design. Among various mental workload detection techniques, multimodal detection techniques integrating electroencephalogram (EEG) and functional near-infrared spectroscopy (fNIRS) signals have attracted considerable attention. However, existing EEG–fNIRS-based mental workload detection methods have certain defects, such as complex signal acquisition channels and low detection accuracy, which restrict their practical application. Methods The signal acquisition configuration was optimized by analyzing the feature importance in mental workload recognition model and a more accurate and convenient EEG–fNIRS-based mental workload detection method was constructed. A classical Multi-Task Attribute Battery (MATB) task was conducted with 20 participating volunteers. Subjective scale data, 64-channel EEG data, and two-channel fNIRS data were collected. Results A higher number of EEG channels correspond to higher detection accuracy. However, there is no obvious improvement in accuracy once the number of EEG channels reaches 26, with a four-level mental workload detection accuracy of 76.25 ± 5.21%. Partial results of physiological analysis verify the results of previous studies, such as that the θ power of EEG and concentration of O 2 Hb in the prefrontal region increase while the concentration of HHb decreases with task difficulty. It was further observed, for the first time, that the energy of each band of EEG signals was significantly different in the occipital lobe region, and the power of $$\beta_{1}$$ β 1 and $$\beta_{2}$$ β 2 bands in the occipital region increased significantly with task difficulty. The changing range and the mean amplitude of O 2 Hb in high-difficulty tasks were significantly higher compared with those in low-difficulty tasks. Conclusions The channel configuration of EEG–fNIRS-based mental workload detection was optimized to 26 EEG channels and two frontal fNIRS channels. A four-level mental workload detection accuracy of 76.25 ± 5.21% was obtained, which is higher than previously reported results. The proposed configuration can promote the application of mental workload detection technology in military, driving, and other complex human–computer interaction systems.

Eeg Feature Selection Based on Weighted-Normalized Mutual Information for Mental Fatigue Classification

A new feature selection approach for driving fatigue EEG detection with a modified machine learning algorithm

Quantitative identification of daily mental fatigue levels based on multimodal parameters

Single-channel EEG-based mental fatigue detection based on deep belief network

EEG based Mental Workload Assessment by Power Spectral Density Feature

Feature Weight Driven Interactive Mutual Information Modeling for Heterogeneous Bio-Signal Fusion to Estimate Mental Workload.

EEG Signal Feature Selection Algorithm and Support Vector Machine Model in Patient's Fatigue Recognition

EEG-Based Multiclass Workload Identification Using Feature Fusion and Selection

EEG-based major depressive disorder recognition by selecting discriminative features via stochastic search

[Fatigue feature extraction and classification algorithm of forehead single-channel electroencephalography signals]

Identification of mental fatigue in language comprehension tasks based on EEG and deep learning

A Multi-Model Analysis for Driving Fatigue Detection using EEG Signals

Optimized electroencephalogram and functional near-infrared spectroscopy-based mental workload detection method for practical applications

Mental fatigue recognition study based on 1D convolutional neural network and short-term ECG signals

Automatic depression diagnosis through hybrid EEG and near-infrared spectroscopy features using support vector machine

A novel EEG-based major depressive disorder detection framework with two-stage feature selection

Driving Mental Fatigue Classification Based on Brain Functional Connectivity

An Adaptive EEG Feature Extraction Method Based on Stacked Denoising Autoencoder for Mental Fatigue Connectivity

Driver fatigue detection based on prefrontal EEG using multi-entropy measures and hybrid model

EEG spatial inter-channel connectivity analysis: A GCN-based dual stream approach to distinguish mental fatigue status

Multi-Level Attention Recognition of EEG Based on Feature Selection