Abstract:Abstract Background Mental workload is a critical consideration in complex man–machine systems design. Among various mental workload detection techniques, multimodal detection techniques integrating electroencephalogram (EEG) and functional near-infrared spectroscopy (fNIRS) signals have attracted considerable attention. However, existing EEG–fNIRS-based mental workload detection methods have certain defects, such as complex signal acquisition channels and low detection accuracy, which restrict their practical application. Methods The signal acquisition configuration was optimized by analyzing the feature importance in mental workload recognition model and a more accurate and convenient EEG–fNIRS-based mental workload detection method was constructed. A classical Multi-Task Attribute Battery (MATB) task was conducted with 20 participating volunteers. Subjective scale data, 64-channel EEG data, and two-channel fNIRS data were collected. Results A higher number of EEG channels correspond to higher detection accuracy. However, there is no obvious improvement in accuracy once the number of EEG channels reaches 26, with a four-level mental workload detection accuracy of 76.25 ± 5.21%. Partial results of physiological analysis verify the results of previous studies, such as that the θ power of EEG and concentration of O 2 Hb in the prefrontal region increase while the concentration of HHb decreases with task difficulty. It was further observed, for the first time, that the energy of each band of EEG signals was significantly different in the occipital lobe region, and the power of $$\beta_{1}$$ β 1 and $$\beta_{2}$$ β 2 bands in the occipital region increased significantly with task difficulty. The changing range and the mean amplitude of O 2 Hb in high-difficulty tasks were significantly higher compared with those in low-difficulty tasks. Conclusions The channel configuration of EEG–fNIRS-based mental workload detection was optimized to 26 EEG channels and two frontal fNIRS channels. A four-level mental workload detection accuracy of 76.25 ± 5.21% was obtained, which is higher than previously reported results. The proposed configuration can promote the application of mental workload detection technology in military, driving, and other complex human–computer interaction systems.

Olfactory Psychological Computation and Olfactory Environment for Human-Machine Collaboration

Olfactory Affective Computation Based on EEG Signal Data

Influence of odor environments on cognitive efficiency: A comprehensive review

The Experimental Research on Mimetic Optical Artificial Nose Sensor System and Detection of Respiration Odor

Biomimetic Olfactory Sensing System Based on Brain-Machine Interface and Olfactory Decoding

Advancing cross-subject olfactory EEG recognition: A novel framework for collaborative multimodal learning between human-machine

Human-Machine Cooperative Multimodal Learning Method for Cross-subject Olfactory Preference Recognition

Toward EEG-based Olfactory Sensing Through Spatial Temporal Subspace Optimization

Intelligent wearable olfactory interface for latency-free mixed reality and fast olfactory enhancement

Influence of Fragrances on Human Psychophysiological Activity: With Special Reference to Human Electroencephalographic Response

Modulating Driver Alertness via Ambient Olfactory Stimulation: A Wearable Electroencephalography Study

Autonomic Responses Associated with Olfactory Preferences of Fragrance Consumers: Skin Conductance, Respiration, and Heart Rate

Optimized electroencephalogram and functional near-infrared spectroscopy-based mental workload detection method for practical applications

Combining a Breath-Synchronized Olfactometer with Brain Simulation to Study the Impact of Odors on Corticospinal Excitability and Effective Connectivity

Design and Verification of an Aromatherapy Feedback System for Mental Fatigue Based on Physiological Signals.

A Comprehensive Review of Impact Assessment of Indoor Thermal Environment on Work and Cognitive Performance - Combined Physiological Measurements and Machine Learning

Design and Implementation of a Human-Machine Interaction Platform for Analysis on Human Cognitive Behaviors

An fMRI-based investigation of the effects of odors on the functional connectivity network underlying the working memory

Recognition of odor and pleasantness based on olfactory EEG combined with functional brain network model

An Investigation of Olfactory-Enhanced Video on EEG-Based Emotion Recognition