Abstract:Objective. The scarcity of electroencephalogram (EEG) data, coupled with individual and scenario variations, leads to considerable challenges in real-world EEG-based driver fatigue detection. We propose a domain adaptation method that utilizes EEG data collected from a laboratory to supplement real-world EEG data and constructs a cross-scenario and cross-subject driver fatigue detection model for real-world scenarios. Approach. First, we collect EEG data from subjects participating in a driving experiment conducted in both laboratory and real-world scenarios. To address the issue of data scarcity, we build a real-world fatigued driving detection model by integrating the real-world data with the laboratory data. Then, we propose a method named cross-scenario and cross-subject domain adaptation (CS2DA), which aims to eliminate the domain shift problem caused by individual variances and scenario differences. Adversarial learning is adopted to extract the common features observed across different subjects within the same scenario. The multikernel maximum mean discrepancy method is applied to further minimize scenario differences. Additionally, we propose a conditional multikernel maximum mean discrepancy constraint to better utilize label information. Finally, we use seven rules to fuse the predicted labels. Main results. We evaluate the CS2DA method through extensive experiments conducted on the two EEG datasets created in this work: the SEED-VLA and the SEED-VRW datasets. Different domain adaptation methods are used to construct a real-world fatigued driving detection model using data from laboratory and real-world scenarios, as well as a combination of both. Our findings show that the proposed CS2DA method outperforms the existing traditional and adversarial learning-based domain adaptation approaches. We also find that combining data from both laboratory and real-world scenarios improves the performance of the model. Significance. This study contributes two EEG-based fatigue driving datasets and demonstrates that the proposed CS2DA method can effectively enhance the performance of a real-world fatigued driving detection model.

Multimodal Vigilance Estimation with Adversarial Domain Adaptation Networks.

Multimodal Vigilance Estimation Using Deep Learning

Depersonalized Cross-Subject Vigilance Estimation with Adversarial Domain Generalization

A cross-scenario and cross-subject domain adaptation method for driving fatigue detection

Contrastive fine-grained domain adaptation network for EEG-based vigilance estimation

A Regression Method With Subnetwork Neurons for Vigilance Estimation Using EOG and EEG

A Robust Approach to Estimating Vigilance from EEG with Neural Processes

Driving Cognitive Alertness Detecting Using Evoked Multimodal Physiological Signals Based on Uncertain Self-Supervised Learning

Multimodal Vigilance Estimation with Modality-Pairwise Contrastive Loss.

Faster Single Model Vigilance Detection Based on Deep Learning

A Multimodal Data-Driven Approach for Driving Risk Assessment

Multisource Adaption for Driver Attention Prediction in Arbitrary Driving Scenes

An improved CapsNet based on data augmentation for driver vigilance estimation with forehead single-channel EEG

Capsule Attention for Multimodal EEG-EOG Representation Learning With Application to Driver Vigilance Estimation

Unsupervised Domain Adaptation for Remote-Sensing Vehicle Detection Using Domain-Specific Channel Recalibration

Vigilance Estimation Using a Wearable EOG Device in Real Driving Environment

Continuous Vigilance Estimation Using LSTM Neural Networks.

Efficient Mixture-of-Expert for Video-based Driver State and Physiological Multi-task Estimation in Conditional Autonomous Driving

Wasserstein-Distance-Based Multi-Source Adversarial Domain Adaptation for Emotion Recognition and Vigilance Estimation

Attention Monitoring and Hazard Assessment with Bio-Sensing and Vision: Empirical Analysis Utilizing CNNs on the KITTI Dataset

Sleep Quality Estimation with Adversarial Domain Adaptation: From Laboratory to Real Scenario