Abstract:Brief fragments of sleep shorter than 15 s are defined as microsleep episodes (MSEs), often subjectively perceived as sleepiness. Their main characteristic is a slowing in frequency in the electroencephalogram (EEG), similar to stage N1 sleep according to standard criteria. The maintenance of wakefulness test (MWT) is often used in a clinical setting to assess vigilance. Scoring of the MWT in most sleep-wake centers is limited to classical definition of sleep (30-s epochs), and MSEs are mostly not considered in the absence of established scoring criteria defining MSEs but also because of the laborious work. We aimed for automatic detection of MSEs with machine learning, i.e. with deep learning based on raw EEG and EOG data as input. We analyzed MWT data of 76 patients. Experts visually scored wakefulness, and according to recently developed scoring criteria MSEs, microsleep episode candidates (MSEc), and episodes of drowsiness (ED). We implemented segmentation algorithms based on convolutional neural networks (CNNs) and a combination of a CNN with a long-short term memory (LSTM) network. A LSTM network is a type of a recurrent neural network which has a memory for past events and takes them into account. Data of 53 patients were used for training of the classifiers, 12 for validation and 11 for testing. Our algorithms showed a good performance close to human experts. The detection was very good for wakefulness and MSEs and poor for MSEc and ED, similar to the low inter-expert reliability for these borderline segments. We provide a proof of principle that it is feasible to reliably detect MSEs with deep neuronal networks based on raw EEG and EOG data with a performance close to that of human experts. Code of algorithms ( <a class="link-external link-https" href="https://github.com/alexander-malafeev/microsleep-detection" rel="external noopener nofollow">this https URL</a> ) and data ( <a class="link-external link-https" href="https://zenodo.org/record/3251716" rel="external noopener nofollow">this https URL</a> ) are available.

Automatic Micro-sleep Detection under Car-driving Simulation Environment using Night-sleep EEG

Toward Safer Vehicular Transit: Implementing Deep Learning on Single Channel EEG Systems for Microsleep Detection

A Deep Learning Approach to Detect Microsleep Using Various Forms of EEG Signal

Automatic detection of microsleep episodes with deep learning

Recognizing drowsiness in young men during real driving based on electroencephalography using an end-to-end deep learning approach

Driving Drowsiness Detection With Eeg Using A Modified Hierarchical Extreme Learning Machine Algorithm With Particle Swarm Optimization: A Pilot Study

Deep Learning-based EEG Detection of Mental Alertness States from Drivers under Ethical Aspects.

Cascaded Convolutional Neural Network with Attention Mechanism for Mobile EEG-based Driver Drowsiness Detection System

Vehicle driver drowsiness detection method using wearable EEG based on convolution neural network

EEG brain signals to detect the sleep health of a driver: An automated framework system based on deep learning

Micro SleepNet: efficient deep learning model for mobile terminal real-time sleep staging

EEG-based System Using Deep Learning and Attention Mechanism for Driver Drowsiness Detection

SLEEPNET: Automated Sleep Staging System via Deep Learning

Boosting Transfer Learning Improves Performance of Driving Drowsiness Classification Using EEG

Heavy Truck Driver's Drowsiness Detection Method Using Wearable EEG Based on Convolution Neural Network

Deep Learning in Automatic Sleep Staging With a Single Channel Electroencephalography

EEG_DMNet: A Deep Multi-Scale Convolutional Neural Network for Electroencephalography-Based Driver Drowsiness Detection

Ensemble CNN to Detect Drowsy Driving with In-Vehicle Sensor Data

EEG-Based Drowsiness Estimation for Driving Safety Using Deep Q-Learning

A Study on Drowsy Driving State Based on EEG Signals

Customized deep learning algorithm for drowsiness detection using single-channel EEG signal