Behind-the-Ear EEG-based Wearable Driver Drowsiness Detection System using Embedded Tiny Neural Networks

Ha-Trung Nguyen,Ngoc-Dau Mai,Boon Giin Lee,Wan-Young Chung
DOI: https://doi.org/10.1109/jsen.2023.3307766
IF: 4.3
2023-01-01
IEEE Sensors Journal
Abstract:Driver drowsiness is a major factor that leads to traffic accidents and loss of life. A popular drowsiness detection (DD) method is based on machine learning (ML) and monitoring electroencephalogram (EEG) signals from the scalp. However, the setup is usually bulky and too obtrusive for use in daily life. In addition, the data processing unit is usually placed in large hardware such as cloud servers and personal computers that receive the EEG signal from wearable sensors wirelessly. This results in a cumbersome system that lacks mobility and suffers high latency and power consumption because of wireless connection. The behind-the-ear (BTE) EEG is a novel approach that promises a more convenient and practical solution than scalp-EEG. Recent advances in tiny ML (TinyML) mean that on-device ML-based driver DD (DDD) could also be realized to avoid the limitations mentioned above. This article presents the design of a novel BTE EEG-based DDD system that uses a wearable headband device and runs built-in neural network (NN) models. The device collects EEG signals from four proposed BTE locations that are then preprocessed. Welch’s method is applied to extract the relative power spectral density (rPSD) ratio of three EEG bands (theta, alpha, and beta). Two NN models [multilayer perceptron (MLP) and convolutional NN (CNN)] were trained and compared to a support vector machine (SVM) before deployment in the embedded device. Then, a benchmark test was performed to evaluate the on-device performances of these models. The test results established the practicality and feasibility of the proposed system for on-device DDD.
engineering, electrical & electronic,instruments & instrumentation,physics, applied
What problem does this paper attempt to address?