Federated Learning for Drowsiness Detection in Connected Vehicles

William Lindskog,Valentin Spannagl,Christian Prehofer

DOI: https://doi.org/10.1007/978-3-031-49379-9_9

2024-05-06

Abstract:Ensuring driver readiness poses challenges, yet driver monitoring systems can assist in determining the driver's state. By observing visual cues, such systems recognize various behaviors and associate them with specific conditions. For instance, yawning or eye blinking can indicate driver drowsiness. Consequently, an abundance of distributed data is generated for driver monitoring. Employing machine learning techniques, such as driver drowsiness detection, presents a potential solution. However, transmitting the data to a central machine for model training is impractical due to the large data size and privacy concerns. Conversely, training on a single vehicle would limit the available data and likely result in inferior performance. To address these issues, we propose a federated learning framework for drowsiness detection within a vehicular network, leveraging the YawDD dataset. Our approach achieves an accuracy of 99.2%, demonstrating its promise and comparability to conventional deep learning techniques. Lastly, we show how our model scales using various number of federated clients

Computer Vision and Pattern Recognition,Machine Learning

What problem does this paper attempt to address?

This paper discusses the use of Federated Learning in connected vehicles to detect driver fatigue. Currently, ensuring driver alertness is a challenge and driver monitoring systems can help identify the driver's state. These systems determine driver fatigue by observing visual clues such as yawning or blinking. However, a large amount of scattered data is used for driver monitoring, and directly transmitting the data to a central machine for model training is neither practical nor involves privacy concerns. On the other hand, training on a single vehicle may limit the available data, thus impacting performance.

The paper proposes a Federated Learning framework for in-vehicle networks, using the YawDD dataset for driver fatigue detection. Their method achieves 99.2% accuracy, demonstrating its potential and comparability to traditional deep learning techniques. Furthermore, they show how the model's performance scales as the number of participating client devices increases.

The study also compares previous work, which primarily relies on deep learning techniques such as convolutional neural networks and recurrent neural networks, for accurate driver fatigue detection. While these techniques have achieved some success, there is still limited research on applying Federated Learning in the field of driver monitoring, and there is no demonstration of performance changes with an increasing number of client devices.

The YawDD dataset used in the paper includes various driver behaviors, particularly yawning as a fatigue indicator. The data is preprocessed, including frame-level annotations, image resizing, and grayscale conversion, to facilitate model training. Experimental results show that using 2D-CNN to process single-frame images achieves the highest accuracy of 99.2% with 2 client devices, although performance slightly decreases as the number of client devices increases.

In conclusion, this paper addresses the problem of effectively utilizing distributed in-vehicle data for driver fatigue detection while preserving privacy. It presents a solution based on Federated Learning, which demonstrates high accuracy and scalability in practice.