VigilEye -- Artificial Intelligence-based Real-time Driver Drowsiness Detection

Sandeep Singh Sengar,Aswin Kumar,Owen Singh

2024-06-22

Abstract:This study presents a novel driver drowsiness detection system that combines deep learning techniques with the OpenCV framework. The system utilises facial landmarks extracted from the driver's face as input to Convolutional Neural Networks trained to recognise drowsiness patterns. The integration of OpenCV enables real-time video processing, making the system suitable for practical implementation. Extensive experiments on a diverse dataset demonstrate high accuracy, sensitivity, and specificity in detecting drowsiness. The proposed system has the potential to enhance road safety by providing timely alerts to prevent accidents caused by driver fatigue. This research contributes to advancing real-time driver monitoring systems and has implications for automotive safety and intelligent transportation systems. The successful application of deep learning techniques in this context opens up new avenues for future research in driver monitoring and vehicle safety. The implementation code for the paper is available at <a class="link-external link-https" href="https://github.com/LUFFY7001/Driver-s-Drowsiness-Detection" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

### The Problem This Paper Attempts to Solve

This paper aims to address the road safety hazards caused by driver fatigue. Specifically:

1. **Propose a New Real-Time Detection System**:
- A real-time driver fatigue detection system is developed using deep learning technology and the OpenCV framework.
- The system identifies signs of fatigue by analyzing facial features of the driver (such as eye closure, blink frequency, etc.).

2. **Improve Detection Accuracy and Real-Time Performance**:
- The system uses Convolutional Neural Networks (CNN) to process facial feature points and combines OpenCV for real-time video processing.
- Experiments show that the system has high accuracy, sensitivity, and specificity in detecting fatigue.

3. **Cost-Effective**:
- It does not rely on specialized hardware and can use common cameras or in-car cameras, reducing deployment costs and complexity.
- Suitable for both personal and commercial vehicles.

4. **Enhance Driver Safety**:
- By timely reminding drivers to rest or take other preventive measures, it reduces traffic accidents caused by fatigue driving.
- The system can continuously monitor the driver's facial features and issue alerts when signs of fatigue are detected.

5. **Promote Future Research**:
- This research provides a foundation for future driver monitoring systems, opening up more non-invasive research directions, such as integrating physiological indicators like heart rate variability or cognitive load.

In summary, this paper is dedicated to developing a non-invasive, real-time fatigue detection system based on computer vision and machine learning technologies to improve road safety and reduce accidents caused by fatigue driving.