Enhancing automated vehicle identification by integrating YOLO v8 and OCR techniques for high-precision license plate detection and recognition

Hanae Moussaoui,Nabil El Akkad,Mohamed Benslimane,Walid El-Shafai,Abdullah Baihan,Chaminda Hewage,Rajkumar Singh Rathore

DOI: https://doi.org/10.1038/s41598-024-65272-1

IF: 4.6

2024-06-24

Scientific Reports

Abstract:Vehicle identification systems are vital components that enable many aspects of contemporary life, such as safety, trade, transit, and law enforcement. They improve community and individual well-being by increasing vehicle management, security, and transparency. These tasks entail locating and extracting license plates from images or video frames using computer vision and machine learning techniques, followed by recognizing the letters or digits on the plates. This paper proposes a new license plate detection and recognition method based on the deep learning YOLO v8 method, image processing techniques, and the OCR technique for text recognition. For this, the first step was the dataset creation, when gathering 270 images from the internet. Afterward, CVAT (Computer Vision Annotation Tool) was used to annotate the dataset, which is an open-source software platform made to make computer vision tasks easier to annotate and label images and videos. Subsequently, the newly released Yolo version, the Yolo v8, has been employed to detect the number plate area in the input image. Subsequently, after extracting the plate the k-means clustering algorithm, the thresholding techniques, and the opening morphological operation were used to enhance the image and make the characters in the license plate clearer before using OCR. The next step in this process is using the OCR technique to extract the characters. Eventually, a text file containing only the character reflecting the vehicle's country is generated. To ameliorate the efficiency of the proposed approach, several metrics were employed, namely precision, recall, F1-Score, and CLA. In addition, a comparison of the proposed method with existing techniques in the literature has been given. The suggested method obtained convincing results in both detection as well as recognition by obtaining an accuracy of 99% in detection and 98% in character recognition.

multidisciplinary sciences

What problem does this paper attempt to address?

### Problems Addressed by the Paper

The paper aims to propose a new method for license plate detection and recognition by integrating YOLO v8 and Optical Character Recognition (OCR) technologies to improve the accuracy of license plate detection and recognition. Specifically, the paper addresses the following aspects:

1. **License Plate Detection and Recognition**:
- Utilizing YOLO v8 for detecting the license plate area.
- Using image processing techniques (such as K-means clustering, thresholding, and morphological operations) to preprocess the extracted license plate to enhance image quality.
- Applying OCR technology to recognize the characters on the license plate.

2. **Dataset Creation and Annotation**:
- Collected 270 publicly available internet images as a dataset and annotated them using the CVAT tool.
- The dataset includes vehicle images under different angles and lighting conditions, ensuring diversity and representativeness.

3. **Algorithm Optimization and Evaluation**:
- Proposed several evaluation metrics (such as accuracy, recall, F1 score, and CLA) to validate the effectiveness of the proposed method.
- Achieved 99% accuracy in detection and 98% accuracy in character recognition.

4. **Cross-Country License Plate Recognition**:
- Generated a text file containing only the part of the information indicating the country to which the vehicle belongs.

The paper aims to improve the accuracy and reliability of license plate detection and recognition systems through these technical means and apply them to various scenarios such as parking management, traffic management, and law enforcement.