Optimization of Autonomous Driving Image Detection Based on RFAConv and Triplet Attention

Zhipeng Ling,Qi Xin,Yiyu Lin,Guangze Su,Zuwei Shui

2024-06-25

Abstract:YOLOv8 plays a crucial role in the realm of autonomous driving, owing to its high-speed target detection, precise identification and positioning, and versatile compatibility across multiple platforms. By processing video streams or images in real-time, YOLOv8 rapidly and accurately identifies obstacles such as vehicles and pedestrians on roadways, offering essential visual data for autonomous driving systems. Moreover, YOLOv8 supports various tasks including instance segmentation, image classification, and attitude estimation, thereby providing comprehensive visual perception for autonomous driving, ultimately enhancing driving safety and efficiency. Recognizing the significance of object detection in autonomous driving scenarios and the challenges faced by existing methods, this paper proposes a holistic approach to enhance the YOLOv8 model. The study introduces two pivotal modifications: the C2f_RFAConv module and the Triplet Attention mechanism. Firstly, the proposed modifications are elaborated upon in the methodological section. The C2f_RFAConv module replaces the original module to enhance feature extraction efficiency, while the Triplet Attention mechanism enhances feature focus. Subsequently, the experimental procedure delineates the training and evaluation process, encompassing training the original YOLOv8, integrating modified modules, and assessing performance improvements using metrics and PR curves. The results demonstrate the efficacy of the modifications, with the improved YOLOv8 model exhibiting significant performance enhancements, including increased MAP values and improvements in PR curves. Lastly, the analysis section elucidates the results and attributes the performance improvements to the introduced modules. C2f_RFAConv enhances feature extraction efficiency, while Triplet Attention improves feature focus for enhanced target detection.

Computer Vision and Pattern Recognition,Artificial Intelligence,Robotics

What problem does this paper attempt to address?

The problems that this paper attempts to solve are as follows: In the autonomous driving scenario, the existing image detection methods still face challenges in feature extraction and multi - scale information processing, especially in the complex and changeable traffic environment. Specifically, these challenges include:

1. **Multi - scale object detection**: Objects in the traffic environment vary in size, from distant pedestrians to nearby vehicles, requiring the detection model to have strong multi - scale perception ability.
2. **Real - time processing**: The autonomous driving system requires efficient computing performance to ensure real - time processing and response and avoid potential safety hazards caused by latency.
3. **Robustness**: The model needs to maintain stable performance under various extreme conditions (such as rainy days, nights and occlusions).
4. **Accuracy of feature extraction**: In complex traffic scenes, accurate extraction of useful features is crucial for object recognition and classification.

To solve the above problems, this paper proposes an improved YOLOv8 model, which combines RFAConv (Receptive Field Attention Convolution) and Triplet Attention mechanisms to optimize the performance of the YOLOv8 model and improve the image detection ability of the autonomous driving system. The specific improvement measures are as follows:

- **C2f_RFAConv module**: Replace the original module to enhance the efficiency of feature extraction.
- **Triplet Attention mechanism**: Enhance feature focusing and improve the accuracy of object detection.

Through these improvements, the paper aims to make the YOLOv8 model not only more accurately extract and represent the key information in the image, but also enhance the image detection performance of the autonomous driving system while ensuring real - time performance.