Surround Sensing Technique for Trucks Based on Multi-Features and Improved Yolov5 Algorithm

Zixian Li,Yongtao Li,Hanyan Li,Liting Deng,Rungang Yan
DOI: https://doi.org/10.3390/s24072112
IF: 3.9
2024-03-27
Sensors
Abstract:The traditional rearview mirror method cannot fully guarantee safety when driving trucks. RGB and infrared images collected by cameras are used for registration and recognition, so as to achieve the perception of surroundings and ensure safe driving. The traditional scale-invariant feature transform (SIFT) algorithm has a mismatching rate, and the YOLO algorithm has an optimization space in feature extraction. To address these issues, this paper proposes a truck surround sensing technique based on multi-features and an improved YOLOv5 algorithm. Firstly, the edge corner points and infrared features of the preset target region are extracted, and then a feature point set containing the improved SIFT algorithm is generated for registration. Finally, the YOLOv5 algorithm is improved by fusing infrared features and introducing a composite prediction mechanism at the prediction end. The simulation results show that, on average, the image stitching accuracy is improved by 17%, the time is reduced by 89%, and the target recognition accuracy is improved by 2.86%. The experimental results show that this method can effectively perceive the surroundings of trucks, accurately identify targets, and reduce the missed alarm rate and false alarm rate.
engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
What problem does this paper attempt to address?
The paper attempts to address the shortcomings of traditional truck surrounding environment perception technology in terms of safe driving. Specifically: 1. **Limitations of traditional rearview mirror methods**: Traditional rearview mirror methods cannot fully ensure the safety of truck driving, especially in situations with many visual blind spots. 2. **Improvements in image stitching and target recognition**: The traditional Scale-Invariant Feature Transform (SIFT) algorithm has a high error rate in matching, while the YOLO algorithm still has room for optimization in feature extraction. To address these issues, the paper proposes a truck surrounding environment perception technology based on multi-feature and improved YOLOv5 algorithm. The main improvements include: - **Multi-feature extraction**: Extracting edge corner points and infrared features, and generating a feature point set containing the improved SIFT algorithm for registration. - **Improved YOLOv5 algorithm**: Improving the YOLOv5 algorithm by integrating infrared features and introducing a composite prediction mechanism to enhance the accuracy of target recognition. Experimental results show that this method significantly improves image stitching accuracy, processing time, and target recognition accuracy. It can effectively perceive the truck's surrounding environment, accurately identify targets, and reduce false alarm and missed detection rates. This helps to improve the safety of truck driving.