Research on Visual Perception of Speed Bumps for Intelligent Connected Vehicles Based on Lightweight FPNet

Ruochen Wang,Xiaoguo Luo,Qing Ye,Yu Jiang,Wei Liu
DOI: https://doi.org/10.3390/s24072130
IF: 3.9
2024-03-28
Sensors
Abstract:In the field of intelligent connected vehicles, the precise and real-time identification of speed bumps is critically important for the safety of autonomous driving. To address the issue that existing visual perception algorithms struggle to simultaneously maintain identification accuracy and real-time performance amidst image distortion and complex environmental conditions, this study proposes an enhanced lightweight neural network framework, YOLOv5-FPNet. This framework strengthens perception capabilities in two key phases: feature extraction and loss constraint. Firstly, FPNet, based on FasterNet and Dynamic Snake Convolution, is developed to adaptively extract structural features of distorted speed bumps with accuracy. Subsequently, the C3-SFC module is proposed to augment the adaptability of the neck and head components to distorted features. Furthermore, the SimAM attention mechanism is embedded within the backbone to enhance the ability of key feature extraction. Finally, an adaptive loss function, Inner–WiseIoU, based on a dynamic non-monotonic focusing mechanism, is designed to improve the generalization and fitting ability of bounding boxes. Experimental evaluations on a custom speed bumps dataset demonstrate the superior performance of FPNet, with significant improvements in key metrics such as the mAP, mAP50_95, and FPS by 38.76%, 143.15%, and 51.23%, respectively, compared to conventional lightweight neural networks. Ablation studies confirm the effectiveness of the proposed improvements. This research provides a fast and accurate speed bump detection solution for autonomous vehicles, offering theoretical insights for obstacle recognition in intelligent vehicle systems.
engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
What problem does this paper attempt to address?
The paper attempts to address the issue in the field of intelligent connected vehicles, where existing visual perception algorithms struggle to maintain both recognition accuracy and real-time performance under image distortion and complex environmental conditions. Specifically, the paper proposes an enhanced lightweight neural network framework, YOLOv5-FPNet, aimed at improving the precise and real-time recognition capability of speed bumps to ensure the safety of autonomous driving. To achieve this goal, the paper proposes the following improvements: 1. **FPNet Structure**: Combines FasterNet and Dynamic Snake Convolution (DSConv), which can reduce the number of model parameters and floating-point operations while ensuring detection accuracy. It accurately extracts structural features of targets with significant aspect ratio changes or image distortions through adaptive changes. 2. **C3-SFC Module**: Enhances the neck and head components' adaptability to distorted features. 3. **SimAM Attention Mechanism**: Embedded in the backbone network and large object detection head to improve feature extraction capability and suppress background noise interference. 4. **Inner–WiseIoU Loss Function**: Designed based on a dynamic non-monotonic focusing mechanism to improve the fitting and generalization ability of anchor boxes. These improvements collectively enhance the model's performance in speed bump detection tasks, particularly in key metrics such as mAP, mAP50_95, and FPS, with significant improvements of 38.76%, 143.15%, and 51.23%, respectively, compared to traditional lightweight neural networks. Therefore, this research provides a fast and accurate speed bump detection solution for autonomous vehicles and offers theoretical insights for obstacle recognition in intelligent vehicle systems.