Abstract:Object detection is a crucial component of the perception system in autonomous driving. However, the road scene presents a highly intricate environment where the visibility and characteristics of traffic targets are susceptible to attenuation and loss due to various complex road scenarios such as lighting conditions, weather conditions, time of day, background elements, and traffic density. Nevertheless, the current object detection network must exhibit more learning capabilities when detecting such targets. This also exacerbates the loss of features during the feature extraction and fusion process, significantly compromising the network's detection performance on traffic targets. This paper presents a novel methodology by which to overcome the concerns above, namely HRYNet. Firstly, a dual fusion gradual pyramid structure (DFGPN) is introduced, which employs a two-stage gradient fusion strategy to enhance the generation of more comprehensive multi-scale high-level semantic information, strengthen the interconnection between non-adjacent feature layers, and reduce the information gap that exists between them. HRYNet introduces an anti-interference feature extraction module, the residual multi-head self-attention mechanism (RMA). RMA enhances the target information by implementing a characteristic channel weighting policy, thereby reducing background interference and improving the attention capability of the network. Finally, the detection performance of HRYNet was evaluated by utilizing three datasets: the horizontally collected dataset BDD1000K, the UAV high-altitude dataset Visdrone, and a custom dataset. Experimental results demonstrate that HRYNet achieves a higher mAP_0.5 compared with YOLOv8s on the three datasets, with increases of 10.8%, 16.7%, and 5.5%, respectively. To optimize HRYNet for mobile devices, this study presents Lightweight HRYNet (LHRYNet), which effectively reduces the number of model parameters by 2 million. The results demonstrate that LHRYNet outperforms YOLOv8s in terms of mAP_0.5, with improvements of 6.7%, 10.9%, and 2.5% observed on the three datasets, respectively.

YCANet: Target Detection for Complex Traffic Scenes Based on Camera-LiDAR Fusion

Millimeter-Wave Radar and Vision Fusion Target Detection Algorithm Based on an Extended Network

HCNET: A Point Cloud Object Detection Network Based on Height and Channel Attention

SNCE-YOLO: An Improved Target Detection Algorithm in Complex Road Scenes

Target detection for remote sensing based on the enhanced YOLOv4 with improved BiFPN

UCDNet: Multi-UAV Collaborative 3D Object Detection Network by Reliable Feature Mapping

Channelwise and Spatially Guided Multimodal Feature Fusion Network for 3-D Object Detection in Autonomous Vehicles

HRYNet: A Highly Robust YOLO Network for Complex Road Traffic Object Detection

YOLO-MPAM: Efficient real-time neural networks based on multi-channel feature fusion

Influence of Camera-LiDAR Configuration on 3D Object Detection for Autonomous Driving

From One to Many: Dynamic Cross Attention Networks for LiDAR and Camera Fusion

3D Dynamic Multi-target Detection Algorithm Based on Cross-view Feature Fusion

CenterPNets: A Multi-Task Shared Network for Traffic Perception

High-precision real-time autonomous driving target detection based on YOLOv8

Accurate and real-time object detection in crowded indoor spaces based on the fusion of DBSCAN algorithm and improved YOLOv4-tiny network

Object detection using depth completion and camera-LiDAR fusion for autonomous driving

Adaptive Feature Fusion With Attention-Guided Small Target Detection in Remote Sensing Images

Voxel-RCNN-Complex: An Effective 3-D Point Cloud Object Detector for Complex Traffic Conditions

Density and Context Aware Network with Hierarchical Head for Traffic Scene Detection

MMYFnet: Multi-Modality YOLO Fusion Network for Object Detection in Remote Sensing Images

FS-Net: LiDAR-Camera Fusion With Matched Scale for 3D Object Detection in Autonomous Driving