Abstract:Object detection is the central issue of intelligent traffic systems, and recent advancements in single-vehicle lidar-based 3D detection indicate that it can provide accurate position information for intelligent agents to make decisions and plan. Compared with single-vehicle perception, multi-view vehicle-road cooperation perception has fundamental advantages, such as the elimination of blind spots and a broader range of perception, and has become a research hotspot. However, the current perception of cooperation focuses on improving the complexity of fusion while ignoring the fundamental problems caused by the absence of single-view outlines. We propose a multi-view vehicle-road cooperation perception system, vehicle-to-everything cooperative perception (V2X-AHD), in order to enhance the identification capability, particularly for predicting the vehicle's shape. At first, we propose an asymmetric heterogeneous distillation network fed with different training data to improve the accuracy of contour recognition, with multi-view teacher features transferring to single-view student features. While the point cloud data are sparse, we propose Spara Pillar, a spare convolutional-based plug-in feature extraction backbone, to reduce the number of parameters and improve and enhance feature extraction capabilities. Moreover, we leverage the multi-head self-attention (MSA) to fuse the single-view feature, and the lightweight design makes the fusion feature a smooth expression. The results of applying our algorithm to the massive open dataset V2Xset demonstrate that our method achieves the state-of-the-art result. The V2X-AHD can effectively improve the accuracy of 3D object detection and reduce the number of network parameters, according to this study, which serves as a benchmark for cooperative perception. The code for this article is available at https://github.com/feeling0414-lab/V2X-AHD.

Object Detection Based on Hierarchical Multi-view Proposal Network for Autonomous Driving.

A Multi-view 3D Vehicle Detection Method Based On Novel 3D Proposal Generation Method

A Fusion Method Aiming at Environmental Perception of Autonomous Vehicle Based on Visual Scheme

Multi-view 3D Object Detection Network for Autonomous Driving

Monocular 3-D Vehicle Detection Using a Cascade Network for Autonomous Driving

Three-Dimensional Object Detection Network Based on Multi-Layer and Multi-Modal Fusion

3D Object Detector: A Multiscale Region Proposal Network Based on Autonomous Driving.

Object Detection Using Multi-Sensor Fusion Based on Deep Learning

Multi-View Adaptive Fusion Network for 3D Object Detection

Fusion Strategy of Multi-sensor Based Object Detection for Self-driving Vehicles.

Real-time Object Detection and Semantic Segmentation for Autonomous Driving

MVMM: Multiview Multimodal 3-D Object Detection for Autonomous Driving

MENet: Multi-Modal Mapping Enhancement Network for 3D Object Detection in Autonomous Driving

Real time object detection using LiDAR and camera fusion for autonomous driving

Object detection using depth completion and camera-LiDAR fusion for autonomous driving

V2X-AHD:Vehicle-to-Everything Cooperation Perception via Asymmetric Heterogenous Distillation Network

Multimodal 3D Object Detection Based on Sparse Interaction in Internet of Vehicles

Deep learning-based fusion networks with high-order attention mechanism for 3D object detection in autonomous driving scenarios

3DMMF: 3D Object Detection Network Based on Multi-Layer and Multi-Modal Fusion

Enhancing 3D object detection through multi-modal fusion for cooperative perception