Abstract:Object detection is the central issue of intelligent traffic systems, and recent advancements in single-vehicle lidar-based 3D detection indicate that it can provide accurate position information for intelligent agents to make decisions and plan. Compared with single-vehicle perception, multi-view vehicle-road cooperation perception has fundamental advantages, such as the elimination of blind spots and a broader range of perception, and has become a research hotspot. However, the current perception of cooperation focuses on improving the complexity of fusion while ignoring the fundamental problems caused by the absence of single-view outlines. We propose a multi-view vehicle-road cooperation perception system, vehicle-to-everything cooperative perception (V2X-AHD), in order to enhance the identification capability, particularly for predicting the vehicle's shape. At first, we propose an asymmetric heterogeneous distillation network fed with different training data to improve the accuracy of contour recognition, with multi-view teacher features transferring to single-view student features. While the point cloud data are sparse, we propose Spara Pillar, a spare convolutional-based plug-in feature extraction backbone, to reduce the number of parameters and improve and enhance feature extraction capabilities. Moreover, we leverage the multi-head self-attention (MSA) to fuse the single-view feature, and the lightweight design makes the fusion feature a smooth expression. The results of applying our algorithm to the massive open dataset V2Xset demonstrate that our method achieves the state-of-the-art result. The V2X-AHD can effectively improve the accuracy of 3D object detection and reduce the number of network parameters, according to this study, which serves as a benchmark for cooperative perception. The code for this article is available at https://github.com/feeling0414-lab/V2X-AHD.

DHA: Lidar and Vision Data Fusion-based on Road Object Classifier

Object Classification Using CNN-Based Fusion of Vision and LIDAR in Autonomous Vehicle Environment

Real time object detection using LiDAR and camera fusion for autonomous driving

Multi-Stage Residual Fusion Network for LIDAR-Camera Road Detection

Deep LiDAR-Radar-Visual Fusion for Object Detection in Urban Environments

Deep Feature Fusion for High-Resolution Aerial Scene Classification

Object Detection Using Multi-Sensor Fusion Based on Deep Learning

RangeLVDet: Boosting 3D Object Detection in LIDAR With Range Image and RGB Image

RGB Camera and LiDAR Fusion for Road Detection

Fusion of color images and LiDAR data for lane classification.

Enhancing 3D object detection through multi-modal fusion for cooperative perception

Robust Dual-Modal Image Quality Assessment Aware Deep Learning Network for Traffic Targets Detection of Autonomous Vehicles.

Multi-Modal Fusion Based on Depth Adaptive Mechanism for 3D Object Detection

Deep multi-scale and multi-modal fusion for 3D object detection

RI-Fusion: 3D Object Detection Using Enhanced Point Features With Range-Image Fusion for Autonomous Driving.

Multi-Task Foreground-Aware Network with Depth Completion for Enhanced RGB-D Fusion Object Detection Based on Transformer

BAFusion: Bidirectional Attention Fusion for 3D Object Detection Based on LiDAR and Camera

Object detection using depth completion and camera-LiDAR fusion for autonomous driving

CrossFusion net: Deep 3D object detection based on RGB images and point clouds in autonomous driving

Depth Completion via Inductive Fusion of Planar LIDAR and Monocular Camera

V2X-AHD:Vehicle-to-Everything Cooperation Perception via Asymmetric Heterogenous Distillation Network