Abstract:Object detection is the central issue of intelligent traffic systems, and recent advancements in single-vehicle lidar-based 3D detection indicate that it can provide accurate position information for intelligent agents to make decisions and plan. Compared with single-vehicle perception, multi-view vehicle-road cooperation perception has fundamental advantages, such as the elimination of blind spots and a broader range of perception, and has become a research hotspot. However, the current perception of cooperation focuses on improving the complexity of fusion while ignoring the fundamental problems caused by the absence of single-view outlines. We propose a multi-view vehicle-road cooperation perception system, vehicle-to-everything cooperative perception (V2X-AHD), in order to enhance the identification capability, particularly for predicting the vehicle's shape. At first, we propose an asymmetric heterogeneous distillation network fed with different training data to improve the accuracy of contour recognition, with multi-view teacher features transferring to single-view student features. While the point cloud data are sparse, we propose Spara Pillar, a spare convolutional-based plug-in feature extraction backbone, to reduce the number of parameters and improve and enhance feature extraction capabilities. Moreover, we leverage the multi-head self-attention (MSA) to fuse the single-view feature, and the lightweight design makes the fusion feature a smooth expression. The results of applying our algorithm to the massive open dataset V2Xset demonstrate that our method achieves the state-of-the-art result. The V2X-AHD can effectively improve the accuracy of 3D object detection and reduce the number of network parameters, according to this study, which serves as a benchmark for cooperative perception. The code for this article is available at https://github.com/feeling0414-lab/V2X-AHD.

V2VFormer++: Multi-Modal Vehicle-to-Vehicle Cooperative Perception Via Global-Local Transformer

V2VFormer: Vehicle-to-Vehicle Cooperative Perception with Spatial-Channel Transformer

V2VFusion: Multimodal Fusion for Enhanced Vehicle-to-Vehicle Cooperative Perception

V2V Based Visual Cooperative Perception for Connected Autonomous Vehicles: Far-Sight and See-Through

V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformer

V2X-AHD:Vehicle-to-Everything Cooperation Perception via Asymmetric Heterogenous Distillation Network

CoFormerNet: A Transformer-Based Fusion Approach for Enhanced Vehicle-Infrastructure Cooperative Perception

V2X-ViTv2: Improved Vision Transformers for Vehicle-to-Everything Cooperative Perception

HM-ViT: Hetero-modal Vehicle-to-Vehicle Cooperative perception with vision transformer

CoBEVFusion: Cooperative Perception with LiDAR-Camera Bird's-Eye View Fusion

Cooperative Perception with Learning-Based V2V communications

InterCoop: Spatio-Temporal Interaction Aware Cooperative Perception for Networked Vehicles

ViT-FuseNet: MultiModal Fusion of Vision Transformer for Vehicle-Infrastructure Cooperative Perception

HP3D-V2V: High-Precision 3D Object Detection Vehicle-to-Vehicle Cooperative Perception Algorithm

A Novel Probabilistic V2X Data Fusion Framework for Cooperative Perception

CoBEVT: Cooperative Bird's Eye View Semantic Segmentation with Sparse Transformers

PACP: Priority-Aware Collaborative Perception for Connected and Autonomous Vehicles

V2I-BEVF: Multi-modal Fusion Based on BEV Representation for Vehicle-Infrastructure Perception

Consensus-Based Distributed Cooperative Perception for Connected and Automated Vehicles