Abstract:Object detection is the central issue of intelligent traffic systems, and recent advancements in single-vehicle lidar-based 3D detection indicate that it can provide accurate position information for intelligent agents to make decisions and plan. Compared with single-vehicle perception, multi-view vehicle-road cooperation perception has fundamental advantages, such as the elimination of blind spots and a broader range of perception, and has become a research hotspot. However, the current perception of cooperation focuses on improving the complexity of fusion while ignoring the fundamental problems caused by the absence of single-view outlines. We propose a multi-view vehicle-road cooperation perception system, vehicle-to-everything cooperative perception (V2X-AHD), in order to enhance the identification capability, particularly for predicting the vehicle's shape. At first, we propose an asymmetric heterogeneous distillation network fed with different training data to improve the accuracy of contour recognition, with multi-view teacher features transferring to single-view student features. While the point cloud data are sparse, we propose Spara Pillar, a spare convolutional-based plug-in feature extraction backbone, to reduce the number of parameters and improve and enhance feature extraction capabilities. Moreover, we leverage the multi-head self-attention (MSA) to fuse the single-view feature, and the lightweight design makes the fusion feature a smooth expression. The results of applying our algorithm to the massive open dataset V2Xset demonstrate that our method achieves the state-of-the-art result. The V2X-AHD can effectively improve the accuracy of 3D object detection and reduce the number of network parameters, according to this study, which serves as a benchmark for cooperative perception. The code for this article is available at https://github.com/feeling0414-lab/V2X-AHD.

BlindSpotEliminator: Collaborative Point Cloud Perception in Cellular-V2X Networks

Slim-FCP: Lightweight-Feature-Based Cooperative Perception for Connected Automated Vehicles

Practical Collaborative Perception: A Framework for Asynchronous and Multi-Agent 3D Object Detection

PACP: Priority-Aware Collaborative Perception for Connected and Autonomous Vehicles

Where2comm: Communication-Efficient Collaborative Perception Via Spatial Confidence Maps

V2X-PC: Vehicle-to-everything Collaborative Perception via Point Cluster

NLOS Dies Twice: Challenges and Solutions of V2X for Cooperative Perception

Efficient Vehicular Collaborative Perception Based on Saptial-Temporal Feature Compression

Edge Computing-Based Collaborative Vehicles 3D Mapping in Real Time

EdgeCooper: Network-Aware Cooperative LiDAR Perception for Enhanced Vehicular Awareness

Cooper: Cooperative Perception for Connected Autonomous Vehicles based on 3D Point Clouds

Selective Communication for Cooperative Perception in End-to-End Autonomous Driving

Collaborative Joint Perception and Prediction for Autonomous Driving

An End-to-End Collaborative Learning Approach for Connected Autonomous Vehicles in Occluded Scenarios

Collaborative Perception for Connected and Autonomous Driving: Challenges, Possible Solutions and Opportunities

SparseComm: an Efficient Sparse Communication Framework for Vehicle-Infrastructure Cooperative 3D Detection

A Two-Stage Clustering Method for Point Clouds Based on Cooperative Perception of Vehicle-to-Vehicle

Performance and Scaling of Collaborative Sensing and Networking for Automated Driving Applications

Spatio-Temporal Domain Awareness for Multi-Agent Collaborative Perception

V2X-AHD:Vehicle-to-Everything Cooperation Perception via Asymmetric Heterogenous Distillation Network

A Survey of Collaborative Perception in Intelligent Vehicles at Intersections