Abstract:Object detection is the central issue of intelligent traffic systems, and recent advancements in single-vehicle lidar-based 3D detection indicate that it can provide accurate position information for intelligent agents to make decisions and plan. Compared with single-vehicle perception, multi-view vehicle-road cooperation perception has fundamental advantages, such as the elimination of blind spots and a broader range of perception, and has become a research hotspot. However, the current perception of cooperation focuses on improving the complexity of fusion while ignoring the fundamental problems caused by the absence of single-view outlines. We propose a multi-view vehicle-road cooperation perception system, vehicle-to-everything cooperative perception (V2X-AHD), in order to enhance the identification capability, particularly for predicting the vehicle's shape. At first, we propose an asymmetric heterogeneous distillation network fed with different training data to improve the accuracy of contour recognition, with multi-view teacher features transferring to single-view student features. While the point cloud data are sparse, we propose Spara Pillar, a spare convolutional-based plug-in feature extraction backbone, to reduce the number of parameters and improve and enhance feature extraction capabilities. Moreover, we leverage the multi-head self-attention (MSA) to fuse the single-view feature, and the lightweight design makes the fusion feature a smooth expression. The results of applying our algorithm to the massive open dataset V2Xset demonstrate that our method achieves the state-of-the-art result. The V2X-AHD can effectively improve the accuracy of 3D object detection and reduce the number of network parameters, according to this study, which serves as a benchmark for cooperative perception. The code for this article is available at https://github.com/feeling0414-lab/V2X-AHD.

Delay-Aware Cooperative Perception with Deep Reinforcement Learning in Vehicular Networks

Slim-FCP: Lightweight-Feature-Based Cooperative Perception for Connected Automated Vehicles

Cooperative Perception with Deep Reinforcement Learning for Connected Vehicles

Decentralized Multiagent Reinforcement Learning-based Cooperative Perception with Dual-functional Radar-Communication V2V Links

V2X User Scheduling for Collaborative Perception Based on Reinforcement Learning

InterCoop: Spatio-Temporal Interaction Aware Cooperative Perception for Networked Vehicles

Enhanced Cooperative Perception for Autonomous Vehicles Using Imperfect Communication

Learning for Vehicle-to-Vehicle Cooperative Perception Under Lossy Communication

EdgeCooper: Network-Aware Cooperative LiDAR Perception for Enhanced Vehicular Awareness

Consensus-Based Distributed Cooperative Perception for Connected and Automated Vehicles

Model-Assisted Learning for Adaptive Cooperative Perception of Connected Autonomous Vehicles

PACP: Priority-Aware Collaborative Perception for Connected and Autonomous Vehicles

Soft Actor–Critic-Based Multilevel Cooperative Perception for Connected Autonomous Vehicles

V2I Interference Management for Collaborative Perception Based on Hierarchical Reinforcement Learning

V2X Cooperative Perception for Autonomous Driving: Recent Advances and Challenges

Cooperative Perception With Learning-Based V2V Communications

Decentralized cooperative perception for autonomous vehicles: Learning to value the unknown

V2VFormer++: Multi-Modal Vehicle-to-Vehicle Cooperative Perception Via Global-Local Transformer

Interruption-Aware Cooperative Perception for V2X Communication-Aided Autonomous Driving

V2X-AHD:Vehicle-to-Everything Cooperation Perception via Asymmetric Heterogenous Distillation Network