Abstract:Object detection is the central issue of intelligent traffic systems, and recent advancements in single-vehicle lidar-based 3D detection indicate that it can provide accurate position information for intelligent agents to make decisions and plan. Compared with single-vehicle perception, multi-view vehicle-road cooperation perception has fundamental advantages, such as the elimination of blind spots and a broader range of perception, and has become a research hotspot. However, the current perception of cooperation focuses on improving the complexity of fusion while ignoring the fundamental problems caused by the absence of single-view outlines. We propose a multi-view vehicle-road cooperation perception system, vehicle-to-everything cooperative perception (V2X-AHD), in order to enhance the identification capability, particularly for predicting the vehicle's shape. At first, we propose an asymmetric heterogeneous distillation network fed with different training data to improve the accuracy of contour recognition, with multi-view teacher features transferring to single-view student features. While the point cloud data are sparse, we propose Spara Pillar, a spare convolutional-based plug-in feature extraction backbone, to reduce the number of parameters and improve and enhance feature extraction capabilities. Moreover, we leverage the multi-head self-attention (MSA) to fuse the single-view feature, and the lightweight design makes the fusion feature a smooth expression. The results of applying our algorithm to the massive open dataset V2Xset demonstrate that our method achieves the state-of-the-art result. The V2X-AHD can effectively improve the accuracy of 3D object detection and reduce the number of network parameters, according to this study, which serves as a benchmark for cooperative perception. The code for this article is available at https://github.com/feeling0414-lab/V2X-AHD.

V2I based environment perception for autonomous vehicles at intersections

A Fusion Method Aiming at Environmental Perception of Autonomous Vehicle Based on Visual Scheme

Unifying Terrain Awareness Through Real-Time Semantic Segmentation

Enhanced Perception for Autonomous Vehicles at Obstructed Intersections: An Implementation of Vehicle to Infrastructure (V2I) Collaboration

V2I-BEVF: Multi-modal Fusion Based on BEV Representation for Vehicle-Infrastructure Perception

Vision-Based Environmental Perception and Navigation of Micro-Intelligent Vehicles

V2V Based Visual Cooperative Perception for Connected Autonomous Vehicles: Far-Sight and See-Through

Dynamic V2X Autonomous Perception from Road-to-Vehicle Vision

Distributed perception and model inference with intelligent connected vehicles in smart cities

IPS300+: a Challenging Multi-Modal Data Sets for Intersection Perception System

3D Scene Understanding at Urban Intersection Using Stereo Vision and Digital Map.

Infrastructure-Assisted Collaborative Perception in Automated Valet Parking: A Safety Perspective

V2I-Coop: Accurate Object Detection for Connected Automated Vehicles at Accident Black Spots with V2I Cross-Modality Cooperation

V2X-AHD:Vehicle-to-Everything Cooperation Perception via Asymmetric Heterogenous Distillation Network

Overcoming Occlusions: Perception Task-Oriented Information Sharing in Connected and Autonomous Vehicles

Intersection Detection and Recognition for Autonomous Urban Driving Using a Virtual Cylindrical Scanner

Cooper: Cooperative Perception for Connected Autonomous Vehicles based on 3D Point Clouds

Beyond-line-of-sight Perception Enhancement Via Information Interaction in Connected Autonomous Driving Environment

V2VNet: Vehicle-to-Vehicle Communication for Joint Perception and Prediction

Driving Environment Perception Based on the Fusion of Vehicular Wireless Communications and Automotive Remote Sensors

Joint 3D Reconstruction and Object Tracking for Traffic Video Analysis under IoV Environment