Abstract:Occlusion is a major challenge for LiDAR-based object detection methods. This challenge becomes safety-critical in urban traffic where the ego vehicle must have reliable object detection to avoid collision while its field of view is severely reduced due to the obstruction posed by a large number of road users. Collaborative perception via Vehicle-to-Everything (V2X) communication, which leverages the diverse perspective thanks to the presence at multiple locations of connected agents to form a complete scene representation, is an appealing solution. State-of-the-art V2X methods resolve the performance-bandwidth tradeoff using a mid-collaboration approach where the Bird-Eye View images of point clouds are exchanged so that the bandwidth consumption is lower than communicating point clouds as in early collaboration, and the detection performance is higher than late collaboration, which fuses agents' output, thanks to a deeper interaction among connected agents. While achieving strong performance, the real-world deployment of most mid-collaboration approaches is hindered by their overly complicated architectures, involving learnable collaboration graphs and autoencoder-based compressor/ decompressor, and unrealistic assumptions about inter-agent synchronization. In this work, we devise a simple yet effective collaboration method that achieves a better bandwidth-performance tradeoff than prior state-of-the-art methods while minimizing changes made to the single-vehicle detection models and relaxing unrealistic assumptions on inter-agent synchronization. Experiments on the V2X-Sim dataset show that our collaboration method achieves 98\% of the performance of an early-collaboration method, while only consuming the equivalent bandwidth of a late-collaboration method.

A Collaborative Perception Network Based on Dynamic Multi-scale Fusion

Attention Based Feature Fusion For Multi-Agent Collaborative Perception

Multi-agent Collaborative Perception Via Motion-aware Robust Communication Network

UMC: A Unified Bandwidth-efficient and Multi-resolution based Collaborative Perception Framework

Enhancing lane detection with a lightweight collaborative late fusion model

DCP-Net: A Distributed Collaborative Perception Network for Remote Sensing Semantic Segmentation

Practical Collaborative Perception: A Framework for Asynchronous and Multi-Agent 3D Object Detection

Enhancing 3D object detection through multi-modal fusion for cooperative perception

Spatio-Temporal Domain Awareness for Multi-Agent Collaborative Perception

Latency-Aware Collaborative Perception

Cooperative Perception with Learning-Based V2V communications

How2comm: Communication-Efficient and Collaboration-Pragmatic Multi-Agent Perception

CollaMamba: Efficient Collaborative Perception with Cross-Agent Spatial-Temporal State Space Model

Collaborative Joint Perception and Prediction for Autonomous Driving

R-ACP: Real-Time Adaptive Collaborative Perception Leveraging Robust Task-Oriented Communications

StreamLTS: Query-based Temporal-Spatial LiDAR Fusion for Cooperative Object Detection

Efficient Vehicular Collaborative Perception Based on Saptial-Temporal Feature Compression

SiCP: Simultaneous Individual and Cooperative Perception for 3D Object Detection in Connected and Automated Vehicles

ACF-Net: Asymmetric Cascade Fusion for 3D Detection with LiDAR Point Clouds and Images

BM2CP: Efficient Collaborative Perception with LiDAR-Camera Modalities