Abstract:Environment perception plays a crucial role in enabling collaborative driving automation, which is considered to be the ground-breaking solution to tackling the safety, mobility, and sustainability challenges of contemporary transportation systems. Despite the fact that computer vision for object perception is undergoing an extraordinary evolution, single-vehicle systems' constrained receptive fields and inherent physical occlusion make it difficult for state-of-the-art perception techniques to cope with complex real-world traffic settings. Collaborative perception (CP) based on various geographically separated perception nodes was developed to break the perception bottleneck for driving automation. CP leverages vehicle-to-vehicle and vehicle-to-infrastructure communication to enable vehicles and infrastructure to combine and share information to comprehend the surrounding environment beyond the line of sight and field of view to enhance perception accuracy, lower latency, and remove perception blind spots. In this article, we highlight the need for an evolved version of the collaborative perception that should address the challenges hindering the realization of level 5 AD use cases by comprehensively studying the transition from classical perception to collaborative perception. In particular, we discuss and review perception creation at two different levels: vehicle and infrastructure. Furthermore, we also study the communication technologies and three different collaborative perception message-sharing models, their comparison analyzing the trade-off between the accuracy of the transmitted data and the communication bandwidth used for data transmission, and the challenges therein. Finally, we discuss a range of crucial challenges and future directions of collaborative perception that need to be addressed before a higher level of autonomy hits the roads.

Scalable and Dynamic Cooperative Perception: A Data/Model Co-Driven Framework

Slim-FCP: Lightweight-Feature-Based Cooperative Perception for Connected Automated Vehicles

A Survey and Framework of Cooperative Perception: From Heterogeneous Singleton to Hierarchical Cooperation

Model-Assisted Learning for Adaptive Cooperative Perception of Connected Autonomous Vehicles

MACP: Efficient Model Adaptation for Cooperative Perception

RSU-Aided Energy-Efficient Collaborative Perception for Connected Autonomous Vehicles

Enhanced Cooperative Perception for Autonomous Vehicles Using Imperfect Communication

A Cooperative Perception Environment for Traffic Operations and Control

PACP: Priority-Aware Collaborative Perception for Connected and Autonomous Vehicles

Consensus-Based Distributed Cooperative Perception for Connected and Automated Vehicles

Collaborative Perception for Connected and Autonomous Driving: Challenges, Possible Solutions and Opportunities

COOPERNAUT: End-to-End Driving with Cooperative Perception for Networked Vehicles

MASS: Mobility-Aware Sensor Scheduling of Cooperative Perception for Connected Automated Driving

On the Federated Learning Framework for Cooperative Perception

Demonstrations of Cooperative Perception: Safety and Robustness in Connected and Automated Vehicle Operations

Cooperative Perception with Deep Reinforcement Learning for Connected Vehicles

Situation-aware Autonomous Driving Decision Making with Cooperative Perception on Demand

Collaborative Perception-The Missing Piece in Realizing Fully Autonomous Driving

EdgeCooper: Network-Aware Cooperative LiDAR Perception for Enhanced Vehicular Awareness

SiCP: Simultaneous Individual and Cooperative Perception for 3D Object Detection in Connected and Automated Vehicles