Abstract:Autonomous driving requires accurate reasoning of the location of objects from raw sensor data. Recent end-to-end learning methods go from raw sensor data to a trajectory output via Bird's Eye View(BEV) segmentation as an interpretable intermediate representation. Motion planning over cost maps generated via Birds Eye View (BEV) segmentation has emerged as a prominent approach in autonomous driving. However, the current approaches have two critical gaps. First, the optimization process is simplistic and involves just evaluating a fixed set of trajectories over the cost map. The trajectory samples are not adapted based on their associated cost values. Second, the existing cost maps do not account for the uncertainty in the cost maps that can arise due to noise in RGB images, and BEV annotations. As a result, these approaches can struggle in challenging scenarios where there is abrupt cut-in, stopping, overtaking, merging, etc from the neighboring vehicles. In this paper, we propose UAP-BEV: A novel approach that models the noise in Spatio-Temporal BEV predictions to create an uncertainty-aware occupancy grid map. Using queries of the distance to the closest occupied cell, we obtain a sample estimate of the collision probability of the ego-vehicle. Subsequently, our approach uses gradient-free sampling-based optimization to compute low-cost trajectories over the cost map. Importantly, the sampling distribution is adapted based on the optimal cost values of the sampled trajectories. By explicitly modeling probabilistic collision avoidance in the BEV space, our approach is able to outperform the cost-map-based baselines in collision avoidance, route completion, time to completion, and smoothness. To further validate our method, we also show results on the real-world dataset NuScenes, where we report improvements in collision avoidance and smoothness.

Bird’s Eye View Map for End-to-end Autonomous Driving Using Reinforcement Learning

Hierarchical End-to-End Autonomous Driving: Integrating BEV Perception with Deep Reinforcement Learning

Autonomous Driving with Human Guided Image Feature Extraction

BEVNav: Robot Autonomous Navigation Via Spatial-Temporal Contrastive Learning in Bird's-Eye View

Delving Into the Devils of Bird's-Eye-View Perception: A Review, Evaluation and Recipe

Probabilistic End-to-End Vehicle Navigation in Complex Dynamic Environments with Multimodal Sensor Fusion

Vision-Driven 2D Supervised Fine-Tuning Framework for Bird's Eye View Perception

Hierarchical Interpretable Imitation Learning for End-to-End Autonomous Driving

S2G2: Semi-Supervised Semantic Bird-Eye-View Grid-Map Generation Using a Monocular Camera for Autonomous Driving

OneBEV: Using One Panoramic Image for Bird's-Eye-View Semantic Mapping

Hierarchical and Decoupled BEV Perception Learning Framework for Autonomous Driving

Understanding Bird's-Eye View of Road Semantics using an Onboard Camera

UAP-BEV: Uncertainty Aware Planning using Bird's Eye View generated from Surround Monocular Images

BEVerse: Unified Perception and Prediction in Birds-Eye-View for Vision-Centric Autonomous Driving

SkyEye: Self-Supervised Bird's-Eye-View Semantic Mapping Using Monocular Frontal View Images

Improved Single Camera BEV Perception Using Multi-Camera Training

A Camera-Based End-to-End Autonomous Driving Framework Combined with Meta-Based Multi-task Optimization

Fast-BEV: Towards Real-time On-vehicle Bird's-Eye View Perception

Multi-View Fusion of Sensor Data for Improved Perception and Prediction in Autonomous Driving

MapVision: CVPR 2024 Autonomous Grand Challenge Mapless Driving Tech Report