Abstract:Autonomous driving requires accurate reasoning of the location of objects from raw sensor data. Recent end-to-end learning methods go from raw sensor data to a trajectory output via Bird's Eye View(BEV) segmentation as an interpretable intermediate representation. Motion planning over cost maps generated via Birds Eye View (BEV) segmentation has emerged as a prominent approach in autonomous driving. However, the current approaches have two critical gaps. First, the optimization process is simplistic and involves just evaluating a fixed set of trajectories over the cost map. The trajectory samples are not adapted based on their associated cost values. Second, the existing cost maps do not account for the uncertainty in the cost maps that can arise due to noise in RGB images, and BEV annotations. As a result, these approaches can struggle in challenging scenarios where there is abrupt cut-in, stopping, overtaking, merging, etc from the neighboring vehicles. In this paper, we propose UAP-BEV: A novel approach that models the noise in Spatio-Temporal BEV predictions to create an uncertainty-aware occupancy grid map. Using queries of the distance to the closest occupied cell, we obtain a sample estimate of the collision probability of the ego-vehicle. Subsequently, our approach uses gradient-free sampling-based optimization to compute low-cost trajectories over the cost map. Importantly, the sampling distribution is adapted based on the optimal cost values of the sampled trajectories. By explicitly modeling probabilistic collision avoidance in the BEV space, our approach is able to outperform the cost-map-based baselines in collision avoidance, route completion, time to completion, and smoothness. To further validate our method, we also show results on the real-world dataset NuScenes, where we report improvements in collision avoidance and smoothness.

Probably Approximately Correct Vision-Based Planning using Motion Primitives

PAC-Bayes Control: Learning Policies that Provably Generalize to Novel Environments

CPA-Planner: Motion Planner with Complete Perception Awareness for Sensing- Limited Quadrotors

Reactive motion planning with probabilistic safety guarantees

Stronger Generalization Guarantees for Robot Learning by Combining Generative Models and Real-World Data

Vision-Based Uncertainty-Aware Motion Planning based on Probabilistic Semantic Segmentation

Learning Obstacle Representations for Neural Motion Planning

Distilling Motion Planner Augmented Policies into Visual Control Policies for Robot Manipulation

Universal Planning Networks

Robust Perception-Informed Navigation using PAC-NMPC with a Learned Value Function

iKap: Kinematics-aware Planning with Imperative Learning

Motion Planning Networks: Bridging the Gap Between Learning-Based and Classical Motion Planners

Intention-Aware Navigation in Crowds with Extended-Space POMDP Planning

Binocular Vision-Based Motion Planning of An AUV: A Deep Reinforcement Learning Approach

PC-Planner: Physics-Constrained Self-Supervised Learning for Robust Neural Motion Planning with Shape-Aware Distance Function

Speeding Up Optimization-based Motion Planning through Deep Learning

Learning Augmented, Multi-Robot Long-Horizon Navigation in Partially Mapped Environments

Model-free Motion Planning of Autonomous Agents for Complex Tasks in Partially Observable Environments

Game-theoretic Occlusion-Aware Motion Planning: an Efficient Hybrid-Information Approach

Interactive multi-modal motion planning with Branch Model Predictive Control

UAP-BEV: Uncertainty Aware Planning using Bird's Eye View generated from Surround Monocular Images