Abstract:Predicting the trajectories of road agents is fundamental for self-driving cars. Trajectory prediction contains many sources of uncertainty in data and modelling. A thorough understanding of this uncertainty is crucial in a safety-critical task like auto-piloting a vehicle. In practice, it is necessary to distinguish between the uncertainty caused by partial observability of all factors that may affect a driver's near-future decisions, the so-called aleatoric uncertainty , and the uncertainty of deploying a model in new scenarios that are possibly not present in the training set, the so-called epistemic uncertainty . They reflect the trade-off between data collection and model improvement In this paper, we propose a new framework to systematically quantify both sources of uncertainty. Specifically, to approximate the spatial distribution of an agent's future position, we propose a 2D histogram-based deep learning model combined with deep ensemble techniques for measuring aleatoric and epistemic uncertainty by entropy-based quantities. The proposed Uncertainty Quantification Network (UQnet) employs a causal part to enhance its generalizability so rare driving behaviours can be effectively identified. Experiments on the INTERACTION dataset show that UQnet is able to give more robust predictions in generalizability tests compared to the correlation-based models. Further analysis presents that high aleatoric uncertainty cases are mainly caused by heterogeneous driving behaviours and unknown intended directions. Based on this aleatoric uncertainty component, we estimate the lower bounds of mean-square-error and final-displacement-error as indicators for the predictability of trajectories. Furthermore, the analysis of epistemic uncertainty illustrates that domain knowledge of speed-dependent driving behaviour is essential for adapting a model from low-speed to high-speed situations. Our paper contributes to motion forecasting with a new framework, that recasts the problem of accuracy improvement in a way that focuses on differentiating between unpredictable components and rare cases for which more and different data should be collected.

Uncertainty Prediction for Deep Sequential Regression Using Meta Models

Uncertainty Estimation With Neural Processes for Meta-Continual Learning

Post-hoc Uncertainty Learning using a Dirichlet Meta-Model

Uncertainty Modelling in Deep Networks: Forecasting Short and Noisy Series

Single-Model Uncertainties for Deep Learning

Model Free Prediction with Uncertainty Assessment

A Monte Carlo Framework for Calibrated Uncertainty Estimation in Sequence Prediction

Uncertainty Voting Ensemble for Imbalanced Deep Regression

Uncertainty Estimation and Calibration with Finite-State Probabilistic RNNs

Uncertainty Quantification Metrics for Deep Regression

Average-Over-Time Spiking Neural Networks for Uncertainty Estimation in Regression

Exploring Uncertainty in Regression Neural Networks for Construction of Prediction Intervals

A prediction rigidity formalism for low-cost uncertainties in trained neural networks

A Novel Regression Loss for Non-Parametric Uncertainty Optimization

Deep Modeling of Non-Gaussian Aleatoric Uncertainty

Bayesian Recurrent Neural Network Models for Forecasting and Quantifying Uncertainty in Spatial-Temporal Data

Unravelling uncertainty in trajectory prediction using a non-parametric approach

Learning Uncertainty with Artificial Neural Networks for Improved Predictive Process Monitoring

Accurate Uncertainties for Deep Learning Using Calibrated Regression

A General Framework for Uncertainty Quantification via Neural SDE-RNN