Abstract:Predicting the trajectories of road agents is fundamental for self-driving cars. Trajectory prediction contains many sources of uncertainty in data and modelling. A thorough understanding of this uncertainty is crucial in a safety-critical task like auto-piloting a vehicle. In practice, it is necessary to distinguish between the uncertainty caused by partial observability of all factors that may affect a driver's near-future decisions, the so-called aleatoric uncertainty , and the uncertainty of deploying a model in new scenarios that are possibly not present in the training set, the so-called epistemic uncertainty . They reflect the trade-off between data collection and model improvement In this paper, we propose a new framework to systematically quantify both sources of uncertainty. Specifically, to approximate the spatial distribution of an agent's future position, we propose a 2D histogram-based deep learning model combined with deep ensemble techniques for measuring aleatoric and epistemic uncertainty by entropy-based quantities. The proposed Uncertainty Quantification Network (UQnet) employs a causal part to enhance its generalizability so rare driving behaviours can be effectively identified. Experiments on the INTERACTION dataset show that UQnet is able to give more robust predictions in generalizability tests compared to the correlation-based models. Further analysis presents that high aleatoric uncertainty cases are mainly caused by heterogeneous driving behaviours and unknown intended directions. Based on this aleatoric uncertainty component, we estimate the lower bounds of mean-square-error and final-displacement-error as indicators for the predictability of trajectories. Furthermore, the analysis of epistemic uncertainty illustrates that domain knowledge of speed-dependent driving behaviour is essential for adapting a model from low-speed to high-speed situations. Our paper contributes to motion forecasting with a new framework, that recasts the problem of accuracy improvement in a way that focuses on differentiating between unpredictable components and rare cases for which more and different data should be collected.

Uncertainty prediction and calibration using multi-expert gating mechanism

Uncertainty Estimation With Neural Processes for Meta-Continual Learning

Multi-step prediction of chaotic time-series with intermittent failures based on the generalized nonlinear filtering methods

An Uncertainty Calibration Method for Multi-Output Model

Accurate Uncertainties for Deep Learning Using Calibrated Regression

Uncertainty Estimation and Calibration with Finite-State Probabilistic RNNs

SAUC: Sparsity-Aware Uncertainty Calibration for Spatiotemporal Prediction with Graph Neural Networks

Evaluating and Calibrating Uncertainty Prediction in Regression Tasks

Adaptive Ensemble Learning of Spatiotemporal Processes with Calibrated Predictive Uncertainty: A Bayesian Nonparametric Approach

A Monte Carlo Framework for Calibrated Uncertainty Estimation in Sequence Prediction

Uncertainty Calibration with Energy Based Instance-wise Scaling in the Wild Dataset

Unravelling uncertainty in trajectory prediction using a non-parametric approach

An Uncertainty Quantification and Calibration Framework for RUL Prediction and Accuracy Improvement

Robust Calibration with Multi-domain Temperature Scaling

STUaNet: Understanding uncertainty in spatiotemporal collective human mobility

Multi-Head Multi-Loss Model Calibration

Field-aware Calibration: A Simple and Empirically Strong Method for Reliable Probabilistic Predictions

Confidence Calibration for Systems with Cascaded Predictive Modules

Exploring Uncertainty in Deep Learning for Construction of Prediction Intervals

Improving Uncertainty Calibration of Deep Neural Networks via Truth Discovery and Geometric Optimization

Confidence-Aware Multi-Field Model Calibration