Abstract:In multi-modal multi-agent trajectory forecasting, two major challenges have not been fully tackled: 1) how to measure the uncertainty brought by the interaction module that causes correlations among the predicted trajectories of multiple agents; 2) how to rank the multiple predictions and select the optimal predicted trajectory. In order to handle the aforementioned challenges, this work first proposes a novel concept, collaborative uncertainty (CU), which models the uncertainty resulting from interaction modules. Then we build a general CU-aware regression framework with an original permutation-equivariant uncertainty estimator to do both tasks of regression and uncertainty estimation. Furthermore, we apply the proposed framework to current SOTA multi-agent multi-modal forecasting systems as a plugin module, which enables the SOTA systems to: 1) estimate the uncertainty in the multi-agent multi-modal trajectory forecasting task; 2) rank the multiple predictions and select the optimal one based on the estimated uncertainty. We conduct extensive experiments on a synthetic dataset and two public large-scale multi-agent trajectory forecasting benchmarks. Experiments show that: 1) on the synthetic dataset, the CU-aware regression framework allows the model to appropriately approximate the ground-truth Laplace distribution; 2) on the multi-agent trajectory forecasting benchmarks, the CU-aware regression framework steadily helps SOTA systems improve their performances. Especially, the proposed framework helps VectorNet improve by 262 cm regarding the Final Displacement Error of the chosen optimal prediction on the nuScenes dataset; 3) in multi-agent multi-modal trajectory forecasting, prediction uncertainty is proportional to future stochasticity; 4) the estimated CU values are highly related to the interactive information among agents. The proposed framework can guide the development of more reliable and safer forecasting systems in the future.

Uncertain Multi-Task Learning and Its Applications in Index Forecasting

Multitask Learning Based on Least Squares Support Vector Regression for Stock Forecast

Multi-task Learning for Financial Forecasting

Research on Joint Forecasting Technology of Cold, Heat, and Electricity Loads Based on Multi-Task Learning

Effective LSTMs with Seasonal-Trend Decomposition and Adaptive Learning and Niching-Based Backtracking Search Algorithm for Time Series Forecasting

Can Uncertainty Quantification Enable Better Learning-based Index Tuning?

Parallel Extraction of Long-term Trends and Short-term Fluctuation Framework for Multivariate Time Series Forecasting

Optimizing accuracy and diversity: a multi-task approach to forecast combinations

CAMul: Calibrated and Accurate Multi-view Time-Series Forecasting

Multi-Task Learning for Design under Uncertainty with Multi-Fidelity Partially Observed Information

A multi-task learning method for multi-energy load forecasting based on synthesis correlation analysis and load participation factor

The uncertainty estimation of feature-based forecast combinations

Instance-based meta-learning for conditionally dependent univariate multi-step forecasting

Multiple Stock Time Series Jointly Forecasting with Multi-Task Learning

Collaborative Uncertainty Benefits Multi-Agent Multi-Modal Trajectory Forecasting

Multi-Task Learning for Time Series Forecasting Using NARMAX-LSTM

Quantitative Stock Investment by Routing Uncertainty-Aware Trading Experts: A Multi-Task Learning Approach

Stock Ranking with Multi-Task Learning

Multiple Task Learning Using Iteratively Reweighted Least Square.

Multi-Task Learning with Sequential Dependence Toward Industrial Applications: A Systematic Formulation

Robust Multi-Task Feature Learning