Abstract:In this article, we present a novel approach to multivariate probabilistic forecasting. Our approach is based on an extension of single-output quantile regression (QR) to multivariate-targets, called quantile surfaces (QS). QS uses a simple yet compelling idea of indexing observations of a probabilistic forecast through direction and vector length to estimate a central tendency. We extend the single-output QR technique to multivariate probabilistic targets. QS efficiently models dependencies in multivariate target variables and represents probability distributions through discrete quantile levels. Therefore, we present a novel two-stage process. In the first stage, we perform a deterministic point forecast (i.e., central tendency estimation). Subsequently, we model the prediction uncertainty using QS involving neural networks called quantile surface regression neural networks (QSNN). Additionally, we introduce new methods for efficient and straightforward evaluation of the reliability and sharpness of the issued probabilistic QS predictions. We complement this by the directional extension of the Continuous Ranked Probability Score (CRPS) score. Finally, we evaluate our novel approach on synthetic data and two currently researched real-world challenges in two different domains: First, probabilistic forecasting for renewable energy power generation, second, short-term cyclists trajectory forecasting for autonomously driving vehicles. Especially for the latter, our empirical results show that even a simple one-layer QSNN outperforms traditional parametric multivariate forecasting techniques, thus improving the state-of-the-art performance.

A Bayesian Approach to Multiple-Output Quantile Regression

Bayesian Quantile Regression with Subset Selection: A Posterior Summarization Perspective

Bayesian Quantile Regression for Longitudinal Studies with Nonignorable Missing Data.

A novel Bayesian method for variable selection and estimation in binary quantile regression

Bayesian Non-parametric Quantile Process Regression and Estimation of Marginal Quantile Effects

Bayesian nonparametric quantile process regression and estimation of marginal quantile effects

Quantile Regression Neural Networks: A Bayesian Approach

Bayesian Quantile Regression for Longitudinal Data Models

Bayesian Quantile Regression for Ordinal Models

Bayesian Quantile Estimation and Regression with Martingale Posteriors

Horseshoe Prior Bayesian Quantile Regression

Bayesian joint quantile autoregression

Bayesian Empirical Likelihood of Quantile Regression with Missing Observations

A New Family of Error Distributions for Bayesian Quantile Regression

Bayesian Quantile Regression with Mixed Discrete and Nonignorable Missing Covariates

Bayesian Quantile Regression Based on the Empirical Likelihood with Spike and Slab Priors

A sparse PAC-Bayesian approach for high-dimensional quantile prediction

A Bayesian approach for more reliable tail risk forecasts

Bayesian composite -quantile regression

Bayesian quantile additive regression trees

Quantile Surfaces -- Generalizing Quantile Regression to Multivariate Targets