Abstract:Deep Learning (DL) methods have been transforming computer vision with innovative adaptations to other domains including climate change. For DL to pervade Science and Engineering (S&E) applications where risk management is a core component, well-characterized uncertainty estimates must accompany predictions. However, S&E observations and model-simulations often follow heavily skewed distributions and are not well modeled with DL approaches, since they usually optimize a Gaussian, or Euclidean, likelihood loss. Recent developments in Bayesian Deep Learning (BDL), which attempts to capture uncertainties from noisy observations, aleatoric, and from unknown model parameters, epistemic, provide us a foundation. Here we present a discrete-continuous BDL model with Gaussian and lognormal likelihoods for uncertainty quantification (UQ). We demonstrate the approach by developing UQ estimates on `DeepSD', a super-resolution based DL model for Statistical Downscaling (SD) in climate applied to precipitation, which follows an extremely skewed distribution. We find that the discrete-continuous models outperform a basic Gaussian distribution in terms of predictive accuracy and uncertainty calibration. Furthermore, we find that the lognormal distribution, which can handle skewed distributions, produces quality uncertainty estimates at the extremes. Such results may be important across S&E, as well as other domains such as finance and economics, where extremes are often of significant interest. Furthermore, to our knowledge, this is the first UQ model in SD where both aleatoric and epistemic uncertainties are characterized.

A survey on uncertainty quantification in deep learning for financial time series prediction

A Comparison of Uncertainty Quantification of Deep Learning models for Time Series

Quantifying neural network uncertainty under volatility clustering

Quantile deep learning models for multi-step ahead time series prediction

Uncertainty Modelling in Deep Networks: Forecasting Short and Noisy Series

A Survey on Uncertainty Quantification Methods for Deep Learning

A Survey on Uncertainty Quantification Methods for Deep Neural Networks: An Uncertainty Source Perspective

A survey on deep learning for financial risk prediction

Uncertainty-Aware Lookahead Factor Models for Quantitative Investing

Uncertainty Quantification for Deep Learning

Empirical Frequentist Coverage of Deep Learning Uncertainty Quantification Procedures

Comparative Analysis of Machine Learning, Hybrid, and Deep Learning Forecasting Models Evidence from European Financial Markets and Bitcoins

A review of uncertainty quantification in deep learning: Techniques, applications and challenges

Evaluation of Uncertainty Quantification in Deep Learning

Certainty of uncertainty for asset pricing

Single-Model Uncertainties for Deep Learning

Deeply Uncertain: Comparing Methods of Uncertainty Quantification in Deep Learning Algorithms

Machine Learning for Quantitative Finance Applications: A Survey

Quantifying Epistemic Uncertainty in Deep Learning

Quantifying Uncertainty in Discrete-Continuous and Skewed Data with Bayesian Deep Learning

Uncertainty Quantification in Neural Differential Equations