Abstract:We are interested in the development of surrogate models for uncertainty quantification and propagation in problems governed by stochastic PDEs using a deep convolutional encoder-decoder network in a similar fashion to approaches considered in deep learning for image-to-image regression tasks. Since normal neural networks are data intensive and cannot provide predictive uncertainty, we propose a Bayesian approach to convolutional neural nets. A recently introduced variational gradient descent algorithm based on Stein's method is scaled to deep convolutional networks to perform approximate Bayesian inference on millions of uncertain network parameters. This approach achieves state of the art performance in terms of predictive accuracy and uncertainty quantification in comparison to other approaches in Bayesian neural networks as well as techniques that include Gaussian processes and ensemble methods even when the training data size is relatively small. To evaluate the performance of this approach, we consider standard uncertainty quantification benchmark problems including flow in heterogeneous media defined in terms of limited data-driven permeability realizations. The performance of the surrogate model developed is very good even though there is no underlying structure shared between the input (permeability) and output (flow/pressure) fields as is often the case in the image-to-image regression models used in computer vision problems. Studies are performed with an underlying stochastic input dimensionality up to $4,225$ where most other uncertainty quantification methods fail. Uncertainty propagation tasks are considered and the predictive output Bayesian statistics are compared to those obtained with Monte Carlo estimates.

A Bayesian Neural ODE for a Lettuce Greenhouse

Using Bayesian Deep Learning to Capture Uncertainty for Residential Net Load Forecasting

Bayesian Neural Ordinary Differential Equations

Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantification

SDE-Net: Equipping Deep Neural Networks with Uncertainty Estimates

Deep Neural Network based Optimal Control of Greenhouses

Infinitely Deep Bayesian Neural Networks with Stochastic Differential Equations

Inferring the Langevin Equation with Uncertainty via Bayesian Neural Networks

Optimal Lighting Control in Greenhouses Using Bayesian Neural Networks for Sunlight Prediction

Bayesian Calibration and Uncertainty Quantification for a Large Nutrient Load Impact Model

Differentiable Physics-based Greenhouse Simulation

A Learned Simulation Environment to Model Plant Growth in Indoor Farming

Bayesian optimized deep ensemble for uncertainty quantification of deep neural networks: a system safety case study on sodium fast reactor thermal stratification modeling

Uncertainty and Structure in Neural Ordinary Differential Equations

Neural State-Space Models: Empirical Evaluation of Uncertainty Quantification

Probabilistic Neural Transfer Function Estimation with Bayesian System Identification

Robust Model-based Reinforcement Learning for Autonomous Greenhouse Control

Deep Modeling of Non-Gaussian Aleatoric Uncertainty

Neural SPDE solver for uncertainty quantification in high-dimensional space-time dynamics

Understanding Uncertainty in Bayesian Deep Learning

Using Bayesian deep learning approaches for uncertainty-aware building energy surrogate models