Abstract:The hybrid neural differentiable models mark a significant advancement in the field of scientific machine learning. These models, integrating numerical representations of known physics into deep neural networks, offer enhanced predictive capabilities and show great potential for data-driven modeling of complex physical systems. However, a critical and yet unaddressed challenge lies in the quantification of inherent uncertainties stemming from multiple sources. Addressing this gap, we introduce a novel method, DiffHybrid-UQ, for effective and efficient uncertainty propagation and estimation in hybrid neural differentiable models, leveraging the strengths of deep ensemble Bayesian learning and nonlinear transformations. Specifically, our approach effectively discerns and quantifies both aleatoric uncertainties, arising from data noise, and epistemic uncertainties, resulting from model-form discrepancies and data sparsity. This is achieved within a Bayesian model averaging framework, where aleatoric uncertainties are modeled through hybrid neural models. The unscented transformation plays a pivotal role in enabling the flow of these uncertainties through the nonlinear functions within the hybrid model. In contrast, epistemic uncertainties are estimated using an ensemble of stochastic gradient descent (SGD) trajectories. This approach offers a practical approximation to the posterior distribution of both the network parameters and the physical parameters. Notably, the DiffHybrid-UQ framework is designed for simplicity in implementation and high scalability, making it suitable for parallel computing environments. The merits of the proposed method have been demonstrated through problems governed by both ordinary and partial differentiable equations.

Hyper-Diffusion: Estimating Epistemic and Aleatoric Uncertainty with a Single Model

Shedding Light on Large Generative Networks: Estimating Epistemic Uncertainty in Diffusion Models

Diffusion Tensor Estimation with Uncertainty Calibration

Modeling of 2D Diffusion Processes Based on Microscopy Data: Parameter Estimation and Practical Identifiability Analysis

Zero-Shot Uncertainty Quantification using Diffusion Probabilistic Models

DiffHybrid-UQ: Uncertainty Quantification for Differentiable Hybrid Neural Modeling

Single-Model Uncertainties for Deep Learning

Multi-fidelity Deep Learning-based methodology for epistemic uncertainty quantification of turbulence models

Where to Diffuse, How to Diffuse, and How to Get Back: Automated Learning for Multivariate Diffusions

A Deeper Look into Aleatoric and Epistemic Uncertainty Disentanglement

Uncertainty quantification by direct propagation of shallow ensembles

Model Free Prediction with Uncertainty Assessment

Quantifying Epistemic Uncertainty in Deep Learning

Diffusion Model Guided Sampling with Pixel-Wise Aleatoric Uncertainty Estimation

BayesDiff: Estimating Pixel-wise Uncertainty in Diffusion via Bayesian Inference

Bayesian deep learning for error estimation in the analysis of anomalous diffusion

General Intelligent Imaging and Uncertainty Quantification by Deterministic Diffusion Model

Quantifying Uncertainty in Transdimensional Markov Chain Monte Carlo Using Discrete Markov Models

The Epistemic Uncertainty Hole: an issue of Bayesian Neural Networks

Physics Based & Machine Learning Methods For Uncertainty Estimation In Turbulence Modeling

The Uncanny Valley: A Comprehensive Analysis of Diffusion Models