Abstract:The hybrid neural differentiable models mark a significant advancement in the field of scientific machine learning. These models, integrating numerical representations of known physics into deep neural networks, offer enhanced predictive capabilities and show great potential for data-driven modeling of complex physical systems. However, a critical and yet unaddressed challenge lies in the quantification of inherent uncertainties stemming from multiple sources. Addressing this gap, we introduce a novel method, DiffHybrid-UQ, for effective and efficient uncertainty propagation and estimation in hybrid neural differentiable models, leveraging the strengths of deep ensemble Bayesian learning and nonlinear transformations. Specifically, our approach effectively discerns and quantifies both aleatoric uncertainties, arising from data noise, and epistemic uncertainties, resulting from model-form discrepancies and data sparsity. This is achieved within a Bayesian model averaging framework, where aleatoric uncertainties are modeled through hybrid neural models. The unscented transformation plays a pivotal role in enabling the flow of these uncertainties through the nonlinear functions within the hybrid model. In contrast, epistemic uncertainties are estimated using an ensemble of stochastic gradient descent (SGD) trajectories. This approach offers a practical approximation to the posterior distribution of both the network parameters and the physical parameters. Notably, the DiffHybrid-UQ framework is designed for simplicity in implementation and high scalability, making it suitable for parallel computing environments. The merits of the proposed method have been demonstrated through problems governed by both ordinary and partial differentiable equations.

Uncertainty Quantification Based on Multilevel Conductance and Stochasticity of Heater Size Dependent C-doped Ge2Sb2Te5 PCM Chip

High-Dimensional Uncertainty Quantification in Multi-Physics Simulation for 3D Large-Scale High-Power Microwave System

Parallel Simulation of Fully Coupled Electrothermal Processes in Large-Scale Phase-Change Memory Arrays

Numerical Analysis of Heat Transfer Behaviours of Melting Process for Ice Thermal Storage Based on Various Heat Source Configurations

Efficient Uncertainty Modeling for System Design via Mixed Integer Programming

Heat Equation Stein Variational Ensemble: Rethinking and Advancing Uncertainty-Aware Soft Sensor Modeling

High Dimensional Uncertainty Quantification for an Electrothermal Field Problem using Stochastic Collocation on Sparse Grids and Tensor Train Decompositions

Localization of Joule Heating in Phase-Change Memory With Incorporated Nanostructures and Nanolayer for Reducing Reset Current

Unlocking device-scale atomistic modelling of phase-change memory materials

A Generalized Multi-Fidelity Simulation Method Using Sparse Polynomial Chaos Expansion

Uncertainty analysis of PCM-enhanced systems for reliable prediction of thermal capacity using stochastic finite element method

UNCERTAINTY QUANTIFICATION IN DYNAMIC SIMULATIONS OF LARGE-SCALE POWER SYSTEM MODELS USING THE HIGH-ORDER PROBABILISTIC COLLOCATION METHOD ON SPARSE GRIDS

Machine-Learning Assisted Optimization Strategies for Phase Change Materials Embedded within Electronic Packages

Nonideality Suppression and 16-State Multilevel Cell Storage Optimization in Phase Change Memory With Linear-Like Circuit

Stacked Ge2Sb2Te5/GeTe Multi-Level Phase-Change Memory with Asymmetric Double-Heater

DiffHybrid-UQ: Uncertainty Quantification for Differentiable Hybrid Neural Modeling

High-Accuracy Machine-Learned Interatomic Potentials for the Phase Change Material Ge 3 Sb 6 Te 5

A Stepwise Integration Separation of Variables Solver for Full-Chip Thermal Uncertainty Analysis

On Uncertainty Quantification of Lithium-ion Batteries: Application to an LiC$_6$/LiCoO$_2$ cell

Direct observation of nanometer-scale Joule and Peltier effects in phase change memory devices

Electrothermal Coupling and Threshold-Switching Simulation Study on Phase Change Memory (PCM) Cell