Abstract:Uncertainty quantification (UQ) in scientific machine learning (SciML) becomes increasingly critical as neural networks (NNs) are being widely adopted in addressing complex problems across various scientific disciplines. Representative SciML models are physics-informed neural networks (PINNs) and neural operators (NOs). While UQ in SciML has been increasingly investigated in recent years, very few works have focused on addressing the uncertainty caused by the noisy inputs, such as spatial–temporal coordinates in PINNs and input functions in NOs. The presence of noise in the inputs of the models can pose significantly more challenges compared to noise in the outputs of the models, primarily due to the inherent nonlinearity of most SciML algorithms. As a result, UQ for noisy inputs becomes a crucial factor for reliable and trustworthy deployment of these models in applications involving physical knowledge. To this end, we introduce a Bayesian approach to quantify uncertainty arising from noisy inputs–outputs in PINNs and NOs. We show that this approach can be seamlessly integrated into PINNs and NOs, when they are employed to encode the physical information. PINNs incorporate physics by including physics-informed terms via automatic differentiation, either in the loss function or the likelihood, and often take as input the spatial–temporal coordinate. Therefore, the present method equips PINNs with the capability to address problems where the observed coordinate is subject to noise. On the other hand, pretrained NOs are also commonly employed as equation-free surrogates in solving differential equations and Bayesian inverse problems, in which they take functions as inputs. The proposed approach enables them to handle noisy measurements for both input and output functions with UQ. We present a series of numerical examples to demonstrate the consequences of ignoring the noise in the inputs and the effectiveness of our approach in addressing noisy inputs–outputs with UQ when PINNs and pretrained NOs are employed for physics-informed learning.

NeuralUQ: A Comprehensive Library for Uncertainty Quantification in Neural Differential Equations and Operators

Uncertainty Quantification in Neural Differential Equations

Uncertainty Quantification in Machine Learning for Engineering Design and Health Prognostics: A Tutorial

Uncertainty quantification for noisy inputs-outputs in physics-informed neural networks and neural operators

DiffHybrid-UQ: Uncertainty Quantification for Differentiable Hybrid Neural Modeling

Uncertainty quantification for noisy inputs–outputs in physics-informed neural networks and neural operators

Leveraging Viscous Hamilton–Jacobi PDEs for Uncertainty Quantification in Scientific Machine Learning

Leveraging viscous Hamilton-Jacobi PDEs for uncertainty quantification in scientific machine learning

Assessment of Uncertainty Quantification in Universal Differential Equations

A review of uncertainty quantification in deep learning: Techniques, applications and challenges

UNIQUE: A Framework for Uncertainty Quantification Benchmarking

Uncertainty quantification for deep learning-based schemes for solving high-dimensional backward stochastic differential equations

Using Uncertainty Quantification to Characterize and Improve Out-of-Domain Learning for PDEs

A Survey on Uncertainty Quantification Methods for Deep Learning

Evaluating Uncertainty Quantification approaches for Neural PDEs in scientific applications

Uncertainty Quantification for Forward and Inverse Problems of PDEs via Latent Global Evolution

A Survey on Uncertainty Quantification Methods for Deep Neural Networks: An Uncertainty Source Perspective

Uncertainty Quantification in Machine Learning for Biosignal Applications -- A Review

Physics-constrained polynomial chaos expansion for scientific machine learning and uncertainty quantification

Epistemic Uncertainty Quantification For Pre-trained Neural Network

Democratizing Uncertainty Quantification