Abstract:This paper is about learning the parameter-to-solution map for systems of partial differential equations (PDEs) that depend on a potentially large number of parameters covering all PDE types for which a stable variational formulation (SVF) can be found. A central constituent is the notion of variationally correct residual loss function meaning that its value is always uniformly proportional to the squared solution error in the norm determined by the SVF, hence facilitating rigorous a posteriori accuracy control. It is based on a single variational problem, associated with the family of parameter dependent fiber problems, employing the notion of direct integrals of Hilbert spaces. Since in its original form the loss function is given as a dual test norm of the residual a central objective is to develop equivalent computable expressions. A first critical role is played by hybrid hypothesis classes, whose elements are piecewise polynomial in (low-dimensional) spatio-temporal variables with parameter-dependent coefficients that can be represented, e.g. by neural networks. Second, working with first order SVFs, we distinguish two scenarios: (i) the test space can be chosen as an $L_2$-space (e.g. for elliptic or parabolic problems) so that residuals live in $L_2$ and can be evaluated directly; (ii) when trial and test spaces for the fiber problems (e.g. for transport equations) depend on the parameters, we use ultraweak formulations. In combination with Discontinuous Petrov Galerkin concepts the hybrid format is then instrumental to arrive at variationally correct computable residual loss functions. Our findings are illustrated by numerical experiments representing (i) and (ii), namely elliptic boundary value problems with piecewise constant diffusion coefficients and pure transport equations with parameter dependent convection field.

Variational Monte Carlo - Bridging Concepts of Machine Learning and High Dimensional Partial Differential Equations

Quasi-Monte Carlo for partial differential equations with generalized Gaussian input uncertainty

Algorithms for Solving High Dimensional PDEs: from Nonlinear Monte Carlo to Machine Learning

Robust SDE-Based Variational Formulations for Solving Linear PDEs via Deep Learning

Leveraging Viscous Hamilton–Jacobi PDEs for Uncertainty Quantification in Scientific Machine Learning

Variational formulation based on duality to solve partial differential equations: Use of B-splines and machine learning approximants

Scaling up Probabilistic PDE Simulators with Structured Volumetric Information

Leveraging viscous Hamilton-Jacobi PDEs for uncertainty quantification in scientific machine learning

Machine learning of continuous and discrete variational ODEs with convergence guarantee and uncertainty quantification

Machine learning of discrete field theories with guaranteed convergence and uncertainty quantification

Quasi-Monte Carlo sampling for machine-learning partial differential equations

Stochastic methods for solving high-dimensional partial differential equations

Parabolic PDE-constrained optimal control under uncertainty with entropic risk measure using quasi-Monte Carlo integration

Probabilistic Solutions to Differential Equations and their Application to Riemannian Statistics

Quasi-Monte Carlo for Bayesian design of experiment problems governed by parametric PDEs

A Dimension-adaptive Combination Technique for Uncertainty Quantification

Variationally Correct Neural Residual Regression for Parametric PDEs: On the Viability of Controlled Accuracy

Machine Learning Approximation Algorithms for High-Dimensional Fully Nonlinear Partial Differential Equations and Second-order Backward Stochastic Differential Equations

Evaluating Uncertainty Quantification approaches for Neural PDEs in scientific applications

Robust information divergences for model-form uncertainty arising from sparse data in random PDE