Abstract:Machine learned partial differential equation (PDE) solvers trade the reliability of standard numerical methods for potential gains in accuracy and/or speed. The only way for a solver to guarantee that it outputs the exact solution is to use a convergent method in the limit that the grid spacing $\Delta x$ and timestep $\Delta t$ approach zero. Machine learned solvers, which learn to update the solution at large $\Delta x$ and/or $\Delta t$, can never guarantee perfect accuracy. Some amount of error is inevitable, so the question becomes: how do we constrain machine learned solvers to give us the sorts of errors that we are willing to tolerate? In this paper, we design more reliable machine learned PDE solvers by preserving discrete analogues of the continuous invariants of the underlying PDE. Examples of such invariants include conservation of mass, conservation of energy, the second law of thermodynamics, and/or non-negative density. Our key insight is simple: to preserve invariants, at each timestep apply an error-correcting algorithm to the update rule. Though this strategy is different from how standard solvers preserve invariants, it is necessary to retain the flexibility that allows machine learned solvers to be accurate at large $\Delta x$ and/or $\Delta t$. This strategy can be applied to any autoregressive solver for any time-dependent PDE in arbitrary geometries with arbitrary boundary conditions. Although this strategy is very general, the specific error-correcting algorithms need to be tailored to the invariants of the underlying equations as well as to the solution representation and time-stepping scheme of the solver. The error-correcting algorithms we introduce have two key properties. First, by preserving the right invariants they guarantee numerical stability. Second, in closed or periodic systems they do so without degrading the accuracy of an already-accurate solver.

Conservative correction procedures utilizing artificial dissipation operators

High-Order Entropy Correction with SIAC Filters

Stabilizing Discontinuous Galerkin Methods Using Dafermos' Entropy Rate Criterion: II—Systems of Conservation Laws and Entropy Inequality Predictors

Stabilizing Discontinuous Galerkin Methods Using Dafermos' Entropy Rate Criterion: II -- Systems of Conservation Laws and Entropy Inequality Predictors

Corrector Theory for Elliptic Equations in Random Media with Singular Green’s Function. Application to Random Boundaries

Discontinuous Galerkin schemes for hyperbolic systems in non-conservative variables: quasi-conservative formulation with subcell finite volume corrections

Informed Correctors for Discrete Diffusion Models

Sparsity-based Correction of Exponential Artifacts

Conservative and Stable Degree Preserving SBP Operators for Non-Conforming Meshes

Invariant preservation in machine learned PDE solvers via error correction

Homogenization of periodic parabolic systems in the $L_2(\mathbb{R}^d)$-norm with the corrector taken into account

High-order conservative and accurately dissipative numerical integrators via auxiliary variables

How to Design A Generic Accuracy-Enhancing Filter for Discontinuous Galerkin Methods

Smoothing $\mathcal{L}^2$ gradients in iterative regularization

Corrector Estimates and Homogenization Error of Unsteady Flow Ruled by Darcy's Law

Stable semi-implicit SDC methods for conservation laws

Towards Accuracy and Scalability: Combining Isogeometric Analysis with Deflation to Obtain Scalable Convergence for the Helmholtz Equation

Optimizing performance of the deconvolution model reduction for large ODE systems

Restoration by Compression

Conservative iterative methods for implicit discretizations of conservation laws

Residual-Based Error Corrector Operator to Enhance Accuracy and Reliability of Neural Operator Surrogates of Nonlinear Variational Boundary-Value Problems