Abstract:Machine learned partial differential equation (PDE) solvers trade the reliability of standard numerical methods for potential gains in accuracy and/or speed. The only way for a solver to guarantee that it outputs the exact solution is to use a convergent method in the limit that the grid spacing $\Delta x$ and timestep $\Delta t$ approach zero. Machine learned solvers, which learn to update the solution at large $\Delta x$ and/or $\Delta t$, can never guarantee perfect accuracy. Some amount of error is inevitable, so the question becomes: how do we constrain machine learned solvers to give us the sorts of errors that we are willing to tolerate? In this paper, we design more reliable machine learned PDE solvers by preserving discrete analogues of the continuous invariants of the underlying PDE. Examples of such invariants include conservation of mass, conservation of energy, the second law of thermodynamics, and/or non-negative density. Our key insight is simple: to preserve invariants, at each timestep apply an error-correcting algorithm to the update rule. Though this strategy is different from how standard solvers preserve invariants, it is necessary to retain the flexibility that allows machine learned solvers to be accurate at large $\Delta x$ and/or $\Delta t$. This strategy can be applied to any autoregressive solver for any time-dependent PDE in arbitrary geometries with arbitrary boundary conditions. Although this strategy is very general, the specific error-correcting algorithms need to be tailored to the invariants of the underlying equations as well as to the solution representation and time-stepping scheme of the solver. The error-correcting algorithms we introduce have two key properties. First, by preserving the right invariants they guarantee numerical stability. Second, in closed or periodic systems they do so without degrading the accuracy of an already-accurate solver.

Constraint-Satisfying Krylov Solvers for Structure-Preserving DiscretiZations

Constraint-satisfying Krylov solvers for structure-preserving discretisations

An optimization-based approach for high-order accurate discretization of conservation laws with discontinuous solutions

Discontinuity-resolving shock-capturing schemes on unstructured grids

A Structure-Preserving Domain Decomposition Method for Data-Driven Modeling

Invariant preservation in machine learned PDE solvers via error correction

Bridging the gap: symplecticity and low regularity in Runge-Kutta resonance-based schemes

Structure-Preserving Discretization of Incompressible Fluids

Structure-preserving numerical schemes for Lindblad equations

A novel, structure-preserving, second-order-in-time relaxation scheme for Schrödinger-Poisson systems

Structure preservation in high-order hybrid discretisations of potential-driven advection-diffusion: linear and nonlinear approaches

Parallel-in-Time Solver for the All-at-Once Runge–Kutta Discretization

Monolithic convex limiting and implicit pseudo-time stepping for calculating steady-state solutions of the Euler equations

The Onsager principle and structure preserving numerical schemes

A Linearly-Fitted Conservative (dissipative) Scheme for Efficiently Solving Conservative (dissipative) Nonlinear Wave PDEs

A structure preserving difference scheme with fast algorithms for high dimensional nonlinear space-fractional Schrödinger equations

Parallel Kinetic Schemes for Conservation Laws, with Large Time Steps

What is a limit of structure-preserving numerical methods for compressible flows?

Geometric numerical schemes for the KdV equation

Numerical preservation of multiple local conservation laws