Abstract:Abstract Improving the predictive capability and computational cost of dynamical models is often at the heart of augmenting computational physics with machine learning (ML). However, most learning results are limited in interpretability and generalization over different computational grid resolutions, initial and boundary conditions, domain geometries, and physical or problem-specific parameters. In the present study, we simultaneously address all these challenges by developing the novel and versatile methodology of unified neural partial delay differential equations. We augment existing/low-fidelity dynamical models directly in their partial differential equation (PDE) forms with both Markovian and non-Markovian neural network (NN) closure parameterizations. The melding of the existing models with NNs in the continuous spatiotemporal space followed by numerical discretization automatically allows for the desired generalizability. The Markovian term is designed to enable extraction of its analytical form and thus provides interpretability. The non-Markovian terms allow accounting for inherently missing time delays needed to represent the real world. Our flexible modeling framework provides full autonomy for the design of the unknown closure terms such as using any linear-, shallow-, or deep-NN architectures, selecting the span of the input function libraries, and using either or both Markovian and non-Markovian closure terms, all in accord with prior knowledge. We obtain adjoint PDEs in the continuous form, thus enabling direct implementation across differentiable and non-differentiable computational physics codes, different ML frameworks, and treatment of nonuniformly-spaced spatiotemporal training data. We demonstrate the new generalized neural closure models ( g nCMs) framework using four sets of experiments based on advecting nonlinear waves, shocks, and ocean acidification models. Our learned g nCMs discover missing physics, find leading numerical error terms, discriminate among candidate functional forms in an interpretable fashion, achieve generalization, and compensate for the lack of complexity in simpler models. Finally, we analyze the computational advantages of our new framework.

Structure-preserving neural networks for the regularized entropy-based closure of the Boltzmann moment system

Learning Invariance Preserving Moment Closure Model for Boltzmann-BGK Equation

Learning fast, accurate, and stable closures of a kinetic theory of an active fluid

Hyperbolic Machine Learning Moment Closures for the BGK Equations

Machine learning-based moment closure model for the semiconductor Boltzmann equation with uncertainties

Analysis of the Closure Approximation for A Class of Stochastic Differential Equations

Data-Driven Stochastic Closure Modeling via Conditional Diffusion Model and Neural Operator

Generalized neural closure models with interpretability

Entropy stable conservative flux form neural networks

Structure-preserving Local Discontinuous Galerkin method for nonlinear cross-diffusion systems

Solving the Boltzmann Equation with a Neural Sparse Representation

Numerical Methods for Solving Moment Equations in Kinetic Theory of Neuronal Network Dynamics

High-order Moment Closure Models with Random Batch Method for Efficient Computation of Multiscale Turbulent Systems

Learning Moment Closure in Reaction-Diffusion Systems with Spatial Dynamic Boltzmann Distributions

Energy-Conserving Neural Network for Turbulence Closure Modeling

Predicting continuum breakdown with deep neural networks

Spectral Closure for the Linear Boltzmann-BGK Equation

Direct Flux Gradient Approximation to Moment Closure of Kinetic Equations

A TVD neural network closure and application to turbulent combustion