Abstract:Abstract Improving the predictive capability and computational cost of dynamical models is often at the heart of augmenting computational physics with machine learning (ML). However, most learning results are limited in interpretability and generalization over different computational grid resolutions, initial and boundary conditions, domain geometries, and physical or problem-specific parameters. In the present study, we simultaneously address all these challenges by developing the novel and versatile methodology of unified neural partial delay differential equations. We augment existing/low-fidelity dynamical models directly in their partial differential equation (PDE) forms with both Markovian and non-Markovian neural network (NN) closure parameterizations. The melding of the existing models with NNs in the continuous spatiotemporal space followed by numerical discretization automatically allows for the desired generalizability. The Markovian term is designed to enable extraction of its analytical form and thus provides interpretability. The non-Markovian terms allow accounting for inherently missing time delays needed to represent the real world. Our flexible modeling framework provides full autonomy for the design of the unknown closure terms such as using any linear-, shallow-, or deep-NN architectures, selecting the span of the input function libraries, and using either or both Markovian and non-Markovian closure terms, all in accord with prior knowledge. We obtain adjoint PDEs in the continuous form, thus enabling direct implementation across differentiable and non-differentiable computational physics codes, different ML frameworks, and treatment of nonuniformly-spaced spatiotemporal training data. We demonstrate the new generalized neural closure models ( g nCMs) framework using four sets of experiments based on advecting nonlinear waves, shocks, and ocean acidification models. Our learned g nCMs discover missing physics, find leading numerical error terms, discriminate among candidate functional forms in an interpretable fashion, achieve generalization, and compensate for the lack of complexity in simpler models. Finally, we analyze the computational advantages of our new framework.

Generalizable data-driven turbulence closure modeling on unstructured grids with differentiable physics

Neural Differentiable Modeling with Diffusion-Based Super-resolution for Two-Dimensional Spatiotemporal Turbulence

Generalized neural closure models with interpretability

Learning Closed-form Equations for Subgrid-scale Closures from High-fidelity Data: Promises and Challenges

Learning Incompressible Fluid Dynamics from Scratch -- Towards Fast, Differentiable Fluid Models that Generalize

Enhancing Data-Assimilation in CFD using Graph Neural Networks

Finite-difference-informed graph network for solving steady-state incompressible flows on block-structured grids

Finite Volume Features, Global Geometry Representations, and Residual Training for Deep Learning-based CFD Simulation

Data-driven RANS closures for improving mean field calculation of separated flows

Using Physics-Informed Super-Resolution Generative Adversarial Networks for Subgrid Modeling in Turbulent Reactive Flows

Kinetic data-driven approach to turbulence subgrid modeling

Learning fast, accurate, and stable closures of a kinetic theory of an active fluid

Machine learning of hidden variables in multiscale fluid simulation

Graph Neural Networks and Differential Equations: A hybrid approach for data assimilation of fluid flows

A fully differentiable GNN-based PDE Solver: With Applications to Poisson and Navier-Stokes Equations

Machine-learnt closure models based on computational space training frameworks for large-eddy simulations in natural convection

Turbulence closure with small, local neural networks: Forced two-dimensional and $β$-plane flows

Stacked Generative Machine Learning Models for Fast Approximations of Steady-State Navier-Stokes Equations

SURF: A Generalization Benchmark for GNNs Predicting Fluid Dynamics

Multi-Objective CFD-Driven Development of Coupled Turbulence Closure Models