Abstract:Abstract Improving the predictive capability and computational cost of dynamical models is often at the heart of augmenting computational physics with machine learning (ML). However, most learning results are limited in interpretability and generalization over different computational grid resolutions, initial and boundary conditions, domain geometries, and physical or problem-specific parameters. In the present study, we simultaneously address all these challenges by developing the novel and versatile methodology of unified neural partial delay differential equations. We augment existing/low-fidelity dynamical models directly in their partial differential equation (PDE) forms with both Markovian and non-Markovian neural network (NN) closure parameterizations. The melding of the existing models with NNs in the continuous spatiotemporal space followed by numerical discretization automatically allows for the desired generalizability. The Markovian term is designed to enable extraction of its analytical form and thus provides interpretability. The non-Markovian terms allow accounting for inherently missing time delays needed to represent the real world. Our flexible modeling framework provides full autonomy for the design of the unknown closure terms such as using any linear-, shallow-, or deep-NN architectures, selecting the span of the input function libraries, and using either or both Markovian and non-Markovian closure terms, all in accord with prior knowledge. We obtain adjoint PDEs in the continuous form, thus enabling direct implementation across differentiable and non-differentiable computational physics codes, different ML frameworks, and treatment of nonuniformly-spaced spatiotemporal training data. We demonstrate the new generalized neural closure models ( g nCMs) framework using four sets of experiments based on advecting nonlinear waves, shocks, and ocean acidification models. Our learned g nCMs discover missing physics, find leading numerical error terms, discriminate among candidate functional forms in an interpretable fashion, achieve generalization, and compensate for the lack of complexity in simpler models. Finally, we analyze the computational advantages of our new framework.

Evolutionary Neural Networks for Learning Turbulence Closure Models with Explicit Expressions

Turbulence Model Development based on a Novel Method Combining Gene Expression Programming with an Artificial Neural Network

Gradient Information and Regularization for Gene Expression Programming to Develop Data-Driven Physics Closure Models

A coupled framework for symbolic turbulence models from deep-learning

Multiphase turbulence modeling using sparse regression and gene expression programming

Generalized neural closure models with interpretability

Deep Structured Neural Networks for Turbulence Closure Modelling

Accelerating evolutionary exploration through language model-based transfer learning

Discovering explicit Reynolds-averaged turbulence closures for turbulent separated flows through deep learning-based symbolic regression with non-linear corrections

Neural Galerkin Schemes with Active Learning for High-Dimensional Evolution Equations

Computable Turbulence Modeling of Laminar-Turbulent Transition Characterized Boundary Layer Flows with the Aid of Artificial Neural Network

Turbulence closure for high Reynolds number airfoil flows by deep neural networks

A New Evolutionary System for Evolving Artificial Neural Networks

Generalizable data-driven turbulence closure modeling on unstructured grids with differentiable physics

Physical interpretation of neural network-based nonlinear eddy viscosity models

AutoTurb: Using Large Language Models for Automatic Algebraic Model Discovery of Turbulence Closure

Quantifying Model Uncertainty of Neural Network-based Turbulence Closures

A Physics-Informed Deep Learning Closure for Lagrangian Velocity Gradient Evolution

Neural Ideal Large Eddy Simulation: Modeling Turbulence with Neural Stochastic Differential Equations