Abstract:<p>In the last 50 years there has been a tremendous progress in solving numerically the Navier-Stokes equations using finite differences, finite elements, spectral, and even meshless methods. Yet, in many real cases, we still cannot incorporate seamlessly (multi-fidelity) data into existing algorithms, and for industrial-complexity applications the mesh generation is time consuming and still an art. Moreover, solving ill-posed problems (e.g., lacking boundary conditions) or inverse problems is often prohibitively expensive and requires different formulations and new computer codes. Here, we employ physics-informed neural networks (PINNs), encoding the governing equations directly into the deep neural network via automatic differentiation, to overcome some of the aforementioned limitations for simulating incompressible laminar and turbulent flows. We develop the Navier-Stokes flow nets (NSFnets) by considering two different mathematical formulations of the Navier-Stokes equations: the velocity-pressure (VP) formulation and the vorticity-velocity (VV) formulation. Since this is a new approach, we first select some standard benchmark problems to assess the accuracy, convergence rate, computational cost and flexibility of NSFnets; analytical solutions and direct numerical simulation (DNS) databases provide proper initial and boundary conditions for the NSFnet simulations. The spatial and temporal coordinates are the inputs of the NSFnets, while the instantaneous velocity and pressure fields are the outputs for the VP-NSFnet, and the instantaneous velocity and vorticity fields are the outputs for the VV-NSFnet. This is unsupervised learning and, hence, no labeled data are required beyond boundary and initial conditions and the fluid properties. The residuals of the VP or VV governing equations, together with the initial and boundary conditions, are embedded into the loss function of the NSFnets. No data is provided for the pressure to the VP-NSFnet, which is a hidden state and is obtained via the incompressibility constraint without extra computational cost. Unlike the traditional numerical methods, NSFnets inherit the properties of neural networks (NNs), hence the total error is composed of the approximation, the optimization, and the generalization errors. Here, we empirically attempt to quantify these errors by varying the sampling ("residual") points, the iterative solvers, and the size of the NN architecture. For the laminar flow solutions, we show that both the VP and the VV formulations are comparable in accuracy but their best performance corresponds to different NN architectures. The initial convergence rate is fast but the error eventually saturates to a plateau due to the dominance of the optimization error. For the turbulent channel flow, we show that NSFnets can sustain turbulence at <span class="math"><math>Reτ∼1,000</math></span>, but due to expensive training we only consider part of the channel domain and enforce velocity boundary conditions on the subdomain boundaries provided by the DNS data base. We also perform a systematic study on the weights used in the loss function for balancing the data and physics components, and investigate a new way of computing the weights dynamically to accelerate training and enhance accuracy. In the last part, we demonstrate how NSFnets should be used in practice, namely for ill-posed problems with incomplete or noisy boundary conditions as well as for inverse problems. We obtain reasonably accurate solutions for such cases as well without the need to change the NSFnets and at the same computational cost as in the forward well-posed problems. We also present a simple example of transfer learning that will aid in accelerating the training of NSFnets for different parameter settings.</p>

Neural Vortex Method: from Finite Lagrangian Particles to Infinite Dimensional Eulerian Dynamics

Vector Form of Intrinsic Finite Element Method for Incompressible Fluids

Deep Random Vortex Method for Simulation and Inference of Navier-Stokes Equations

Learning Vortex Dynamics for Fluid Inference and Prediction

Neural Networks-based Random Vortex Methods for Modelling Incompressible Flows

Reviving the Vortex Particle Method: A Stable Formulation for Meshless Large Eddy Simulation

An Eulerian Vortex Method on Flow Maps

Simulation of Hydrokinetic Turbines in Turbulent Flow Using Vortex Particle Methods

Deep Learning of Vortex Induced Vibrations

Monte Carlo Vortical Smoothed Particle Hydrodynamics for Simulating Turbulent Flows

DRVN (deep random vortex network): A new physics-informed machine learning method for simulating and inferring incompressible fluid flows

Application of A Vortex Method to Free-Surface Flows

NSFnets (Navier-Stokes flow nets): Physics-informed neural networks for the incompressible Navier-Stokes equations

AdvectiveNet: An Eulerian-Lagrangian Fluidic reservoir for Point Cloud Processing

An Accurate Vortex Feature Extraction Method for Lagrangian Vortex Visualization on High-Order Flow Field Data.

Teaching the Incompressible Navier-Stokes Equations to Fast Neural Surrogate Models in 3D

Solving Inverse Problems in Steady State Navier-Stokes Equations using Deep Neural Networks

Neural Network with Local Converging Input (NNLCI) for Supersonic Flow Problems with Unstructured Grids

Learning Incompressible Fluid Dynamics from Scratch -- Towards Fast, Differentiable Fluid Models that Generalize

Wall-Bounded Flow Simulation on Vortex Dynamics

Random vortex dynamics via functional stochastic differential equations