Abstract:Proceedings of the Institution of Mechanical Engineers, Part M: Journal of Engineering for the Maritime Environment, Ahead of Print. Physics Informed Neural Networks (PINN), a deep learning tool, has recently become an effective method for solving inverse Partial Differential Equations (PDEs) where the boundary/initial conditions are not well defined and only noisy sparse measurements sampled in the domain exist. PINN, and other Neural Networks, tends to converge to the low frequency solution in a field that has multiple frequency scales, this is known as spectral bias. For PINN this happens when solving PDEs that exhibit periodic behavior spatially and temporally with multi frequency scales. Previous studies suggested that Fourier Features-Neural Networks (FF-NN) can be used to overcome the spectral bias problem. They proposed the Multi Scale-Spatio Temporal-Fourier Features-Physics Informed Neural Networks (MS-ST-FF-PINN) to overcome the spectral bias problem in PDEs solved by PINN. This has been evaluated on basic PDEs such as Poisson, wave and Gray-Scott equations. In this paper we take MS-ST-FF-PINN a step further by applying it to the incompressible Navier-Stokes equations. Furthermore, a comparative analysis between the PINN and the MS-ST-FF-PINN architectures solution accuracy, the learnt frequency components and the rate of convergence to the correct solution is included. To show this three test cases are shown (a)-Forward time independent double-lid-driven cavity, (b)-Inverse time independent free surface estimation of Kelvin wave pattern, and (c)-Inverse 2D time-dependent turbulent Von Karman vortex shedding interaction downstream of multiple cylinders. The results show that MS-ST-FF-PINN is better at learning low and high frequency components synchronously at early training iterations compared to the PINN architecture that does not learn the high frequency components even after multiple iteration numbers such as the Kelvin wave pattern and the Karman vortex shedding cases. However, for the third test case, the MS-ST-FF-PINN architecture showed a discontinuity for the temporal prediction of the pressure field due to over-fitting.

Solving elastodynamics via physics-informed neural network frequency domain method

Physics-Informed Neural Networks for Solving 2-D Magnetostatic Fields

Physics informed deep learning for computational elastodynamics without labeled data

Solving a class of multi-scale elliptic PDEs by means of Fourier-based mixed physics informed neural networks

On the use of Fourier Features-Physics Informed Neural Networks (FF-PINN) for forward and inverse fluid mechanics problems

Diminishing Spectral Bias in Physics-Informed Neural Networks Using Spatially-Adaptive Fourier Feature Encoding

Practical Aspects of Physics-Informed Neural Networks Applied to Solve Frequency-Domain Acoustic Wave Forward Problem

Solving Partial Differential Equations with Point Source Based on Physics-Informed Neural Networks

Finite element-integrated neural network framework for elastic and elastoplastic solids

Physics-informed Neural Networks (PINN) for computational solid mechanics: Numerical frameworks and applications

Hybrid Finite Difference with the Physics-informed Neural Network for solving PDE in complex geometries

Physics-informed Neural Networks with Fourier Features for Seismic Wavefield Simulation in Time-Domain Nonsmooth Complex Media

Finite-PINN: A Physics-Informed Neural Network Architecture for Solving Solid Mechanics Problems with General Geometries

Modeling multisource multifrequency acoustic wavefields by a multiscale Fourier feature physics-informed neural network with adaptive activation functions

Physical informed neural networks with soft and hard boundary constraints for solving advection-diffusion equations using Fourier expansions

AT-PINN: Advanced time-marching physics-informed neural network for structural vibration analysis

Frequency-compensated PINNs for Fluid-dynamic Design Problems

Fourier warm start for physics-informed neural networks

A Physics-Informed Neural Network for Simulation of Finite Deformation in Hyperelastic-Magnetic Coupling Problems

Spectrally Adapted Physics-Informed Neural Networks for Solving Unbounded Domain Problems