Abstract:Several forms for constructing novel physics-informed neural-networks (PINN) for the solution of partial-differential-algebraic equations based on derivative operator splitting are proposed, using the nonlinear Kirchhoff rod as a prototype for demonstration. The open-source DeepXDE is likely the most well documented framework with many examples. Yet, we encountered some pathological problems and proposed novel methods to resolve them. Among these novel methods are the PDE forms, which evolve from the lower-level form with fewer unknown dependent variables to higher-level form with more dependent variables, in addition to those from lower-level forms. Traditionally, the highest-level form, the balance-of-momenta form, is the starting point for (hand) deriving the lowest-level form through a tedious (and error prone) process of successive substitutions. The next step in a finite element method is to discretize the lowest-level form upon forming a weak form and linearization with appropriate interpolation functions, followed by their implementation in a code and testing. The time-consuming tedium in all of these steps could be bypassed by applying the proposed novel PINN directly to the highest-level form. We developed a script based on JAX. While our JAX script did not show the pathological problems of DDE-T (DDE with TensorFlow backend), it is slower than DDE-T. That DDE-T itself being more efficient in higher-level form than in lower-level form makes working directly with higher-level form even more attractive in addition to the advantages mentioned further above. Since coming up with an appropriate learning-rate schedule for a good solution is more art than science, we systematically codified in detail our experience running optimization through a normalization/standardization of the network-training process so readers can reproduce our results.

Runge-Kutta Physics Informed Neural Networks: Formulation and Analysis

On the Stability and Convergence of Physics Informed Neural Networks

Error estimation for physics-informed neural networks with implicit Runge-Kutta methods

Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations

A Physics Informed Neural Network for Time-Dependent Nonlinear and Higher Order Partial Differential Equations

Physics Informed Neural Network Framework for Unsteady Discretized Reduced Order System

Learning phase-space flows using time-discrete implicit Runge-Kutta PINNs

A Unified Framework for the Error Analysis of Physics-Informed Neural Networks

An Analysis of Physics-Informed Neural Networks

Physics-informed graph neural Galerkin networks: A unified framework for solving PDE-governed forward and inverse problems

Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equations

Stability Analysis of Physics-Informed Neural Networks for Stiff Linear Differential Equations

Advanced Physics-Informed Neural Networks for Numerical Approximation of the Coupled Schrödinger-Kdv Equation

Physics-Informed Neural Networks with Adaptive Localized Artificial Viscosity

General-Kindred Physics-Informed Neural Network to the Solutions of Singularly Perturbed Differential Equations

Characterizing and Mitigating the Difficulty in Training Physics-informed Artificial Neural Networks under Pointwise Constraints

Partial-differential-algebraic equations of nonlinear dynamics by Physics-Informed Neural-Network: (I) Operator splitting and framework assessment

Optimally weighted loss functions for solving PDEs with Neural Networks

Error Analysis of Physics-Informed Neural Networks for Approximating Dynamic PDEs of Second Order in Time

RPINNs: Rectified-physics informed neural networks for solving stationary partial differential equations

A two-stage physics-informed neural network method based on conserved quantities and applications in localized wave solutions