Abstract:The use of deep learning methods in scientific computing represents a potential paradigm shift in engineering problem solving. One of the most prominent developments is Physics-Informed Neural Networks (PINNs), in which neural networks are trained to satisfy partial differential equations (PDEs). While this method shows promise, the standard version has been shown to struggle in accurately predicting the dynamic behavior of time-dependent problems. To address this challenge, methods have been proposed that decompose the time domain into multiple segments, employing a distinct neural network in each segment and directly incorporating continuity between them in the loss function of the minimization problem. In this work we introduce a method to exactly enforce continuity between successive time segments via a solution ansatz. This hard constrained sequential PINN (HCS-PINN) method is simple to implement and eliminates the need for any loss terms associated with temporal continuity. The method is tested for a number of benchmark problems involving both linear and non-linear PDEs. Examples include various first order time dependent problems in which traditional PINNs struggle, namely advection, Allen-Cahn, and Korteweg-de Vries equations. Furthermore, second and third order time-dependent problems are demonstrated via wave and Jerky dynamics examples, respectively. Notably, the Jerky dynamics problem is chaotic, making the problem especially sensitive to temporal accuracy. The numerical experiments conducted with the proposed method demonstrated superior convergence and accuracy over both traditional PINNs and the soft-constrained counterparts.

Neural Integration of Continuous Dynamics

Neural Operator Learning for Long-Time Integration in Dynamical Systems with Recurrent Neural Networks

Systematic construction of continuous-time neural networks for linear dynamical systems

Discrete-time analogues of integrodifferential equations modeling neural networks

Integration of Continuous-Time Dynamics in a Spiking Neural Network Simulator

Neural Networks are Integrable

Newton-Cotes Graph Neural Networks: on the Time Evolution of Dynamic Systems

Learning Algorithm for Neural Networks Based upon Continuous-time System Simulation

A Continuous Time Dynamical Turing Machine

Neural Networks and Continuous Time

Dynamics of Continuous-Time Neural Networks and Their Discrete-Time Analogues with Distributed Delays

Long-time Integration of Nonlinear Wave Equations with Neural Operators

A tutorial on solving ordinary differential equations using Python and hybrid physics-informed neural network

Neural Dynamics on Complex Networks

Learning nonlinear integral operators via Recurrent Neural Networks and its application in solving Integro-Differential Equations

Neural-network-based decentralized control of continuous-time nonlinear interconnected systems with unknown dynamics

Some Theoretical Issues on Continuous Process Neural Networks

Exact Enforcement of Temporal Continuity in Sequential Physics-Informed Neural Networks

Two Neural Dynamics Approaches for Computing System of Time-Varying Nonlinear Equations