Abstract:Throughout many fields, practitioners often rely on differential equations to model systems. Yet, for many applications, the theoretical derivation of such equations and/or accurate resolution of their solutions may be intractable. Instead, recently developed methods, including those based on parameter estimation, operator subset selection, and neural networks, allow for the data-driven discovery of both ordinary and partial differential equations (PDEs), on a spectrum of interpretability. The success of these strategies is often contingent upon the correct identification of representative equations from noisy observations of state variables and, as importantly and intertwined with that, the mathematical strategies utilized to enforce those equations. Specifically, the latter has been commonly addressed via unconstrained optimization strategies. Representing the PDE as a neural network, we propose to discover the PDE by solving a constrained optimization problem and using an intermediate state representation similar to a Physics-Informed Neural Network (PINN). The objective function of this constrained optimization problem promotes matching the data, while the constraints require that the PDE is satisfied at several spatial collocation points. We present a penalty method and a widely used trust-region barrier method to solve this constrained optimization problem, and we compare these methods on numerical examples. Our results on the Burgers' and the Korteweg-De Vreis equations demonstrate that the latter constrained method outperforms the penalty method, particularly for higher noise levels or fewer collocation points. For both methods, we solve these discovered neural network PDEs with classical methods, such as finite difference methods, as opposed to PINNs-type methods relying on automatic differentiation. We briefly highlight other small, yet crucial, implementation details.

Data-driven Recovery of PDE Models and Unveiling of Solution Interconnections

Deep-learning of parametric partial differential equations from sparse and noisy data

DL-PDE: Deep-learning based data-driven discovery of partial differential equations from discrete and noisy data

Deep-learning based discovery of partial differential equations in integral form from sparse and noisy data

Solving Partial Differential Equations Using Deep Learning and Physical Constraints

Methods to Recover Unknown Processes in Partial Differential Equations Using Data

Data Generation-based Operator Learning for Solving Partial Differential Equations on Unbounded Domains

Constrained or Unconstrained? Neural-Network-Based Equation Discovery from Data

An improved data-free surrogate model for solving partial differential equations using deep neural networks

DLGA-PDE: Discovery of PDEs with incomplete candidate library via combination of deep learning and genetic algorithm

Solving Inverse Problems in Steady State Navier-Stokes Equations using Deep Neural Networks

Solving Irregular and Data-enriched Differential Equations using Deep Neural Networks

Numerical solution for high-dimensional partial differential equations based on deep learning with residual learning and data-driven learning

The Neural Network Approach to Inverse Problems in Differential Equations

Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations

Recovering missing CFD data for high-order discretizations using deep neural networks and dynamics learning

Data-Guided Physics-Informed Neural Networks for Solving Inverse Problems in Partial Differential Equations

An Efficient Method for Solving Two-Dimensional Partial Differential Equations with the Deep Operator Network

Learning Partial Differential Equations from Data Using Neural Networks

Multi-Grade Deep Learning for Partial Differential Equations with Applications to the Burgers Equation

Solving High-Dimensional Partial Differential Equations Using Tensor Neural Network and A Posteriori Error Estimators