Abstract:In recent years, the researches about solving partial differential equations (PDEs) based on artificial neural network have attracted considerable attention. In these researches, the neural network models are usually designed depend on human experience or trial and error. Despite the emergence of several model searching methods, these methods primarily concentrate on optimizing the hyperparameters of fully connected neural network model based on the framework of physics-informed neural networks (PINNs), and the corresponding search spaces are relatively restricted, thereby limiting the exploration of superior models. This article proposes an evolutionary computation method aimed at discovering the PINNs model with higher approximation accuracy and faster convergence rate. In addition to searching the numbers of layers and neurons per hidden layer, this method concurrently explores the optimal shortcut connections between the layers and the novel parametric activation functions expressed by the binary trees. In evolution, the strategy about dynamic population size and training epochs (DPSTE) is adopted, which significantly increases the number of models to be explored and facilitates the discovery of models with fast convergence rate. In experiments, the performance of different models that are searched through Bayesian optimization, random search and evolution is compared in solving Klein-Gordon, Burgers, and Lamé equations. The experimental results affirm that the models discovered by the proposed evolutionary computation method generally exhibit superior approximation accuracy and convergence rate, and these models also show commendable generalization performance with respect to the source term, initial and boundary conditions, equation coefficient and computational domain. The corresponding code is available at

A Review of Neural Network Solvers for Second-order Boundary Value Problems

Solving Partial Differential Equations Using Deep Learning and Physical Constraints

Improved Deep Neural Networks with Domain Decomposition in Solving Partial Differential Equations

dNNsolve: an efficient NN-based PDE solver

Physics-Informed neural network solver for numerical analysis in geoengineering

PinnDE: Physics-Informed Neural Networks for Solving Differential Equations

A Survey on Solving and Discovering Differential Equations Using Deep Neural Networks

Physics Informed Neural Networks (PINNs) as intelligent computing technique for solving partial differential equations: Limitation and Future prospects

Solving Partial Differential Equations with Point Source Based on Physics-Informed Neural Networks

Operator Learning Enhanced Physics-informed Neural Networks for Solving Partial Differential Equations Characterized by Sharp Solutions

Discovering Physics-Informed Neural Networks Model for Solving Partial Differential Equations through Evolutionary Computation

Newton Informed Neural Operator for Computing Multiple Solutions of Nonlinear Partials Differential Equations

Semi-analytic PINN methods for singularly perturbed boundary value problems

Understanding the Difficulty of Solving Cauchy Problems with PINNs

Message Passing Neural PDE Solvers

Surrogate-Based Physics-Informed Neural Networks for Elliptic Partial Differential Equations

Semi-Implicit Neural Solver for Time-dependent Partial Differential Equations

The Old and the New: Can Physics-Informed Deep-Learning Replace Traditional Linear Solvers?

A Discussion on Solving Partial Differential Equations using Neural Networks

DeepXDE: A Deep Learning Library for Solving Differential Equations

Boussinesq Equation Solved by the Physics-Informed Neural Networks