Abstract:Partial differential equations have a wide range of applications in modeling multiple physical, biological, or social phenomena. Therefore, we need to approximate the solutions of these equations in computationally feasible terms. Nowadays, among the most popular numerical methods for solving partial differential equations in engineering, we encounter the finite difference and finite element methods. An alternative numerical method that has recently gained popularity for numerically solving partial differential equations is the use of artificial neural networks. Artificial neural networks, or neural networks for short, are mathematical structures with universal approximation properties. In addition, thanks to the extraordinary computational development of the last decade, neural networks have become accessible and powerful numerical methods for engineers and researchers. For example, imaging and language processing are applications of neural networks today that show sublime performance inconceivable years ago. This dissertation contributes to the numerical solution of partial differential equations using neural networks with the following two-fold objective: investigate the behavior of neural networks as approximators of solutions of partial differential equations and propose neural-network-based methods for frameworks that are hardly addressable via traditional numerical methods. As novel neural-network-based proposals, we first present a method inspired by the finite element method when applying mesh refinements to solve parametric problems. Secondly, we propose a general residual minimization scheme based on a generalized version of the Ritz method. Finally, we develop a memory-based strategy to overcome a usual numerical integration limitation when using neural networks to solve partial differential equations.

Fast Iterative Solver For Neural Network Method: I. 1D Diffusion Problems

Fast Iterative Solver For Neural Network Method: II. 1D Diffusion-Reaction Problems And Data Fitting

Fast Neural Network based Solving of Partial Differential Equations

A fast algorithm for solving large scale nonlinear optimization problems using RNN

Solving high-dimensional eigenvalue problems using deep neural networks: A diffusion Monte Carlo like approach

Neural-Network-Assisted Finite Difference Discretization for Numerical Solution of Partial Differential Equations

A Deep Double Ritz Method (D$^2$RM) for solving Partial Differential Equations using Neural Networks

A Stable and Scalable Method for Solving Initial Value PDEs with Neural Networks

Semi-Implicit Neural Solver for Time-dependent Partial Differential Equations

A Neural Network-Based Poisson Solver for Fluid Simulation

A fast method for solving time-dependent nonlinear convection diffusion problems

A randomized Newton's method for solving differential equations based on the neural network discretization

A Poisson’s Equation Solver Based on Neural Network Precondtioned CG Method

Gauss Newton Method for Solving Variational Problems of PDEs with Neural Network Discretizaitons

Solving Inverse Problems in Steady State Navier-Stokes Equations using Deep Neural Networks

The Deep Ritz Method: A Deep Learning-Based Numerical Algorithm for Solving Variational Problems

Non-diffusive neural network method for hyperbolic conservation laws

A Natural Deep Ritz Method for Essential Boundary Value Problems

Solving Partial Differential Equations Using Artificial Neural Networks

Deep FBSDE Neural Networks for Solving Incompressible Navier-Stokes Equation and Cahn-Hilliard Equation