Abstract:Partial differential equations have a wide range of applications in modeling multiple physical, biological, or social phenomena. Therefore, we need to approximate the solutions of these equations in computationally feasible terms. Nowadays, among the most popular numerical methods for solving partial differential equations in engineering, we encounter the finite difference and finite element methods. An alternative numerical method that has recently gained popularity for numerically solving partial differential equations is the use of artificial neural networks. Artificial neural networks, or neural networks for short, are mathematical structures with universal approximation properties. In addition, thanks to the extraordinary computational development of the last decade, neural networks have become accessible and powerful numerical methods for engineers and researchers. For example, imaging and language processing are applications of neural networks today that show sublime performance inconceivable years ago. This dissertation contributes to the numerical solution of partial differential equations using neural networks with the following two-fold objective: investigate the behavior of neural networks as approximators of solutions of partial differential equations and propose neural-network-based methods for frameworks that are hardly addressable via traditional numerical methods. As novel neural-network-based proposals, we first present a method inspired by the finite element method when applying mesh refinements to solve parametric problems. Secondly, we propose a general residual minimization scheme based on a generalized version of the Ritz method. Finally, we develop a memory-based strategy to overcome a usual numerical integration limitation when using neural networks to solve partial differential equations.

Some observations on partial differential equations in Barron and multi-layer spaces

Some observations on high-dimensional partial differential equations with Barron data

Representation Formulas and Pointwise Properties for Barron Functions

Solving parametric PDE problems with artificial neural networks

The Barron Space and the Flow-Induced Function Spaces for Neural Network Models

Two-Layer Neural Networks for Partial Differential Equations: Optimization and Generalization Theory

Overcoming the curse of dimensionality for some Hamilton--Jacobi partial differential equations via neural network architectures

Two-layers neural networks for Schr{ö}dinger eigenvalue problems

Three ways to solve partial differential equations with neural networks — A review

Application of multivariate bilinear neural network method to fractional partial differential equations

Solving Partial Differential Equations Using Artificial Neural Networks

On the approximation of the solution of partial differential equations by artificial neural networks trained by a multilevel Levenberg-Marquardt method

A Priori Estimation of the Approximation, Optimization and Generalization Errors of Random Neural Networks for Solving Partial Differential Equations

Partial Differential Equations is All You Need for Generating Neural Architectures -- A Theory for Physical Artificial Intelligence Systems

Embedding Inequalities for Barron-type Spaces

Embeddings between Barron spaces with higher order activation functions

A Mathematical Analysis of Neural Operator Behaviors

Neural Operator: Graph Kernel Network for Partial Differential Equations

Two-scale Neural Networks for Partial Differential Equations with Small Parameters

Multilevel Monte Carlo methods for simulating forward-backward stochastic differential equations using neural networks

Solving the Poisson Equation with Dirichlet data by shallow ReLU$^α$-networks: A regularity and approximation perspective