Abstract:Partial differential equations have a wide range of applications in modeling multiple physical, biological, or social phenomena. Therefore, we need to approximate the solutions of these equations in computationally feasible terms. Nowadays, among the most popular numerical methods for solving partial differential equations in engineering, we encounter the finite difference and finite element methods. An alternative numerical method that has recently gained popularity for numerically solving partial differential equations is the use of artificial neural networks. Artificial neural networks, or neural networks for short, are mathematical structures with universal approximation properties. In addition, thanks to the extraordinary computational development of the last decade, neural networks have become accessible and powerful numerical methods for engineers and researchers. For example, imaging and language processing are applications of neural networks today that show sublime performance inconceivable years ago. This dissertation contributes to the numerical solution of partial differential equations using neural networks with the following two-fold objective: investigate the behavior of neural networks as approximators of solutions of partial differential equations and propose neural-network-based methods for frameworks that are hardly addressable via traditional numerical methods. As novel neural-network-based proposals, we first present a method inspired by the finite element method when applying mesh refinements to solve parametric problems. Secondly, we propose a general residual minimization scheme based on a generalized version of the Ritz method. Finally, we develop a memory-based strategy to overcome a usual numerical integration limitation when using neural networks to solve partial differential equations.

Adversarial Sampling for Solving Differential Equations with Neural Networks

Solving partial differential equations with sampled neural networks

White-box Fairness Testing Through Adversarial Sampling

Adversarial Adaptive Sampling: Unify PINN and Optimal Transport for the Approximation of PDEs

An Adaptive Sampling Algorithm with Dynamic Iterative Probability Adjustment Incorporating Positional Information

Adaptive Sampling for Deep Learning via Efficient Nonparametric Proxies

Locally Regularized Neural Differential Equations: Some Black Boxes Were Meant to Remain Closed!

Adversarial Learning for Neural PDE Solvers with Sparse Data

Adaptive Sampling Points Based Multi-Scale Residual Network for Solving Partial Differential Equations

Improving Bayesian Neural Networks by Adversarial Sampling.

Automatic Differentiation is Essential in Training Neural Networks for Solving Differential Equations

Adaptive trajectories sampling for solving PDEs with deep learning methods

SA-Solver: Stochastic Adams Solver for Fast Sampling of Diffusion Models

Solutions to Elliptic and Parabolic Problems via Finite Difference Based Unsupervised Small Linear Convolutional Neural Networks

Solving Irregular and Data-enriched Differential Equations using Deep Neural Networks

A Natural Primal-Dual Hybrid Gradient Method for Adversarial Neural Network Training on Solving Partial Differential Equations

Opening the Blackbox: Accelerating Neural Differential Equations by Regularizing Internal Solver Heuristics

Scalable Gradients for Stochastic Differential Equations

Adversarial Sampling for Fairness Testing in Deep Neural Network

Learning Differential Equations that are Easy to Solve

Solving Partial Differential Equations Using Artificial Neural Networks