Abstract:Deep neural networks (DNNs) recently emerged as a promising tool for analyzing and solving complex differential equations arising in science and engineering applications. Alternative to traditional numerical schemes, learning-based solvers utilize the representation power of DNNs to approximate the input-output relations in an automated manner. However, the lack of physics-in-the-loop often makes it difficult to construct a neural network solver that simultaneously achieves high accuracy, low computational burden, and interpretability. In this work, focusing on a class of evolutionary PDEs characterized by decomposable operators, we show that the classical "operator splitting" technique can be adapted to design neural network architectures. This gives rise to a learning-based PDE solver, which we name Deep Operator-Splitting Network (DOSnet). Such non-black-box network design is constructed from the physical rules and operators governing the underlying dynamics, and is more efficient and flexible than the classical numerical schemes and standard DNNs. To demonstrate the advantages of our new AI-enhanced PDE solver, we train and validate it on several types of operator-decomposable differential equations. We also apply DOSnet to nonlinear Schrödinger equations which have important applications in the signal processing for modern optical fiber transmission systems, and experimental results show that our model has better accuracy and lower computational complexity than numerical schemes and the baseline DNNs.

Learning Topological Horseshoe via Deep Neural Networks

New Topological Horseshoe in the Chen System

Deep Neural Network Modeling of Unknown Partial Differential Equations in Nodal Space

A Differential Topological View of Challenges in Learning with Feedforward Neural Networks.

A Comprehensive Review of Deep Neural Network Interpretation Using Topological Data Analysis

Functional Loops: Monitoring Functional Organization of Deep Neural Networks Using Algebraic Topology

Neural Dynamics on Complex Networks

Topological Horseshoe in Nonlinear Bloch System

Understanding Deep Neural Networks Using Topological Data Analysis

The advance of neural ordinary differential ordinary differential equations

Topological learning in multiclass data sets

Solving a Class of High-Order Elliptic PDEs Using Deep Neural Networks Based on Its Coupled Scheme

Data-driven learning of chaotic dynamical systems using Discrete-Temporal Sobolev Networks

Deep Neural Network Solutions for Oscillatory Fredholm Integral Equations

Solving Irregular and Data-enriched Differential Equations using Deep Neural Networks

Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators

TO‐NODE: Topology optimization with neural ordinary differential equation

TSONN: Time-stepping-oriented neural network for solving partial differential equations

Dynamical systems' based neural networks

DOSnet as a Non-Black-Box PDE Solver: When Deep Learning Meets Operator Splitting

A Survey on Solving and Discovering Differential Equations Using Deep Neural Networks