Abstract:In this paper, we present an initial attempt to learn evolution PDEs from data. Inspired by the latest development of neural network designs in deep learning, we propose a new feed-forward deep network, called PDE-Net, to fulfill two objectives at the same time: to accurately predict dynamics of complex systems and to uncover the underlying hidden PDE models. The basic idea of the proposed PDE-Net is to learn differential operators by learning convolution kernels (filters), and apply neural networks or other machine learning methods to approximate the unknown nonlinear responses. Comparing with existing approaches, which either assume the form of the nonlinear response is known or fix certain finite difference approximations of differential operators, our approach has the most flexibility by learning both differential operators and the nonlinear responses. A special feature of the proposed PDE-Net is that all filters are properly constrained, which enables us to easily identify the governing PDE models while still maintaining the expressive and predictive power of the network. These constrains are carefully designed by fully exploiting the relation between the orders of differential operators and the orders of sum rules of filters (an important concept originated from wavelet theory). We also discuss relations of the PDE-Net with some existing networks in computer vision such as Network-In-Network (NIN) and Residual Neural Network (ResNet). Numerical experiments show that the PDE-Net has the potential to uncover the hidden PDE of the observed dynamics, and predict the dynamical behavior for a relatively long time, even in a noisy environment.

A Perception Evolution Network for Unsupervised Fast Incremental Learning

Perception Evolution Network Adapting to the Emergence of New Sensory Receptor

A Bio-Inspired Incremental Learning Architecture for Applied Perceptual Problems

Self-Organizing Pathway Expansion for Non-Exemplar Class-Incremental Learning

A Self-Structurizing Neural Network for Online Incremental Learning

An Incremental Neural Network for Online Supervised Learning and Topology Learning

An Incremental Neural Network for Non-stationary Unsupervised Learning

EPNE: Evolutionary Pattern Preserving Network Embedding.

PEN4Rec: Preference Evolution Networks for Session-based Recommendation

A Pseudoinverse Incremental Algorithm For Fast Training Deep Neural Networks With Application To Spectra Pattern Recognition

Incremental Learning In Online Scenario

An Incremental Network for On-Line Unsupervised Classification and Topology Learning.

An enhanced self-organizing incremental neural network for online unsupervised learning.

An Incremental Deep Learning Network For On-Line Unsupervised Feature Extraction

Perception Coordination Network: A Framework for Online Multi-Modal Concept Acquisition and Binding

PDE-Net: Learning PDEs from Data

Self-Organizing Incremental Neural Network And Its Application

Perception Coordination Network: A Neuro Framework for Multimodal Concept Acquisition and Binding.

PENet: Pre-Enhanced Network for Object Detection and Instance Segmentation

Class incremental learning with self-supervised pre-training and prototype learning

Fast Learning Network with Parallel Layer Perceptrons