Abstract:Partial differential equations (PDEs) play a crucial role in studying a vast number of problems in science and engineering. Numerically solving nonlinear and/or high-dimensional PDEs is frequently a challenging task. Inspired by the traditional finite difference and finite elements methods and emerging advancements in machine learning, we propose a sequence-to-sequence learning (Seq2Seq) framework called Neural-PDE, which allows one to automatically learn governing rules of any time-dependent PDE system from existing data by using a bidirectional LSTM encoder, and predict the solutions in next n time steps. One critical feature of our proposed framework is that the Neural-PDE is able to simultaneously learn and simulate all variables of interest in a PDE system. We test the Neural-PDE by a range of examples, from one-dimensional PDEs to a multi-dimensional and nonlinear complex fluids model. The results show that the Neural-PDE is capable of learning the initial conditions, boundary conditions and differential operators defining the initial-boundary-value problem of a PDE system without the knowledge of the specific form of the PDE system. In our experiments, the Neural-PDE can efficiently extract the dynamics within 20 epochs training and produce accurate predictions. Furthermore, unlike the traditional machine learning approaches for learning PDEs, such as CNN and MLP, which require great quantity of parameters for model precision, the Neural-PDE shares parameters among all time steps, and thus considerably reduces computational complexity and leads to a fast learning algorithm.

Tensorized Timeline Alignment for Neural Dynamical Systems in Irregularly Sampled Time Series Prediction

Time-aware neural ordinary differential equations for incomplete time series modeling

Explainable Tensorized Neural Ordinary Differential Equations for Arbitrary-step Time Series Prediction

Tensor Neural Controlled Differential Equations

Explainable Tensorized Neural Ordinary Differential Equations forArbitrary-step Time Series Prediction

Neural Continuous-Discrete State Space Models for Irregularly-Sampled Time Series

Neural Controlled Differential Equations for Irregular Time Series

DualDynamics: Synergizing Implicit and Explicit Methods for Robust Irregular Time Series Analysis

TE-ESN: Time Encoding Echo State Network for Prediction Based on Irregularly Sampled Time Series Data.

Stable Neural Stochastic Differential Equations in Analyzing Irregular Time Series Data

Neural Chronos ODE: Unveiling Temporal Patterns and Forecasting Future and Past Trends in Time Series Data

TSINR: Capturing Temporal Continuity via Implicit Neural Representations for Time Series Anomaly Detection

Time Dependence in Non-Autonomous Neural ODEs

High-efficiency Chaotic Time Series Prediction Based on Time Convolution Neural Network

Invariant Neural Ordinary Differential Equations

Neural Differential Recurrent Neural Network with Adaptive Time Steps

AdaRNN: Adaptive Learning and Forecasting of Time Series

A TCN-Linear Hybrid Model for Chaotic Time Series Forecasting

The Disappearance of Timestep Embedding in Modern Time-Dependent Neural Networks

PDETime: Rethinking Long-Term Multivariate Time Series Forecasting from the Perspective of Partial Differential Equations

Neural-PDE: a RNN Based Neural Network for Solving Time Dependent PDEs