Abstract:Predicting the evolution of systems that exhibit spatio-temporal dynamics in response to external stimuli is a key enabling technology fostering scientific innovation. Traditional equations-based approaches leverage first principles to yield predictions through the numerical approximation of high-dimensional systems of differential equations, thus calling for large-scale parallel computing platforms and requiring large computational costs. Data-driven approaches, instead, enable the description of systems evolution in low-dimensional latent spaces, by leveraging dimensionality reduction and deep learning algorithms. We propose a novel architecture, named Latent Dynamics Network (LDNet), which is able to discover low-dimensional intrinsic dynamics of possibly non-Markovian dynamical systems, thus predicting the time evolution of space-dependent fields in response to external inputs. Unlike popular approaches, in which the latent representation of the solution manifold is learned by means of auto-encoders that map a high-dimensional discretization of the system state into itself, LDNets automatically discover a low-dimensional manifold while learning the latent dynamics, without ever operating in the high-dimensional space. Furthermore, LDNets are meshless algorithms that do not reconstruct the output on a predetermined grid of points, but rather at any point of the domain, thus enabling weight-sharing across query-points. These features make LDNets lightweight and easy-to-train, with excellent accuracy and generalization properties, even in time-extrapolation regimes. We validate our method on several test cases and we show that, for a challenging highly-nonlinear problem, LDNets outperform state-of-the-art methods in terms of accuracy (normalized error 5 times smaller), by employing a dramatically smaller number of trainable parameters (more than 10 times fewer).

Data-driven learning of chaotic dynamical systems using Discrete-Temporal Sobolev Networks

A TCN-Linear Hybrid Model for Chaotic Time Series Forecasting

Reconstruction, forecasting, and stability of chaotic dynamics from partial data

Learning Chaotic Dynamics with Embedded Dissipativity

Improved deep learning of chaotic dynamical systems with multistep penalty losses

Divide And Conquer: Learning Chaotic Dynamical Systems With Multistep Penalty Neural Ordinary Differential Equations

Latent Dynamics Networks (LDNets): learning the intrinsic dynamics of spatio-temporal processes

Learning the intrinsic dynamics of spatio-temporal processes through Latent Dynamics Networks

Exploiting Chaotic Dynamics as Deep Neural Networks

Deep learning algorithm for data-driven simulation of noisy dynamical system

High-efficiency Chaotic Time Series Prediction Based on Time Convolution Neural Network

Entanglement-Embedded Recurrent Network Architecture: Tensorized Latent State Propagation and Chaos Forecasting

TSONN: Time-stepping-oriented neural network for solving partial differential equations

Can neural networks predict dynamics they have never seen?

Constraining Chaos: Enforcing dynamical invariants in the training of recurrent neural networks

Long-term Time Series Forecasting based on Decomposition and Neural Ordinary Differential Equations

SineNet: Learning Temporal Dynamics in Time-Dependent Partial Differential Equations

Training neural operators to preserve invariant measures of chaotic attractors

Learning without Data: Physics-Informed Neural Networks for Fast Time-Domain Simulation

Interpretable predictions of chaotic dynamical systems using dynamical system deep learning

Physics-Constrained Taylor Neural Networks for Learning and Control of Dynamical Systems