Abstract:Predicting the evolution of systems that exhibit spatio-temporal dynamics in response to external stimuli is a key enabling technology fostering scientific innovation. Traditional equations-based approaches leverage first principles to yield predictions through the numerical approximation of high-dimensional systems of differential equations, thus calling for large-scale parallel computing platforms and requiring large computational costs. Data-driven approaches, instead, enable the description of systems evolution in low-dimensional latent spaces, by leveraging dimensionality reduction and deep learning algorithms. We propose a novel architecture, named Latent Dynamics Network (LDNet), which is able to discover low-dimensional intrinsic dynamics of possibly non-Markovian dynamical systems, thus predicting the time evolution of space-dependent fields in response to external inputs. Unlike popular approaches, in which the latent representation of the solution manifold is learned by means of auto-encoders that map a high-dimensional discretization of the system state into itself, LDNets automatically discover a low-dimensional manifold while learning the latent dynamics, without ever operating in the high-dimensional space. Furthermore, LDNets are meshless algorithms that do not reconstruct the output on a predetermined grid of points, but rather at any point of the domain, thus enabling weight-sharing across query-points. These features make LDNets lightweight and easy-to-train, with excellent accuracy and generalization properties, even in time-extrapolation regimes. We validate our method on several test cases and we show that, for a challenging highly-nonlinear problem, LDNets outperform state-of-the-art methods in terms of accuracy (normalized error 5 times smaller), by employing a dramatically smaller number of trainable parameters (more than 10 times fewer).

Learning Latent Dynamics via Invariant Decomposition and (Spatio-)Temporal Transformers

Learning the intrinsic dynamics of spatio-temporal processes through Latent Dynamics Networks

Automated Global Analysis of Experimental Dynamics through Low-Dimensional Linear Embeddings

Extracting Interpretable Physical Parameters from Spatiotemporal Systems using Unsupervised Learning

Identifying latent state transition in non-linear dynamical systems

Learning Nonautonomous Systems via Dynamic Mode Decomposition

Dynamically Meaningful Latent Representations of Dynamical Systems

Smooth and Sparse Latent Dynamics in Operator Learning with Jerk Regularization

A Disentangled Recognition and Nonlinear Dynamics Model for Unsupervised Learning

Learning a Reduced Basis of Dynamical Systems using an Autoencoder

Decomposed Linear Dynamical Systems (dLDS) for learning the latent components of neural dynamics

Latent Dynamics Networks (LDNets): learning the intrinsic dynamics of spatio-temporal processes

Learning Slow and Fast System Dynamics Via Automatic Separation of Time Scales

Data-driven models of nonautonomous systems

Learning In-between Imagery Dynamics via Physical Latent Spaces

Capturing Actionable Dynamics with Structured Latent Ordinary Differential Equations

Learning deep dynamical models from image pixels

Invariant Neural Ordinary Differential Equations

Data-driven learning of non-autonomous systems

Deep multi-modal learning for joint linear representation of nonlinear dynamical systems