Abstract:Predicting the evolution of systems that exhibit spatio-temporal dynamics in response to external stimuli is a key enabling technology fostering scientific innovation. Traditional equations-based approaches leverage first principles to yield predictions through the numerical approximation of high-dimensional systems of differential equations, thus calling for large-scale parallel computing platforms and requiring large computational costs. Data-driven approaches, instead, enable the description of systems evolution in low-dimensional latent spaces, by leveraging dimensionality reduction and deep learning algorithms. We propose a novel architecture, named Latent Dynamics Network (LDNet), which is able to discover low-dimensional intrinsic dynamics of possibly non-Markovian dynamical systems, thus predicting the time evolution of space-dependent fields in response to external inputs. Unlike popular approaches, in which the latent representation of the solution manifold is learned by means of auto-encoders that map a high-dimensional discretization of the system state into itself, LDNets automatically discover a low-dimensional manifold while learning the latent dynamics, without ever operating in the high-dimensional space. Furthermore, LDNets are meshless algorithms that do not reconstruct the output on a predetermined grid of points, but rather at any point of the domain, thus enabling weight-sharing across query-points. These features make LDNets lightweight and easy-to-train, with excellent accuracy and generalization properties, even in time-extrapolation regimes. We validate our method on several test cases and we show that, for a challenging highly-nonlinear problem, LDNets outperform state-of-the-art methods in terms of accuracy (normalized error 5 times smaller), by employing a dramatically smaller number of trainable parameters (more than 10 times fewer).

Learning in latent spaces improves the predictive accuracy of deep neural operators

Learning nonlinear operators in latent spaces for real-time predictions of complex dynamics in physical systems

Diffeomorphic Latent Neural Operators for Data-Efficient Learning of Solutions to Partial Differential Equations

Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators

Improved architectures and training algorithms for deep operator networks

Latent Neural Operator for Solving Forward and Inverse PDE Problems

Optimal deep learning of holomorphic operators between Banach spaces

Latent Neural PDE Solver: a reduced-order modelling framework for partial differential equations

Physics-Informed Deep Neural Operator Networks

Latent Neural Operator Pretraining for Solving Time-Dependent PDEs

Latent Dynamics Networks (LDNets): learning the intrinsic dynamics of spatio-temporal processes

Separable DeepONet: Breaking the Curse of Dimensionality in Physics-Informed Machine Learning

Improved generalization with deep neural operators for engineering systems: Path towards digital twin

Solving High-Dimensional PDEs with Latent Spectral Models

Learning Partial Differential Equations with Deep Parallel Neural Operator

Deep Operator Learning Lessens the Curse of Dimensionality for PDEs

Sequential Deep Operator Networks (S-DeepONet) for predicting full-field solutions under time-dependent loads

Derivative-enhanced Deep Operator Network

Smooth and Sparse Latent Dynamics in Operator Learning with Jerk Regularization

Reliable extrapolation of deep neural operators informed by physics or sparse observations