Abstract:Simulating the time evolution of Partial Differential Equations (PDEs) of large-scale systems is crucial in many scientific and engineering domains such as fluid dynamics, weather forecasting and their inverse optimization problems. However, both classical solvers and recent deep learning-based surrogate models are typically extremely computationally intensive, because of their local evolution: they need to update the state of each discretized cell at each time step during inference. Here we develop Latent Evolution of PDEs (LE-PDE), a simple, fast and scalable method to accelerate the simulation and inverse optimization of PDEs. LE-PDE learns a compact, global representation of the system and efficiently evolves it fully in the latent space with learned latent evolution models. LE-PDE achieves speed-up by having a much smaller latent dimension to update during long rollout as compared to updating in the input space. We introduce new learning objectives to effectively learn such latent dynamics to ensure long-term stability. We further introduce techniques for speeding-up inverse optimization of boundary conditions for PDEs via backpropagation through time in latent space, and an annealing technique to address the non-differentiability and sparse interaction of boundary conditions. We test our method in a 1D benchmark of nonlinear PDEs, 2D Navier-Stokes flows into turbulent phase and an inverse optimization of boundary conditions in 2D Navier-Stokes flow. Compared to state-of-the-art deep learning-based surrogate models and other strong baselines, we demonstrate up to 128x reduction in the dimensions to update, and up to 15x improvement in speed, while achieving competitive accuracy.

Weak-PDE-LEARN: A weak form based approach to discovering PDEs from noisy, limited data

PDE-LEARN: Using deep learning to discover partial differential equations from noisy, limited data

DL-PDE: Deep-learning based data-driven discovery of partial differential equations from discrete and noisy data

PDE-READ: Human-readable partial differential equation discovery using deep learning

Machine Learning of Partial Differential Equations from Noise Data

Learning Partial Differential Equations from Data Using Neural Networks

Deep-learning based discovery of partial differential equations in integral form from sparse and noisy data

PDE-Net: Learning PDEs from Data

Discovering Nonlinear PDEs from Scarce Data with Physics-encoded Learning

Physics-constrained robust learning of open-form partial differential equations from limited and noisy data

Identification of Partial Differential Equations from Noisy Data with Integrated Knowledge Discovery and Embedding Using Evolutionary Neural Networks

Noise-aware Physics-informed Machine Learning for Robust PDE Discovery

Robust data-driven discovery of governing physical laws with error bars

Robust discovery of partial differential equations in complex situations

Robust Low-Rank Discovery of Data-Driven Partial Differential Equations.

Deep-learning of parametric partial differential equations from sparse and noisy data

Physics-Guided Discovery of Highly Nonlinear Parametric Partial Differential Equations

PDE-Net 2.0: Learning PDEs from Data with A Numeric-Symbolic Hybrid Deep Network

Learning to Accelerate Partial Differential Equations via Latent Global Evolution

DISCOVER: Deep identification of symbolically concise open-form PDEs via enhanced reinforcement-learning