Abstract:Data-based discovery of effective, coarse-grained (CG) models of high-dimensional dynamical systems presents a unique challenge in computational physics and particularly in the context of multiscale problems. The present paper offers a data-based, probabilistic perspective that enables the quantification of predictive uncertainties. One of the outstanding problems has been the introduction of physical constraints in the probabilistic machine learning objectives. The primary utility of such constraints stems from the undisputed physical laws such as conservation of mass, energy etc. that they represent. Furthermore and apart from leading to physically realistic predictions, they can significantly reduce the requisite amount of training data which for high-dimensional, multiscale systems are expensive to obtain (Small Data regime). We formulate the coarse-graining process by employing a probabilistic state-space model and account for the aforementioned equality constraints as virtual observables in the associated densities. We demonstrate how deep neural nets in combination with probabilistic inference tools can be employed to identify the coarse-grained variables and their evolution model without ever needing to define a fine-to-coarse (restriction) projection and without needing time-derivatives of state variables.We advocate a sparse Bayesian learning perspective which avoids overfitting and reveals the most salient features in the CG evolution law. The formulation adopted enables the quantification of a crucial, and often neglected, component in the CG process, i.e. the predictive uncertainty due to information loss. Furthermore, it is capable of reconstructing the evolution of the full, fine-scale system and therefore the observables of interest need not be selected a priori. We demonstrate the efficacy of the proposed framework by applying it to systems of interacting particles and a series of images of a nonlinear pendulum. In both cases we identify the underlying coarse dynamics and can generate extrapolative predictions including the forming and propagation of a shock for the particle systems and a stable trajectory in the phase space for the pendulum.

Generative learning for forecasting the dynamics of high-dimensional complex systems

Generative Learning for Forecasting the Dynamics of Complex Systems

Generative Learning of the Solution of Parametric Partial Differential Equations Using Guided Diffusion Models and Virtual Observations

Unfolding Time: Generative Modeling for Turbulent Flows in 4D

Active Learning for Modeling and Prediction of Dynamical Fluid Processes

Adaptive learning of effective dynamics: Adaptive real-time, online modeling for complex systems

Generative learning for nonlinear dynamics

Interpretable learning of effective dynamics for multiscale systems

Deep learning of dynamic subsurface flow via theory-guided generative adversarial network

Generative Ensemble Regression: Learning Particle Dynamics from Observations of Ensembles with Physics-informed Deep Generative Models

Incorporating physical constraints in a deep probabilistic machine learning framework for coarse-graining dynamical systems

Learning Controllable Adaptive Simulation for Multi-resolution Physics

Unifying Predictions of Deterministic and Stochastic Physics in Mesh-reduced Space with Sequential Flow Generative Model

Learning to Accelerate Partial Differential Equations via Latent Global Evolution

From Zero to Turbulence: Generative Modeling for 3D Flow Simulation

Towards complex dynamic physics system simulation with graph neural ordinary equations

Physics-aware, probabilistic model order reduction with guaranteed stability

Data-driven Modeling of Parameterized Nonlinear Fluid Dynamical Systems with a Dynamics-embedded Conditional Generative Adversarial Network

Bayesian Conditional Diffusion Models for Versatile Spatiotemporal Turbulence Generation

Deep Learning Convective Flow Using Conditional Generative Adversarial Networks