Abstract:Data-based discovery of effective, coarse-grained (CG) models of high-dimensional dynamical systems presents a unique challenge in computational physics and particularly in the context of multiscale problems. The present paper offers a data-based, probabilistic perspective that enables the quantification of predictive uncertainties. One of the outstanding problems has been the introduction of physical constraints in the probabilistic machine learning objectives. The primary utility of such constraints stems from the undisputed physical laws such as conservation of mass, energy etc. that they represent. Furthermore and apart from leading to physically realistic predictions, they can significantly reduce the requisite amount of training data which for high-dimensional, multiscale systems are expensive to obtain (Small Data regime). We formulate the coarse-graining process by employing a probabilistic state-space model and account for the aforementioned equality constraints as virtual observables in the associated densities. We demonstrate how deep neural nets in combination with probabilistic inference tools can be employed to identify the coarse-grained variables and their evolution model without ever needing to define a fine-to-coarse (restriction) projection and without needing time-derivatives of state variables.We advocate a sparse Bayesian learning perspective which avoids overfitting and reveals the most salient features in the CG evolution law. The formulation adopted enables the quantification of a crucial, and often neglected, component in the CG process, i.e. the predictive uncertainty due to information loss. Furthermore, it is capable of reconstructing the evolution of the full, fine-scale system and therefore the observables of interest need not be selected a priori. We demonstrate the efficacy of the proposed framework by applying it to systems of interacting particles and a series of images of a nonlinear pendulum. In both cases we identify the underlying coarse dynamics and can generate extrapolative predictions including the forming and propagation of a shock for the particle systems and a stable trajectory in the phase space for the pendulum.

ATLAS: A geometric approach to learning high-dimensional stochastic systems near manifolds

Accurate macroscale modelling of spatial dynamics in multiple dimensions

Learning effective stochastic differential equations from microscopic simulations: combining stochastic numerics and deep learning

Coarse-scale PDEs from fine-scale observations via machine learning

Learning effective stochastic differential equations from microscopic simulations: Linking stochastic numerics to deep learning.

A micro/macro algorithm to accelerate Monte Carlo simulation of stochastic differential equations

Machine-learning-based dynamic-importance sampling for adaptive multiscale simulations

Linking Machine Learning with Multiscale Numerics: Data-Driven Discovery of Homogenized Equations

Efficiency of a micro-macro acceleration method for scale-separated stochastic differential equations

Micro-Macro Consistency in Multiscale Modeling: Score-Based Model Assisted Sampling of Fast/Slow Dynamical Systems

Learning Macroscopic Dynamics from Partial Microscopic Observations

Learning Algorithms for Coarsening Uncertainty Space and Applications to Multiscale Simulations

Learning macroscopic parameters in nonlinear multiscale simulations using nonlocal multicontinua upscaling techniques

Choose interelement coupling to preserve self-adjoint dynamics in multiscale modelling and computation

Concurrent multiscale simulations of nonlinear random materials using probabilistic learning

Multiscale Neural Operator: Learning Fast and Grid-independent PDE Solvers

GANs and Closures: Micro-Macro Consistency in Multiscale Modeling

Hitting the High-Dimensional Notes: An ODE for SGD learning dynamics on GLMs and multi-index models

Data-driven Effective Modeling of Multiscale Stochastic Dynamical Systems

Incorporating physical constraints in a deep probabilistic machine learning framework for coarse-graining dynamical systems