Abstract:Data-based discovery of effective, coarse-grained (CG) models of high-dimensional dynamical systems presents a unique challenge in computational physics and particularly in the context of multiscale problems. The present paper offers a data-based, probabilistic perspective that enables the quantification of predictive uncertainties. One of the outstanding problems has been the introduction of physical constraints in the probabilistic machine learning objectives. The primary utility of such constraints stems from the undisputed physical laws such as conservation of mass, energy etc. that they represent. Furthermore and apart from leading to physically realistic predictions, they can significantly reduce the requisite amount of training data which for high-dimensional, multiscale systems are expensive to obtain (Small Data regime). We formulate the coarse-graining process by employing a probabilistic state-space model and account for the aforementioned equality constraints as virtual observables in the associated densities. We demonstrate how deep neural nets in combination with probabilistic inference tools can be employed to identify the coarse-grained variables and their evolution model without ever needing to define a fine-to-coarse (restriction) projection and without needing time-derivatives of state variables.We advocate a sparse Bayesian learning perspective which avoids overfitting and reveals the most salient features in the CG evolution law. The formulation adopted enables the quantification of a crucial, and often neglected, component in the CG process, i.e. the predictive uncertainty due to information loss. Furthermore, it is capable of reconstructing the evolution of the full, fine-scale system and therefore the observables of interest need not be selected a priori. We demonstrate the efficacy of the proposed framework by applying it to systems of interacting particles and a series of images of a nonlinear pendulum. In both cases we identify the underlying coarse dynamics and can generate extrapolative predictions including the forming and propagation of a shock for the particle systems and a stable trajectory in the phase space for the pendulum.

Topographic Mapping of astronomical light curves via a physically inspired Probabilistic model

Unsupervised Transient Light Curve Analysis Via Hierarchical Bayesian Inference

Mapping stellar surfaces II: An interpretable Gaussian process model for light curves

Contrastive Topographic Models: Energy-based density models applied to the understanding of sensory coding and cortical topography

Topographic product models applied to natural scene statistics

Matching Bayesian and frequentist coverage probabilities when using an approximate data covariance matrix

Phenomenological modelling of eclipsing system light curves

Modeling Lightcurves for Improved Classification of Astronomical Objects

Versatile Energy-Based Probabilistic Models for High Energy Physics

A probabilistic generative model for semi-supervised training of coarse-grained surrogates and enforcing physical constraints through virtual observables

A differentiable N-body code for transit timing and dynamical modelling -- II. Photodynamics

Intrinsic Gaussian Process on Unknown Manifolds with Probabilistic Metrics

Incorporating physical constraints in a deep probabilistic machine learning framework for coarse-graining dynamical systems

Planet Eclipse Mapping with Long-Term Baseline Drifts

Exploring the halo-galaxy connection with probabilistic approaches

Using Galaxy Evolution as Source of Physics-Based Ground Truth for Generative Models

Realistic galaxy image simulation via score-based generative models

Modeling Light Curves for Improved Classification

Stochastic Feature Mapping for PAC-Bayes Classification

Physics-aware, probabilistic model order reduction with guaranteed stability

Hybrid Physical-Deep Learning Model for Astronomical Inverse Problems