Abstract:Complex spatiotemporal dynamics of physicochemical processes are often modeled at a microscopic level (through, e.g., atomistic, agent-based, or lattice models) based on first principles. Some of these processes can also be successfully modeled at the macroscopic level using, e.g., partial differential equations (PDEs) describing the evolution of the right few macroscopic observables (e.g., concentration and momentum fields). Deriving good macroscopic descriptions (the so-called "closure problem") is often a time-consuming process requiring deep understanding/intuition about the system of interest. Recent developments in data science provide alternative ways to effectively extract/learn accurate macroscopic descriptions approximating the underlying microscopic observations. In this paper, we introduce a data-driven framework for the identification of unavailable coarse-scale PDEs from microscopic observations via machine-learning algorithms. Specifically, using Gaussian processes, artificial neural networks, and/or diffusion maps, the proposed framework uncovers the relation between the relevant macroscopic space fields and their time evolution (the right-hand side of the explicitly unavailable macroscopic PDE). Interestingly, several choices equally representative of the data can be discovered. The framework will be illustrated through the data-driven discovery of macroscopic, concentration-level PDEs resulting from a fine-scale, lattice Boltzmann level model of a reaction/transport process. Once the coarse evolution law is identified, it can be simulated to produce long-term macroscopic predictions. Different features (pros as well as cons) of alternative machine-learning algorithms for performing this task (Gaussian processes and artificial neural networks) are presented and discussed.

Learning effective stochastic differential equations from microscopic simulations: combining stochastic numerics and deep learning

Learning effective stochastic differential equations from microscopic simulations: Linking stochastic numerics to deep learning.

An approximate operator-based learning method for the numerical solutions of stochastic differential equations

Learning stochastic dynamical systems with neural networks mimicking the Euler-Maruyama scheme

Stochastic physics-informed neural ordinary differential equations

A deep learning-based Monte Carlo simulation scheme for stochastic differential equations driven by fractional Brownian motion

Coarse-scale PDEs from fine-scale observations via machine learning

The Seven-League Scheme: Deep Learning for Large Time Step Monte Carlo Simulations of Stochastic Differential Equations

DynGMA: a robust approach for learning stochastic differential equations from data

Identifying Drift, Diffusion, and Causal Structure from Temporal Snapshots

How to Learn and Generalize From Three Minutes of Data: Physics-Constrained and Uncertainty-Aware Neural Stochastic Differential Equations

Deep Stochastic Mechanics

Deep learning based numerical approximation algorithms for stochastic partial differential equations and high-dimensional nonlinear filtering problems

Scalable Gradients for Stochastic Differential Equations

Deep learning algorithm for data-driven simulation of noisy dynamical system

Sparse inference and active learning of stochastic differential equations from data

ATLAS: A geometric approach to learning high-dimensional stochastic systems near manifolds

Improving the Noise Estimation of Latent Neural Stochastic Differential Equations

Imitating Deep Learning Dynamics via Locally Elastic Stochastic Differential Equations

Modelling pathwise uncertainty of Stochastic Differential Equations samplers via Probabilistic Numerics