Abstract:Large collections of coupled, heterogeneous agents can manifest complex dynamical behavior presenting difficulties for simulation and analysis. However, if the collective dynamics lie on a low-dimensional manifold, then the original agent-based model may be approximated with a simplified surrogate model on and near the low-dimensional space where the dynamics live. Analytically identifying such simplified models can be challenging or impossible, but here we present a data-driven coarse-graining methodology for discovering such reduced models. We consider two types of reduced models: globally based models that use global information and predict dynamics using information from the whole ensemble and locally based models that use local information, that is, information from just a subset of agents close (close in heterogeneity space, not physical space) to an agent, to predict the dynamics of an agent. For both approaches, we are able to learn laws governing the behavior of the reduced system on the low-dimensional manifold directly from time series of states from the agent-based system. These laws take the form of either a system of ordinary differential equations (ODEs), for the globally based approach, or a partial differential equation (PDE) in the locally based case. For each technique, we employ a specialized artificial neural network integrator that has been templated on an Euler time stepper (i.e., a ResNet) to learn the laws of the reduced model. As part of our methodology, we utilize the proper orthogonal decomposition (POD) to identify the low-dimensional space of the dynamics. Our globally based technique uses the resulting POD basis to define a set of coordinates for the agent states in this space and then seeks to learn the time evolution of these coordinates as a system of ODEs. For the locally based technique, we propose a methodology for learning a partial differential equation representation of the agents; the PDE law depends on the state variables and partial derivatives of the state variables with respect to model heterogeneities. We require that the state variables are smooth with respect to model heterogeneities, which permit us to cast the discrete agent-based problem as a continuous one in heterogeneity space. The agents in such a representation bear similarity to the discretization points used in typical finite element/volume methods. As an illustration of the efficacy of our techniques, we consider a simplified coupled neuron model for rhythmic oscillations in the pre-Bötzinger complex and demonstrate how our data-driven surrogate models are able to produce dynamics comparable to the dynamics of the full system. A nontrivial conclusion is that the dynamics can be equally well reproduced by an all-to-all coupled and by a locally coupled model of the same agents.

Reduced-Order Modeling Of Hidden Dynamics

Reduced-order Modelling of Parameter-Dependent, Linear and Nonlinear Dynamic Partial Differential Equation Models.

Sparse Reduced-Order Modelling: Sensor-Based Dynamics to Full-State Estimation

Reduced order models based on Markovian and Non-Markovian frameworks

Learning Latent Space Dynamics with Model-Form Uncertainties: A Stochastic Reduced-Order Modeling Approach

Learning Stochastic Reduced Models from Data: A Nonintrusive Approach

Data-driven model reduction via non-intrusive optimization of projection operators and reduced-order dynamics

The Applications of Order Reduction Methods in Nonlinear Dynamic Systems

Reduced Markovian Models of Dynamical Systems

Regression-based Identification and Order Reduction Method for Nonlinear Dynamic Structural Models

Global and local reduced models for interacting, heterogeneous agents

Physics-aware, probabilistic model order reduction with guaranteed stability

Model Reduction via Dynamic Mode Decomposition

Model Reduction of Markovian Jump Systems with Uncertain Probabilities

Probabilistic error estimation for non-intrusive reduced models learned from data of systems governed by linear parabolic partial differential equations

Operator inference of non-Markovian terms for learning reduced models from partially observed state trajectories

Learning physics-based reduced-order models from data using nonlinear manifolds

Koopman Reduced Order Modeling with Confidence Bounds

Reconstructing dynamics of complex systems from noisy time series with hidden variables

Data-driven reduced-order modeling for nonautonomous dynamical systems in multiscale media

Non-Markovian Reduced Models to Unravel Transitions in Non-equilibrium Systems