Abstract:Systems of coupled dynamical units (e.g., oscillators or neurons) are known to exhibit complex, emergent behaviors that may be simplified through coarse-graining: a process in which one discovers coarse variables and derives equations for their evolution. Such coarse-graining procedures often require extensive experience and/or a deep understanding of the system dynamics. In this paper we present a systematic, data-driven approach to discovering "bespoke" coarse variables based on manifold learning algorithms. We illustrate this methodology with the classic Kuramoto phase oscillator model, and demonstrate how our manifold learning technique can successfully identify a coarse variable that is one-to-one with the established Kuramoto order parameter. We then introduce an extension of our coarse-graining methodology which enables us to learn evolution equations for the discovered coarse variables via an artificial neural network architecture templated on numerical time integrators (initial value solvers). This approach allows us to learn accurate approximations of time derivatives of state variables from sparse flow data, and hence discover useful approximate differential equation descriptions of their dynamic behavior. We demonstrate this capability by learning ODEs that agree with the known analytical expression for the Kuramoto order parameter dynamics at the continuum limit. We then show how this approach can also be used to learn the dynamics of coarse variables discovered through our manifold learning methodology. In both of these examples, we compare the results of our neural network based method to typical finite differences complemented with geometric harmonics. Finally, we present a series of computational examples illustrating how a variation of our manifold learning methodology can be used to discover sets of "effective" parameters, reduced parameter combinations, for multi-parameter models with complex coupling. We conclude with a discussion of possible extensions of this approach, including the possibility of obtaining data-driven effective partial differential equations for coarse-grained neuronal network behavior, as illustrated by the synchronization dynamics of Hodgkin–Huxley type neurons with a Chung-Lu network. Thus, we build an integrated suite of tools for obtaining data-driven coarse variables, data-driven effective parameters, and data-driven coarse-grained equations from detailed observations of networks of oscillators.

Data assimilation for networks of coupled oscillators: Inferring unknown model parameters from partial observations

Data assimilation for networks of coupled oscillators: Inferring unknown model parameters from partial observations

Parameter and coupling estimation in small groups of Izhikevich neurons

An Iterative Approach to Data-Driven Inference for Decoding Oscillator Network Structures

On a framework of data assimilation for neuronal networks

Using Data Assimilation to Train a Hybrid Forecast System that Combines Machine-Learning and Knowledge-Based Components

Deep Diffusion Kalman Filter Combining Large-Scale Neuronal Networks Simulation with Multimodal Neuroimaging Data

Network inference from oscillatory signals based on circle map

Comparing Data Assimilation Filters for Parameter Estimation in A Neuron Model

Discovering dynamics and parameters of nonlinear oscillatory and chaotic systems from partial observations

Emergent Spaces for Coupled Oscillators

Introduction to data assimilation for parameter estimation

Model error covariance estimation in particle and ensemble Kalman filters using an online expectation-maximization algorithm

Inferring the dynamics of ionic currents from recursive piecewise data assimilation of approximate neuron models

Data assimilation in operator algebras

Data Assimilation by Artificial Neural Networks for an Atmospheric General Circulation Model: Conventional Observation

On a Framework of Data Assimilation for Hyperparameter Estimation of Spiking Neuronal Networks.

Inferring unknown unknowns: Regularized bias-aware ensemble Kalman filter

A nonintrusive hybrid neural-physics modeling of incomplete dynamical systems: Lorenz equations

A Local Ensemble Kalman Filter for Atmospheric Data Assimilation

A Self-Organizing State-Space-Model Approach for Parameter Estimation in Hodgkin-Huxley-Type Models of Single Neurons