Abstract:The reliable prediction of the temporal behavior of complex systems is key in numerous scientific fields. This strong interest is however hindered by modeling issues: Often, the governing equations describing the physics of the system under consideration are not accessible or, when known, their solution might require a computational time incompatible with the prediction time constraints. Not surprisingly, approximating complex systems in a generic functional format and informing it ex–nihilo from available observations has become common practice in the age of machine learning, as illustrated by the numerous successful examples based on deep neural networks. However, generalizability of the models, margins of guarantee and the impact of data are often overlooked or examined mainly by relying on prior knowledge of the physics. We tackle these issues from a different viewpoint, by adopting a curriculum learning strategy. In curriculum learning, the dataset is structured such that the training process starts from simple samples toward more complex ones in order to favor convergence and generalization. The concept has been developed and successfully applied in robotics and control of systems. Here, we apply this concept for the learning of complex dynamical systems in a systematic way. First, leveraging insights from the ergodic theory, we assess the amount of data sufficient for a-priori guaranteeing a faithful model of the physical system and thoroughly investigate the impact of the training set and its structure on the quality of long-term predictions. Based on that, we consider entropy as a metric of complexity of the dataset; we show how an informed design of the training set based on the analysis of the entropy significantly improves the resulting models in terms of generalizability and provide insights on the amount and the choice of data required for an effective data-driven modeling.

Learning Collective Behaviors from Observation

Data-driven Discovery of Emergent Behaviors in Collective Dynamics

Learning Continuous System Dynamics from Irregularly-Sampled Partial Observations

Noise Guided Structural Learning from Observing Stochastic Dynamics

Modeling of Nonlinear Dynamical Systems Based on Deterministic Learning and Structural Stability

Capturing Actionable Dynamics with Structured Latent Ordinary Differential Equations

Rapid Recognition of Dynamical Patterns Via Deterministic Learning and State Observation

Deep Generative Modeling for Identification of Noisy, Non-Stationary Dynamical Systems

Learning Individual Interactions from Population Dynamics with Discrete-Event Simulation Model

Joint Learning of Linear Time-Invariant Dynamical Systems

Learning dynamical behaviors in physical systems

Learning Governing Equations of Unobserved States in Dynamical Systems

Learning System Dynamics without Forgetting

On Learning what to Learn: heterogeneous observations of dynamics and establishing (possibly causal) relations among them

Learning Latent Dynamics via Invariant Decomposition and (Spatio-)Temporal Transformers

Curriculum learning for data-driven modeling of dynamical systems

Learning Stable Deep Dynamics Models

Social Learning in Community Structured Graphs

Automated Global Analysis of Experimental Dynamics through Low-Dimensional Linear Embeddings

Joint Problems in Learning Multiple Dynamical Systems

Collective Relational Inference for learning heterogeneous interactions