Abstract:The reliable prediction of the temporal behavior of complex systems is key in numerous scientific fields. This strong interest is however hindered by modeling issues: Often, the governing equations describing the physics of the system under consideration are not accessible or, when known, their solution might require a computational time incompatible with the prediction time constraints. Not surprisingly, approximating complex systems in a generic functional format and informing it ex–nihilo from available observations has become common practice in the age of machine learning, as illustrated by the numerous successful examples based on deep neural networks. However, generalizability of the models, margins of guarantee and the impact of data are often overlooked or examined mainly by relying on prior knowledge of the physics. We tackle these issues from a different viewpoint, by adopting a curriculum learning strategy. In curriculum learning, the dataset is structured such that the training process starts from simple samples toward more complex ones in order to favor convergence and generalization. The concept has been developed and successfully applied in robotics and control of systems. Here, we apply this concept for the learning of complex dynamical systems in a systematic way. First, leveraging insights from the ergodic theory, we assess the amount of data sufficient for a-priori guaranteeing a faithful model of the physical system and thoroughly investigate the impact of the training set and its structure on the quality of long-term predictions. Based on that, we consider entropy as a metric of complexity of the dataset; we show how an informed design of the training set based on the analysis of the entropy significantly improves the resulting models in terms of generalizability and provide insights on the amount and the choice of data required for an effective data-driven modeling.

Deterministic Learning and Data-based Modeling and Control

Deterministic Learning and Pattern-Based NN Control.

Deterministic Learning Theory

Deterministic Learning Theory For Identification, Recognition, And Control Preface

Deterministic learning from neural control for a class of sampled-data nonlinear systems

Time Series Classification of Dynamical Systems Using Deterministic Learning

Deterministic learning and neural control of a class of nonlinear systems toward improved performance

Deterministic Learning and Rapid Dynamical Pattern Recognition of Discrete-Time Systems

Modeling of Nonlinear Dynamical Systems Based on Deterministic Learning and Structural Stability

Learning from neural control for a class of discrete-time nonlinear systems

Deterministic Learning of a Class of Nonlinear Systems with Relaxed Conditions

DETERMINISTIC LEARNING AND RAPID DYNAMICAL PATTERN RECOGNITION

Deterministic Learning from Neural Control for Uncertain Nonlinear Pure‐feedback Systems by Output Feedback

Reliability Control of Nonlinear Stochastic Dynamical System Based on Discrete Data

Deterministic Learning from Control of Nonlinear Systems with Disturbances

Deterministic learning from sampling data.

Deterministic Learning-Based Adaptive Neural Control for Nonlinear Full-State Constrained Systems.

Learning from Neural Control of Nonlinear Systems in Normal Form

Intelligent adaptive learning and control for discrete-time nonlinear uncertain systems in multiple environments

Controlling nonlinear dynamical systems into arbitrary states using machine learning

Curriculum learning for data-driven modeling of dynamical systems