Abstract:The goal of this work is to learn a parsimonious and informative representation for high-dimensional time series. Conceptually, this comprises two distinct yet tightly coupled tasks: learning a low-dimensional manifold and modeling the dynamical process. These two tasks have a complementary relationship as the temporal constraints provide valuable neighborhood information for dimensionality reduction and, conversely, the low-dimensional space allows dynamics to be learned efficiently. Solving these two tasks simultaneously allows important information to be exchanged mutually. If nonlinear models are required to capture the rich complexity of time series, then the learning problem becomes harder as the nonlinearities in both tasks are coupled. A divide, conquer, and coordinate method is proposed. The solution approximates the nonlinear manifold and dynamics using simple piecewise linear models. The interactions and coordinations among the linear models are captured in a graphical model. The model structure setup and parameter learning are done using a variational Bayesian approach, which enables automatic Bayesian model structure selection, hence solving the problem of overfitting. By exploiting the model structure, efficient inference and learning algorithms are obtained without oversimplifying the model of the underlying dynamical process. Evaluation of the proposed framework with competing approaches is conducted in three sets of experiments: dimensionality reduction and reconstruction using synthetic time series, video synthesis using a dynamic texture database, and human motion synthesis, classification, and tracking on a benchmark data set. In all experiments, the proposed approach provides superior performance.

Learning Slow and Fast System Dynamics Via Automatic Separation of Time Scales

Model inference of a dynamic system by fuzzy learning of geometric structures

Fast and Stable Learning of Dynamical Systems Based on Extreme Learning Machine.

Learning Effective Dynamics from Data-Driven Stochastic Systems

Learning Latent Dynamics via Invariant Decomposition and (Spatio-)Temporal Transformers

Auto-SDE: Learning effective reduced dynamics from data-driven stochastic dynamical systems

Unsupervised Learning of Hybrid Latent Dynamics: A Learn-to-Identify Framework

Divide, Conquer and Coordinate: Globally Coordinated Switching Linear Dynamical System

Learning Nonautonomous Systems via Dynamic Mode Decomposition

A Data-Driven Framework for Learning Hybrid Dynamical Systems.

Intelligent Attractors for Singularly Perturbed Dynamical Systems

Automated Global Analysis of Experimental Dynamics through Low-Dimensional Linear Embeddings

Learning Interpretable Hierarchical Dynamical Systems Models from Time Series Data

Identifying latent state transition in non-linear dynamical systems

Deep multi-modal learning for joint linear representation of nonlinear dynamical systems

Data-driven learning of non-autonomous systems

Learning deep dynamical models from image pixels

Dual-Scale Learning-Based Online Modeling of Nonlinear Distributed Parameter Systems Under Time-Varying Boundary Conditions

Dynamically Meaningful Latent Representations of Dynamical Systems

Autoencoders for discovering manifold dimension and coordinates in data from complex dynamical systems

Layer-wise-residual-driven Approach for Soft Sensing in Composite Dynamic System Based on Slow and Fast Time-Varying Latent Variables