Abstract:The goal of this work is to learn a parsimonious and informative representation for high-dimensional time series. Conceptually, this comprises two distinct yet tightly coupled tasks: learning a low-dimensional manifold and modeling the dynamical process. These two tasks have a complementary relationship as the temporal constraints provide valuable neighborhood information for dimensionality reduction and, conversely, the low-dimensional space allows dynamics to be learned efficiently. Solving these two tasks simultaneously allows important information to be exchanged mutually. If nonlinear models are required to capture the rich complexity of time series, then the learning problem becomes harder as the nonlinearities in both tasks are coupled. A divide, conquer, and coordinate method is proposed. The solution approximates the nonlinear manifold and dynamics using simple piecewise linear models. The interactions and coordinations among the linear models are captured in a graphical model. The model structure setup and parameter learning are done using a variational Bayesian approach, which enables automatic Bayesian model structure selection, hence solving the problem of overfitting. By exploiting the model structure, efficient inference and learning algorithms are obtained without oversimplifying the model of the underlying dynamical process. Evaluation of the proposed framework with competing approaches is conducted in three sets of experiments: dimensionality reduction and reconstruction using synthetic time series, video synthesis using a dynamic texture database, and human motion synthesis, classification, and tracking on a benchmark data set. In all experiments, the proposed approach provides superior performance.

Automated Global Analysis of Experimental Dynamics through Low-Dimensional Linear Embeddings

Statistical Information of Low-Dimensional Processes Hidden in Random State Data

Learning Low-Dimensional Quadratic-Embeddings of High-Fidelity Nonlinear Dynamics using Deep Learning

Dynamically Meaningful Latent Representations of Dynamical Systems

Data-driven discovery of intrinsic dynamics

Autoencoders for discovering manifold dimension and coordinates in data from complex dynamical systems

Discovering governing equations from data by sparse identification of nonlinear dynamical systems

Identifying Latent Dynamic Components in Biological Systems

Stability and Reliability Analysis of Nonlinear Stochastic System Using Data-Driven Dimensional Analysis Method

Deep multi-modal learning for joint linear representation of nonlinear dynamical systems

Uncovering Closed-form Governing Equations of Nonlinear Dynamics from Videos

Learning Latent Dynamics via Invariant Decomposition and (Spatio-)Temporal Transformers

OnsagerNet: Learning Stable and Interpretable Dynamics Using a Generalized Onsager Principle

Data-driven linearization of dynamical systems

Data Based Identification and Prediction of Nonlinear and Complex Dynamical Systems

Discovering governing equations from partial measurements with deep delay autoencoders

Discovering governing equations from data: Sparse identification of nonlinear dynamical systems

Decomposed Linear Dynamical Systems (dLDS) for learning the latent components of neural dynamics

Automated Discovery of Continuous Dynamics from Videos

Divide, Conquer and Coordinate: Globally Coordinated Switching Linear Dynamical System