Abstract:The goal of this work is to learn a parsimonious and informative representation for high-dimensional time series. Conceptually, this comprises two distinct yet tightly coupled tasks: learning a low-dimensional manifold and modeling the dynamical process. These two tasks have a complementary relationship as the temporal constraints provide valuable neighborhood information for dimensionality reduction and, conversely, the low-dimensional space allows dynamics to be learned efficiently. Solving these two tasks simultaneously allows important information to be exchanged mutually. If nonlinear models are required to capture the rich complexity of time series, then the learning problem becomes harder as the nonlinearities in both tasks are coupled. A divide, conquer, and coordinate method is proposed. The solution approximates the nonlinear manifold and dynamics using simple piecewise linear models. The interactions and coordinations among the linear models are captured in a graphical model. The model structure setup and parameter learning are done using a variational Bayesian approach, which enables automatic Bayesian model structure selection, hence solving the problem of overfitting. By exploiting the model structure, efficient inference and learning algorithms are obtained without oversimplifying the model of the underlying dynamical process. Evaluation of the proposed framework with competing approaches is conducted in three sets of experiments: dimensionality reduction and reconstruction using synthetic time series, video synthesis using a dynamic texture database, and human motion synthesis, classification, and tracking on a benchmark data set. In all experiments, the proposed approach provides superior performance.

Manifold Learning with Contracting Observers for Data-driven Time-series Analysis

Data-driven discovery of intrinsic dynamics

Manifold Learning for Organizing Unstructured Sets of Process Observations

Divide, Conquer and Coordinate: Globally Coordinated Switching Linear Dynamical System

Learning Latent Dynamics via Invariant Decomposition and (Spatio-)Temporal Transformers

Automated Global Analysis of Experimental Dynamics through Low-Dimensional Linear Embeddings

Manifold-based time series forecasting

Learning Interpretable Hierarchical Dynamical Systems Models from Time Series Data

Dynamically Meaningful Latent Representations of Dynamical Systems

Data-Driven Modeling and Forecasting of Chaotic Dynamics on Inertial Manifolds Constructed as Spectral Submanifolds

Latent common manifold learning with alternating diffusion: analysis and applications

Structured Manifold Broad Learning System: A Manifold Perspective for Large-Scale Chaotic Time Series Analysis and Prediction

Autoencoders for discovering manifold dimension and coordinates in data from complex dynamical systems

Learning physics-based reduced-order models from data using nonlinear manifolds

Sparse Time Frequency Representations and Dynamical Systems

Manifold-based learning and synthesis.

Manifold Learning in Atomistic Simulations: A Conceptual Review

Data-driven linearization of dynamical systems

Deep Efficient Continuous Manifold Learning for Time Series Modeling

Smooth and Sparse Latent Dynamics in Operator Learning with Jerk Regularization

Manifold learning approach for chaos in the dripping faucet