Abstract:In this paper, we propose a probabilistic physics-guided framework, termed Physics-guided Deep Markov Model (PgDMM). The framework targets the inference of the characteristics and latent structure of nonlinear dynamical systems from measurement data, where exact inference of latent variables is typically intractable. A recently surfaced option pertains to leveraging variational inference to perform approximate inference. In such a scheme, transition and emission functions of the system are parameterized via feed-forward neural networks (deep generative models). However, due to the generalized and highly versatile formulation of neural network functions, the learned latent space often lacks physical interpretation and structured representation. To address this, we bridge physics-based state space models with Deep Markov Models, thus delivering a hybrid modeling framework for unsupervised learning and identification of nonlinear dynamical systems. The proposed framework takes advantage of the expressive power of deep learning, while retaining the driving physics of the dynamical system by imposing physics-driven restrictions on the side of the latent space. We demonstrate the benefits of such a fusion in terms of achieving improved performance on illustrative simulation examples and experimental case studies of nonlinear systems. Our results indicate that the physics-based models involved in the employed transition and emission functions essentially enforce a more structured and physically interpretable latent space, which is essential for enhancing and generalizing the predictive capabilities of deep learning-based models.

Generalization of Auto-Regressive Hidden Markov Models to Non-Linear Dynamics and Unit Quaternion Observation Space

Dynamic Processes Modeling and Monitoring Based on a Novel Dynamic Latent Variable Model.

Bayesian Sparse Vector Autoregressive Switching Models with Application to Human Gesture Phase Segmentation

Autoregressive Dynamic Latent Variable Models for Process Monitoring

Classification and recognition of dynamical models: the role of phase, independent components, kernels and optimal transport

Switching Autoregressive Dynamic Latent Variable Model for Fault Detection in Multimode Processes

Autoregressive Hidden Markov Models with partial knowledge on latent space applied to aero-engines prognostics

A Disentangled Recognition and Nonlinear Dynamics Model for Unsupervised Learning

Linear State-Space Model with Time-Varying Dynamics

A Markov-switching Hidden Heterogeneous Network Autoregressive Model for Multivariate Time Series Data with Multimodality

GenMarkov: Modeling Generalized Multivariate Markov Chains in R

Deep learning Markov and Koopman models with physical constraints

A latent space model for multivariate count data time series analysis

Spatial-based Bayesian Hidden Markov Models with Dirichlet Mixtures for Video Anomaly Detection

Symphony in the Latent Space: Provably Integrating High-dimensional Techniques with Non-linear Machine Learning Models

Hidden Markov graphical models with state-dependent generalized hyperbolic distributions

Physics-guided Deep Markov Models for Learning Nonlinear Dynamical Systems with Uncertainty

Variational learning for switching state-space models

Characterizing A Database of Sequential Behaviors with Latent Dirichlet Hidden Markov Models

Generalised Hyperbolic State-space Models for Inference in Dynamic Systems

Integrating Multimodal Data for Joint Generative Modeling of Complex Dynamics