Abstract:In this article, we apply the theory of quantum channels and open-system state evolution to propose a unitary parameterization and an efficient learning algorithm for Quantum Hidden Markov Models (QHMMs). By leveraging the richer dynamics of quantum channels, we demonstrate the greater efficiency of quantum stochastic generators compared to classical ones. Specifically, we prove that a stochastic process can be simulated within a quantum Hilbert space using quadratically fewer dimensions than in a classical stochastic vector space. We show that any QHMM can be efficiently implemented and simulated using a quantum circuit with mid-circuit measurements. A key advantage for feasible QHMM learning in the hypothesis space of unitary circuits lies in the continuity of Stinespring's dilation. Specifically, if the unitary parameterizations of channels are close in the operator norm, the corresponding channels will be close in both diamond norm and Bures distance. This property forms the foundation for defining of efficient learning algorithms with continuous fitness landscapes. By employing the unitary parameterization of QHMMs, we establish a formal generative learning model. This model formalizes the empirical distributions of target stochastic process languages, defines the hypothesis space of quantum circuits, and introduces an empirical stochastic divergence measure-hypothesis fitness-as a criterion for learning success. The smooth mapping between the hypothesis and fitness spaces facilitates the development of efficient heuristic and gradient descent algorithms. We consider four examples of stochastic process languages and train QHMMs with hyperparameter-adaptive evolutionary search and multi-parameter nonlinear optimization technique applied to parameterized quantum ansatz circuits. We confirm our results by running optimal circuits on quantum hardware.

Factorial hidden Markov models

Factorial Hidden Markov Models for Learning Representations of Natural Language

Boltzmann chains and hidden Markov models

Mixed memory markov models: Decomposing complex stochastic processes as mixtures of simpler ones

Clustering hidden Markov models with variational HEM

A spectral algorithm for learning hidden Markov models

Learning Hidden Markov Models Using Conditional Samples

Factorized Asymptotic Bayesian Hidden Markov Models

Variational learning for switching state-space models

Markov Observation Models

Dynamical mixture modeling with fast, automatic determination of Markov chains

Maximum Entropy Estimator for Hidden Markov Models: Reduction to Dimension 2

Hierarchical mixtures of experts and the EM algorithm

Supervised learning from incomplete data via an EM approach

EM algorithms of Gaussian mixture model and hidden Markov model

Refined Learning of Hidden Markov Models with a Modified Baum-Welch Algorithm and Informative Components

A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models

Implementation and Learning of Quantum Hidden Markov Models

Hidden Markov decision trees

A RPCL-Based Approach for Identification of Markov Model with Unknown Noise and Number of States

The Expectation-Maximization Algorithm for Continuous-time Hidden Markov Models