Abstract:In this article, we apply the theory of quantum channels and open-system state evolution to propose a unitary parameterization and an efficient learning algorithm for Quantum Hidden Markov Models (QHMMs). By leveraging the richer dynamics of quantum channels, we demonstrate the greater efficiency of quantum stochastic generators compared to classical ones. Specifically, we prove that a stochastic process can be simulated within a quantum Hilbert space using quadratically fewer dimensions than in a classical stochastic vector space. We show that any QHMM can be efficiently implemented and simulated using a quantum circuit with mid-circuit measurements. A key advantage for feasible QHMM learning in the hypothesis space of unitary circuits lies in the continuity of Stinespring's dilation. Specifically, if the unitary parameterizations of channels are close in the operator norm, the corresponding channels will be close in both diamond norm and Bures distance. This property forms the foundation for defining of efficient learning algorithms with continuous fitness landscapes. By employing the unitary parameterization of QHMMs, we establish a formal generative learning model. This model formalizes the empirical distributions of target stochastic process languages, defines the hypothesis space of quantum circuits, and introduces an empirical stochastic divergence measure-hypothesis fitness-as a criterion for learning success. The smooth mapping between the hypothesis and fitness spaces facilitates the development of efficient heuristic and gradient descent algorithms. We consider four examples of stochastic process languages and train QHMMs with hyperparameter-adaptive evolutionary search and multi-parameter nonlinear optimization technique applied to parameterized quantum ansatz circuits. We confirm our results by running optimal circuits on quantum hardware.

On learning parametric-output HMMs

Statistical inference for the nonparametric and semiparametric hidden Markov model via the composite likelihood approach

An Efficient Em Approach To Parameter Learning Of The Mixture Of Gaussian Processes

Parameter Estimation for Hidden Markov Models with Intractable Likelihoods

Adiabatic Persistent Contrastive Divergence Learning

Sample-efficient neural likelihood-free Bayesian inference of implicit HMMs

Variational Bayesian Variable Selection for High-Dimensional Hidden Markov Models

Variational Hierarchical Mixtures for Probabilistic Learning of Inverse Dynamics

Implementation and Learning of Quantum Hidden Markov Models

A parameter estimation method for multivariate binned Hawkes processes

Parameter Learning of Logic Programs for Symbolic-Statistical Modeling

Variance-Reduced Stochastic Optimization for Efficient Inference of Hidden Markov Models

Parameter Learning for Log-supermodular Distributions

Learning Mixtures of Gaussians Using the DDPM Objective

On Parameter Estimation in Deviated Gaussian Mixture of Experts

Parameter estimation of hidden Markov models: comparison of EM and quasi-Newton methods with a new hybrid algorithm

Bayesian Nonparametric Hidden Semi-Markov Models

DenseHMM: Learning Hidden Markov Models by Learning Dense Representations

Disentangled Sticky Hierarchical Dirichlet Process Hidden Markov Model

Parameter Estimation of Binned Hawkes Processes

Multivariate, Heteroscedastic Empirical Bayes via Nonparametric Maximum Likelihood