Abstract:Machine learning algorithms often take inspiration from established results and knowledge from statistical physics. A prototypical example is the Boltzmann machine algorithm for supervised learning, which utilizes knowledge of classical thermal partition functions and the Boltzmann distribution. Recently, a quantum version of the Boltzmann machine was introduced by Amin, et. al., however, non-commutativity of quantum operators renders the training process by minimizing a cost function inefficient. Recent advances in the study of non-equilibrium quantum integrable systems, which never thermalize, have lead to the exploration of a wider class of statistical ensembles. These systems may be described by the so-called generalized Gibbs ensemble (GGE), which incorporates a number of "effective temperatures". We propose that these GGE's can be successfully applied as the basis of a Boltzmann-machine-like learning algorithm, which operates by learning the optimal values of effective temperatures. We show that the GGE algorithm is an optimal quantum Boltzmann machine: it is the only quantum machine that circumvents the quantum training-process problem. We apply a simplified version of the GGE algorithm, where quantum effects are suppressed, to the classification of handwritten digits in the MNIST database. While lower error rates can be found with other state-of-the-art algorithms, we find that our algorithm reaches relatively low error rates while learning a much smaller number of parameters than would be needed in a traditional Boltzmann machine, thereby reducing computational cost.

Learning Boltzmann Machine with EM-like Method.

Genetic Ensemble of Extreme Learning Machine

Training Restricted Boltzmann Machines with Binary Synapses Using the Bayesian Learning Rule

Boltzmann Machine Learning with the Latent Maximum Entropy Principle

Restricted Boltzmann machine based algorithm for multi-objective optimization

Advanced Mean Field Theory of Restricted Boltzmann Machine

Big Learning Expectation Maximization

End-to-end Training of Deep Boltzmann Machines by Unbiased Contrastive Divergence with Local Mode Initialization

Riemann-Theta Boltzmann Machine

Expectation-maximization for logistic regression

Monotone deep Boltzmann machines

Learning Mixtures of Experts with EM

Statistical Machine Learning EM algorithm Lecture Notes 13 : EM algorithm

Stochastic Expectation Maximization with Variance Reduction.

On Convergence Properties of the EM Algorithm for Gaussian Mixtures.

Unlearning regularization for Boltzmann Machines

Efficient training of energy-based models using Jarzynski equality *

Nonequilibrium Thermodynamics of Restricted Boltzmann Machines

Convergence of Contrastive Divergence Algorithm in Exponential Family

Machine learning algorithms based on generalized Gibbs ensembles

Restricted Boltzmann Machines: Introduction and Review