Abstract:We present an unbiased method for Bayesian posterior means based on kinetic Langevin dynamics that combines advanced splitting methods with enhanced gradient approximations. Our approach avoids Metropolis correction by coupling Markov chains at different discretization levels in a multilevel Monte Carlo approach. Theoretical analysis demonstrates that our proposed estimator is unbiased, attains finite variance, and satisfies a central limit theorem. It can achieve accuracy $\epsilon>0$ for estimating expectations of Lipschitz functions in $d$ dimensions with $\mathcal{O}(d^{1/4}\epsilon^{-2})$ expected gradient evaluations, without assuming warm start. We exhibit similar bounds using both approximate and stochastic gradients, and our method's computational cost is shown to scale independently of the size of the dataset. The proposed method is tested using a multinomial regression problem on the MNIST dataset and a Poisson regression model for soccer scores. Experiments indicate that the number of gradient evaluations per effective sample is independent of dimension, even when using inexact gradients. For product distributions, we give dimension-independent variance bounds. Our results demonstrate that in large-scale applications, the unbiased algorithm we present can be 2-3 orders of magnitude more efficient than the ``gold-standard" randomized Hamiltonian Monte Carlo.

Amortized Bethe Free Energy Minimization for Learning MRFs

Approximating the Bethe partition function

Hyperparameters Adaptation for Restricted Boltzmann Machines Based on Free Energy

Bethe Bounds and Approximating the Global Optimum

Region-based Energy Neural Network for Approximate Inference

Efficient Graph Laplacian Estimation by Proximal Newton

Tuning-Free Maximum Likelihood Training of Latent Variable Models via Coin Betting

Full Conditional Free Energy Based Inference

Local approximate inference algorithms

Unbiased Kinetic Langevin Monte Carlo with Inexact Gradients

Sequential Monte Carlo for Inclusive KL Minimization in Amortized Variational Inference

On Fenchel Mini-Max Learning.

To Relieve Your Headache of Training an MRF, Take AdVIL

Amortised Learning by Wake-Sleep

Approximate Inference and Constrained Optimization

Learning Multi-layer Latent Variable Model via Variational Optimization of Short Run MCMC for Approximate Inference

Learning Structured Densities Via Infinite Dimensional Exponential Families

Scalable Inference of Sparsely-changing Markov Random Fields with Strong Statistical Guarantees

NeuroLifting: Neural Inference on Markov Random Fields at Scale

Learning to Solve the Constrained Most Probable Explanation Task in Probabilistic Graphical Models

Adversarial Variational Inference and Learning in Markov Random Fields