Abstract:Probability density function estimation with weighted samples is the main foundation of all adaptive importance sampling algorithms. Classically, a target distribution is approximated either by a non-parametric model or within a parametric family. However, these models suffer from the curse of dimensionality or from their lack of flexibility. In this contribution, we suggest to use as the approximating model a distribution parameterised by a variational autoencoder. We extend the existing framework to the case of weighted samples by introducing a new objective function. The flexibility of the obtained family of distributions makes it as expressive as a non-parametric model, and despite the very high number of parameters to estimate, this family is much more efficient in high dimension than the classical Gaussian or Gaussian mixture families. Moreover, in order to add flexibility to the model and to be able to learn multimodal distributions, we consider a learnable prior distribution for the variational autoencoder latent variables. We also introduce a new pre-training procedure for the variational autoencoder to find good starting weights of the neural networks to prevent as much as possible the posterior collapse phenomenon to happen. At last, we explicit how the resulting distribution can be combined with importance sampling, and we exploit the proposed procedure in existing adaptive importance sampling algorithms to draw points from a target distribution and to estimate a rare event probability in high dimension on two multimodal problems.

Variance Reduction in Black-box Variational Inference by Adaptive Importance Sampling

Accelerated Stochastic ADMM with Variance Reduction

Importance Sampled Stochastic Optimization for Variational Inference

Implicitly Adaptive Importance Sampling

Adaptive variational Bayes: Optimality, computation and applications

Variational Refinement for Importance Sampling Using the Forward Kullback-Leibler Divergence

Variance Reduction for the Independent Metropolis Sampler

Variance Analysis of Multiple Importance Sampling Schemes

Variance Control for Black Box Variational Inference Using The James-Stein Estimator

Variance-reduced sampling importance resampling

Variance reduction for dependent sequences with applications to Stochastic Gradient MCMC

Nonasymptotic Bounds for Suboptimal Importance Sampling

Stochastic Gradient Hamiltonian Monte Carlo with Variance Reduction for Bayesian Inference.

Variational autoencoder with weighted samples for high-dimensional non-parametric adaptive importance sampling

Batch and match: black-box variational inference with a score-based divergence

Variational Learning of Gaussian Process Latent Variable Models through Stochastic Gradient Annealed Importance Sampling

Forward $χ^2$ Divergence Based Variational Importance Sampling

Adaptive Variance Reducing for Stochastic Gradient Descent.

Adaptive importance sampling for heavy-tailed distributions via $α$-divergence minimization

Practical and Matching Gradient Variance Bounds for Black-Box Variational Bayesian Inference

Recursive Monte Carlo and Variational Inference with Auxiliary Variables