Abstract:Probability density function estimation with weighted samples is the main foundation of all adaptive importance sampling algorithms. Classically, a target distribution is approximated either by a non-parametric model or within a parametric family. However, these models suffer from the curse of dimensionality or from their lack of flexibility. In this contribution, we suggest to use as the approximating model a distribution parameterised by a variational autoencoder. We extend the existing framework to the case of weighted samples by introducing a new objective function. The flexibility of the obtained family of distributions makes it as expressive as a non-parametric model, and despite the very high number of parameters to estimate, this family is much more efficient in high dimension than the classical Gaussian or Gaussian mixture families. Moreover, in order to add flexibility to the model and to be able to learn multimodal distributions, we consider a learnable prior distribution for the variational autoencoder latent variables. We also introduce a new pre-training procedure for the variational autoencoder to find good starting weights of the neural networks to prevent as much as possible the posterior collapse phenomenon to happen. At last, we explicit how the resulting distribution can be combined with importance sampling, and we exploit the proposed procedure in existing adaptive importance sampling algorithms to draw points from a target distribution and to estimate a rare event probability in high dimension on two multimodal problems.

Adaptive channels for data analysis and importance sampling

Importance Sampling of Interval Markov Chains

Implicitly Adaptive Importance Sampling

Variational autoencoder with weighted samples for high-dimensional non-parametric adaptive importance sampling

Sampling with Adaptive Variance for Multimodal Distributions

A Vine-Copula Based Adaptive Mcmc Sampler for Efficient Inference of Dynamical Systems

Tempered, Anti-trunctated, Multiple Importance Sampling

A Novel Adaptive Importance Sampling Algorithm for Bayesian Model Updating

Using Autodiff to Estimate Posterior Moments, Marginals and Samples

Adapting The Gibbs Sampler

Adaptive and Stratified Subsampling Techniques for High Dimensional Non-Standard Data Environments

Accelerated Markov Chain Monte Carlo Using Adaptive Weighting Scheme

Improving control based importance sampling strategies for metastable diffusions via adapted metadynamics

Adaptive importance sampling for heavy-tailed distributions via $α$-divergence minimization

MadNIS -- Neural Multi-Channel Importance Sampling

On importance sampling and independent Metropolis-Hastings with an unbounded weight function

Stochastic mirror descent for nonparametric adaptive importance sampling

Sampling-Based Approaches to Calculating Marginal Densities

Adaptive Reduced Multilevel Splitting

Adaptive Annealed Importance Sampling with Constant Rate Progress

Distributed Markov Chain Monte Carlo Sampling based on the Alternating Direction Method of Multipliers