Abstract:We present an approach to selecting the distributions in sampling-resampling which improves the efficiency of the weighted bootstrap. To complement the standard scheme of sampling from the prior and reweighting with the likelihood, we introduce a reversed scheme, which samples from the (normalized) likelihood and reweights with the prior. We begin with some motivating examples, before developing the relevant theory. We then apply the approach to the particle filtering of time series, including nonlinear and non-Gaussian Bayesian state-space models, a task that demands efficiency, given the repeated application of the weighted bootstrap. Through simulation studies on a normal dynamic linear model, Poisson hidden Markov model, and stochastic volatility model, we demonstrate the gains in efficiency obtained by the approach, involving the choice of the standard or reversed filter. In addition, for the stochastic volatility model, we provide three real-data examples, including a comparison with importance sampling methods that attempt to incorporate information about the data indirectly into the standard filtering scheme and an extension to multivariate models. We determine that the reversed filtering scheme offers an advantage over such auxiliary methods owing to its ability to incorporate information about the data directly into the sampling, an ability that further facilitates its performance in higher-dimensional settings.

Estimation in hidden Markov models via efficient importance sampling

Importance Sampling of Interval Markov Chains

Efficient Importance Sampling for Rare Event Simulation with Applications

Adaptive Importance Sampling for Efficient Stochastic Root Finding and Quantile Estimation

A General Framework for Importance Sampling with Latent Markov Processes

An Importance Sampling Method with Applications to Rare Event Probability

Random Weighting Estimation of Sampling Distributions Via Importance Resampling.

Implicitly Adaptive Importance Sampling

Two-Stage Importance Sampling With Mixture Proposals

An Adaptive Importance Sampling for Locally Stable Point Processes

Using Autodiff to Estimate Posterior Moments, Marginals and Samples

On importance sampling and independent Metropolis-Hastings with an unbounded weight function

Targeted stochastic gradient Markov chain Monte Carlo for hidden Markov models with rare latent states

On a Metropolis-Hastings importance sampling estimator

Rare Event Simulation Method Based on Importance Sampling Technology

Efficient High-Dimensional Importance Sampling

Penalized Importance Sampling for Parameter Estimation in Stochastic Differential Equations

The resampling method via representative points

Iterative Importance Sampling Algorithms for Parameter Estimation

A Novel Adaptive Importance Sampling Algorithm Based on Markov Chain and Low-Discrepancy Sequence

Reversed particle filtering for hidden markov models