Abstract:The practical use of nonparametric Bayesian methods requires the availability of efficient algorithms for posterior inference. The inherently serial nature of traditional Markov chain Monte Carlo (MCMC) methods imposes limitations on their efficiency and scalability. In recent years, there has been a surge of research activity devoted to developing alternative implementation methods that target parallel computing environments. Sequential Monte Carlo (SMC), also known as a particle filter, has been gaining popularity due to its desirable properties. SMC uses a genetic mutation-selection sampling approach with a set of particles representing the posterior distribution of a stochastic process. We propose to enhance the performance of SMC by utilizing Hamiltonian transition dynamics in the particle transition phase, in place of random walk used in the previous literature. We call the resulting procedure Hamiltonian Sequential Monte Carlo (HSMC). Hamiltonian transition dynamics have been shown to yield superior mixing and convergence properties relative to random walk transition dynamics in the context of MCMC procedures. The rationale behind HSMC is to translate such gains to the SMC environment. HSMC will facilitate practical estimation of models with complicated latent structures, such as nonparametric individual unobserved heterogeneity, that are otherwise difficult to implement. We demonstrate the behavior of HSMC in a challenging simulation study and contrast its favorable performance with SMC and other alternative approaches. We then apply HSMC to a panel discrete choice model with nonparametric consumer heterogeneity, allowing for multiple modes, asymmetries, and data-driven clustering, providing insights for consumer segmentation, individual level marketing, and price micromanagement.

SEQUENTIAL MONTE CARLO METHODS AND THEIR APPLICATIONS

An Overview of Existing Methods and Recent Advances in Sequential Monte Carlo

Sequential Monte Carlo with Highly Informative Observations

Lookahead Strategies for Sequential Monte Carlo

Elements of Sequential Monte Carlo

An Introduction to Sequential Monte Carlo

Towards Improved Uncertainty Quantification of Stochastic Epidemic Models Using Sequential Monte Carlo

Resampling Strategy in Sequential Monte Carlo for Constrained Sampling Problems

Sequential Monte Carlo for cut-Bayesian posterior computation

SMC Is All You Need: Parallel Strong Scaling

A Sequential Monte Carlo Algorithm to Incorporate Model Uncertainty in Bayesian Sequential Design

Hamiltonian sequential Monte Carlo with application to consumer choice behavior

Optimised Annealed Sequential Monte Carlo Samplers

An invitation to sequential Monte Carlo samplers

Sequential quasi-Monte Carlo: Introduction for Non-Experts, Dimension Reduction, Application to Partly Observed Diffusion Processes

vSMC: Parallel Sequential Monte Carlo in C++

Simulation based sequential Monte Carlo methods for discretely observed Markov processes

Some Contributions to Sequential Monte Carlo Methods for Option Pricing

Multilevel Sequential${}^2$ Monte Carlo for Bayesian Inverse Problems

Parallelization and High-Performance Computing Enables Automated Statistical Inference of Multi-scale Models.

A Bayesian Optimization through Sequential Monte Carlo and Statistical Physics-Inspired Techniques