Abstract:The practical use of nonparametric Bayesian methods requires the availability of efficient algorithms for posterior inference. The inherently serial nature of traditional Markov chain Monte Carlo (MCMC) methods imposes limitations on their efficiency and scalability. In recent years, there has been a surge of research activity devoted to developing alternative implementation methods that target parallel computing environments. Sequential Monte Carlo (SMC), also known as a particle filter, has been gaining popularity due to its desirable properties. SMC uses a genetic mutation-selection sampling approach with a set of particles representing the posterior distribution of a stochastic process. We propose to enhance the performance of SMC by utilizing Hamiltonian transition dynamics in the particle transition phase, in place of random walk used in the previous literature. We call the resulting procedure Hamiltonian Sequential Monte Carlo (HSMC). Hamiltonian transition dynamics have been shown to yield superior mixing and convergence properties relative to random walk transition dynamics in the context of MCMC procedures. The rationale behind HSMC is to translate such gains to the SMC environment. HSMC will facilitate practical estimation of models with complicated latent structures, such as nonparametric individual unobserved heterogeneity, that are otherwise difficult to implement. We demonstrate the behavior of HSMC in a challenging simulation study and contrast its favorable performance with SMC and other alternative approaches. We then apply HSMC to a panel discrete choice model with nonparametric consumer heterogeneity, allowing for multiple modes, asymmetries, and data-driven clustering, providing insights for consumer segmentation, individual level marketing, and price micromanagement.

Fitting Bayesian item response models in Stata and Stan

Bayesian Item Response Modeling in R with brms and Stan

Flexible and efficient Bayesian pharmacometrics modeling using Stan and Torsten, Part I

Bayesian Survival Analysis Using the rstanarm R Package

Bayesian Survival Analysis in STAN for Improved Measuring of Uncertainty in Parameter Estimates

Comparing the MCMC Efficiency of JAGS and Stan for the Multi-Level Intercept-Only Model in the Covariance- and Mean-Based and Classic Parametrization

Efficient Bayesian Structural Equation Modeling in Stan

Fitting Multilevel Vector Autoregressive Models in Stan, JAGS, and Mplus

Hamiltonian sequential Monte Carlo with application to consumer choice behavior

Bayesian Regression for a Dirichlet Distributed Response using Stan

A Markov Chain Monte-Carlo Approach to Dose-Response Optimization Using Probabilistic Programming (RStan)

varstan: An R package for Bayesian analysis of structured time series models with Stan

Markov chain Monte Carlo methods in biostatistics

A Point Mass Proposal Method for Bayesian State-Space Model Fitting

The Seven-parameter Diffusion Model: an Implementation in Stan for Bayesian Analyses

MetaStan: An R package for Bayesian (model-based) meta-analysis using Stan

posteriordb: Testing, Benchmarking and Developing Bayesian Inference Algorithms

What are the advantages of MCMC based inference in latent variable models?

A frequentist two-sample test based on Bayesian model selection

Bayesian Variable Selection in Linear Regression in One Pass for Large Data Sets

Bayesian paired comparison with the bpcs package