Bayesian Computing in the Undergraduate Statistics Curriculum

Jim Albert,Jingchen Hu
DOI: https://doi.org/10.48550/arXiv.2002.09716
2020-11-03
Abstract:Bayesian statistics has gained great momentum since the computational developments of the 1990s. Gradually, advances in Bayesian methodology and software have made Bayesian techniques much more accessible to applied statisticians and, in turn, have potentially transformed Bayesian education at the undergraduate level. This article provides an overview on the various options for implementing Bayesian computational methods motivated to achieve particular learning outcomes. The advantages and disadvantages of each computational method are described based on the authors' experience in using these methods in the classroom. The goal is to present guidance on the choice of computation for the instructors who are introducing Bayesian methods in their undergraduate statistics curriculum.
Computation
What problem does this paper attempt to address?
The main problem this paper attempts to address is how to effectively introduce and teach Bayesian computational methods in undergraduate statistics courses. Specifically, the authors aim to provide a comprehensive overview of various options for implementing Bayesian computational methods and propose activities and exercises tailored to specific learning objectives. The paper also discusses the teaching advantages and disadvantages of each computational method to help instructors choose the methods that best fit their courses. ### Background of the Paper - **Development of Bayesian Statistics**: Since the 1990s, Bayesian statistics has made significant progress, especially in computational techniques. - **Teaching Challenges**: Despite the increasing popularity of Bayesian methods in practical applications, introducing these methods in undergraduate education still faces challenges such as computational burden. ### Main Objectives - **Teaching Objectives**: - **Construction of Prior Distributions**: Students will learn how to construct prior distributions that reflect their subjective beliefs about unknown parameters. - **Implementation of Bayesian Inference**: Students will understand how to compute posterior distributions and perform marginal posterior inference for parameters. - **Learning from Data**: Students will understand how posterior distributions combine prior distributions and data information. - **Application of Predictive Distributions**: Students will understand various uses of predictive distributions, including prior predictive distributions and posterior predictive distributions. - **Simulation-Based Inference and Prediction**: Students will understand how to perform inference and prediction by drawing random samples from posterior distributions. - **Bayesian Models in Popular Statistical Methods**: Students will understand how to implement Bayesian models in common statistical methods such as regression and multilevel modeling. ### Main Content - **Non-Simulation Methods**: - **Discrete Bayesian**: Introduce Bayesian thinking through discrete distributions, suitable for simple teaching examples. - **Conjugate Analysis**: Simplify computations using conjugate priors, suitable for one-parameter exponential family distributions. - **Normal Approximation**: Approximate posterior distributions using normal curves, suitable for quick approximations of complex models. - **Simulation-Based Methods**: - **Markov Chain Monte Carlo (MCMC)**: Use Gibbs sampling and Metropolis algorithms to simulate posterior distributions. - **JAGS**: A popular MCMC software tool for Bayesian model computation. ### Two Examples - **Emergency Department Visits**: Study the average number of hourly visits to a hospital emergency department using a Poisson distribution model. - **Comparison of Facebook User Proportions**: Compare the proportions of male and female college students using Facebook through a logistic regression model. ### Conclusion - **Teaching Recommendations**: The paper provides guidance for instructors on choosing appropriate computational methods, including the advantages and disadvantages of each method, as well as corresponding teaching activities and exercises. In summary, this paper aims to provide instructors with a comprehensive guide to introducing Bayesian computational methods in undergraduate statistics courses, helping students better understand and apply Bayesian statistical methods.