Abstract:Summary Generalised linear mixed regression models are fundamental in statistics. Modelling random effects that are shared by individuals allows for correlation among those individuals. There are many methods and statistical packages available for analysing data using these models. Most require some form of numerical or analytic approximation because the likelihood function generally involves intractable integrals over the latents. The Bayesian approach avoids this issue by iteratively sampling the full conditional distributions for various blocks of parameters and latent random effects. Depending on the choice of the prior, some full conditionals are recognisable while others are not. In this paper we develop a novel normal approximation for the random effects full conditional, establish its asymptotic correctness and evaluate how well it performs. We make the case for hierarchical binomial and Poisson regression models with canonical link functions, for hierarchical gamma regression models with log link and for other cases. We also develop what we term a sufficient reduction (SR) approach to the Markov Chain Monte Carlo algorithm that allows for making inferences about all model parameters by replacing the full conditional for the latent variables with a considerably reduced dimensional function of the latents. We expect that this approximation could be quite useful in situations where there are a very large number of latent effects, which may be occurring in an increasingly 'Big Data' world. In the sequel, we compare our methods with INLA, which is a particularly popular method and which has been shown to be excellent in terms of speed and accuracy across a variety of settings. Our methods appear to be comparable to theirs in terms of accuracy, while INLA was faster, for the settings we considered. In addition, we note that our methods and those of others that involve Gibbs sampling trivially handle parameters that are functions of multiple parameters, while INLA approximations do not. Our primary illustration is for a three‐level hierarchical binomial regression model for data on health outcomes for patients who are clustered within physicians who are clustered within particular hospitals or hospital systems.

Hierarchical Bayesian Modeling and Randomized Response Method for Inferring the Sensitive-Nature Proportion

A simple Bayesian model to estimate proportions and ratios from count data with a hierarchical error structure with an application to droplet digital PCR experiments

Bayesian estimation for longitudinal data in a joint model with HPCs

A Probability Proportional to Size Estimation of a Rare Sensitive Attribute Using a Partial Randomized Response Model with Poisson Distribution

A hierarchical Bayesian approach for estimating the origin of a mixed population

A Two‐stage Bayesian Small Area Estimation Approach for Proportions

Approximate inferences for Bayesian hierarchical generalised linear regression models

A Bayesian hierarchical modeling approach to combining multiple data sources: A case study in size estimation

A Bayesian hierarchical small-area population model accounting for data source specific methodologies from American Community Survey, Population Estimates Program, and Decennial Census data

Approximate Gibbs Sampler for Efficient Inference of Hierarchical Bayesian Models for Grouped Count Data

Nonparametric Bayes models for mixed-scale longitudinal surveys

Direct-Assisted Bayesian Unit-level Modeling for Small Area Estimation of Rare Event Prevalence

A Hierarchical Bayes Unit-Level Small Area Estimation Model for Normal Mixture Populations

Scalable Estimation of Multinomial Response Models with Random Consideration Sets

Mendelian Randomization when Many Instruments are Invalid: Hierarchical Empirical Bayes Estimation

Sparse Bayesian Hierarchical Modeling of High-dimensional Clustering Problems

A novel Bayesian computational approach for bridge-randomized quantile regression in high dimensional models

Leveraging single-case results to Bayesian hierarchical modelling

A Bayesian Nonparametric Model for Predicting Pregnancy Outcomes Using Longitudinal Profiles

Bayesian Models for Heterogeneous Personalized Health Data

A New Non‐randomized Model for Analysing Sensitive Questions with Binary Outcomes