Abstract:Abstract Background In meta-analyses of a binary outcome, double zero events in some studies cause a critical methodology problem. The generalized linear mixed model (GLMM) has been proposed as a valid statistical tool for pooling such data. Three parameter estimation methods, including the Laplace approximation (LA), penalized quasi-likelihood (PQL) and adaptive Gauss–Hermite quadrature (AGHQ) were frequently used in the GLMM. However, the performance of GLMM via these estimation methods is unclear in meta-analysis with zero events. Methods A simulation study was conducted to compare the performance. We fitted five random-effects GLMMs and estimated the results through the LA, PQL and AGHQ methods, respectively. Each scenario conducted 20,000 simulation iterations. The data from Cochrane Database of Systematic Reviews were collected to form the simulation settings. The estimation methods were compared in terms of the convergence rate, bias, mean square error, and coverage probability. Results Our results suggested that when the total events were insufficient in either of the arms, the GLMMs did not show good point estimation to pool studies of rare events. The AGHQ method did not show better properties than the LA estimation in terms of convergence rate, bias, coverage, and possibility to produce very large odds ratios. In addition, although the PQL had some advantages, it was not the preferred option due to its low convergence rate in some situations, and the suboptimal point and variance estimation compared to the LA. Conclusion The GLMM is an alternative for meta-analysis of rare events and is especially useful in the presence of zero-events studies, while at least 10 total events in both arms is recommended when employing GLMM for meta-analysis. The penalized quasi-likelihood and adaptive Gauss–Hermite quadrature are not superior to the Laplace approximation for rare events and thus they are not recommended.

A general framework for the use of logistic regression models in meta-analysis

Guidance for the utility of linear models in meta-analysis of genetic association studies of binary phenotypes

A re-analysis of about 60,000 sparse data meta-analyses suggests that using an adequate method for pooling matters

A framework for meta-analysis of prediction model studies with binary and time-to-event outcomes

Covariate-adjusted response-adaptive designs for generalized linear models

Laplace approximation, penalized quasi-likelihood, and adaptive Gauss–Hermite quadrature for generalized linear mixed models: towards meta-analysis of binary outcome with sparse data

Comparison of random‐effects meta‐analysis models for the relative risk in the case of rare events: A simulation study

Model Building Strategy for Logistic Regression: Purposeful Selection

On the comparison of regression coefficients across multiple logistic models with binary predictors

ZIBGLMM: Zero-Inflated Bivariate Generalized Linear Mixed Model for Meta-Analysis with Double-Zero-Event Studies

The use of one-stage meta-analytic method based on individual participant data for binary adverse events under the rule of three: a simulation study.

Individual Patient Data Meta-Analysis of Survival Data Using Poisson Regression Models

Intermediate and advanced topics in multilevel logistic regression analysis

Explaining heterogeneity in meta-analysis: a comparison of methods

Logistic and multinomial-logit models: A brief review on their modifications and extensions

Meta‐analysis of continuous outcome data from individual patients

Meta-analysis of dichotomous and ordinal tests without a gold standard

A Semiparametric Bayesian Approach to Binomial Distribution Logistic Mixed-Effects Models for Longitudinal Data

Non‐parametric logistic and proportional odds regression

Covariate heterogeneity in meta‐analysis: criteria for deciding between meta‐regression and individual patient data

Global and Simultaneous Hypothesis Testing for High-Dimensional Logistic Regression Models