Abstract:<h3>Background</h3><p>Despite its popularity, issues concerning the estimation of power in multilevel logistic regression models are prevalent because of the complexity involved in its calculation (i.e., computer-simulation-based approaches). These issues are further compounded by the fact that the distribution of the predictors can play a role in the power to estimate these effects. To address both matters, we present a sample of cases documenting the influence that predictor distribution have on statistical power as well as a user-friendly, web-based application to conduct power analysis for multilevel logistic regression.</p><h3>Method</h3><p>Computer simulations are implemented to estimate statistical power in multilevel logistic regression with varying numbers of clusters, varying cluster sample sizes, and non-normal and non-symmetrical distributions of the Level 1/2 predictors. Power curves were simulated to see in what ways non-normal/unbalanced distributions of a binary predictor and a continuous predictor affect the detection of population effect sizes for main effects, a cross-level interaction and the variance of the random effects.</p><h3>Results</h3><p>Skewed continuous predictors and unbalanced binary ones require larger sample sizes at both levels than balanced binary predictors and normally-distributed continuous ones. In the most extreme case of imbalance (10% incidence) and skewness of a chi-square distribution with 1 degree of freedom, even 110 Level 2 units and 100 Level 1 units were not sufficient for all predictors to reach power of 80%, mostly hovering at around 50% with the exception of the skewed, continuous Level 2 predictor.</p><h3>Conclusions</h3><p>Given the complex interactive influence among sample sizes, effect sizes and predictor distribution characteristics, it seems unwarranted to make generic rule-of-thumb sample size recommendations for multilevel logistic regression, aside from the fact that larger sample sizes are required when the distributions of the predictors are not symmetric or balanced. The more skewed or imbalanced the predictor is, the larger the sample size requirements. To assist researchers in planning research studies, a user-friendly web application that conducts power analysis via computer simulations in the R programming language is provided. With this web application, users can conduct simulations, tailored to their study design, to estimate statistical power for multilevel logistic regression models.</p>

Power analysis for a linear regression model when regressors are matrix sampled

Linear Mixed-Effects Models for Dependent Data: Power and Accuracy in Parameter Estimation.

Power Analysis for Cross-Sectional and Longitudinal Study Designs.

Calculating the Statistical Power of the Univariate and the Multivariate Repeated Measures Analyses of Variance for the Single Group Case Under Various Conditions

Power Analysis for Experiments with Clustered Data, Ratio Metrics, and Regression for Covariate Adjustment

Power and Sample Size Calculations for Rerandomization

An Application of Matrix Power Series to Linear Models

Confidence regions for repeated measures ANOVA power curves based on estimated covariance

A Bayesian-motivated Test for High-Dimensional Linear Regression Models with Fixed Design Matrix

Parametric Models of Covariance Matrices for Repeated Measures: A Simulation Study on Fit, Error and Statistical Power in Mixed Linear Models

Power Analysis for Parameter Estimation in Structural Equation Modeling: A Discussion and Tutorial

Statistical Power Analysis for Multiple Regression/Correlation: A Computer Program

Improving the Use of Parallel Analysis by Accounting for Sampling Variability of the Observed Correlation Matrix

The analysis of repeated measurements: A quantitative research synthesis

Power Analysis and Sample Size Planning in ANCOVA Designs

The Projected Covariance Measure for assumption-lean variable significance testing

Provably Efficient Posterior Sampling for Sparse Linear Regression via Measure Decomposition

A new sample-size planning approach for person-specific VAR(1) studies: Predictive accuracy analysis

Towards a power analysis for PLS-based methods

Performance of Random Effects Model Estimators under Complex Sampling Designs

The relationship between statistical power and predictor distribution in multilevel logistic regression: a simulation-based approach