Abstract:BackgroundIn biomedical research, response variables are often encountered which have bounded support on the open unit interval - (0,1). Traditionally, researchers have attempted to estimate covariate effects on these types of response data using linear regression. Alternative modelling strategies may include: beta regression, variable-dispersion beta regression, and fractional logit regression models. This study employs a Monte Carlo simulation design to compare the statistical properties of the linear regression model to that of the more novel beta regression, variable-dispersion beta regression, and fractional logit regression models.MethodsIn the Monte Carlo experiment we assume a simple two sample design. We assume observations are realizations of independent draws from their respective probability models. The randomly simulated draws from the various probability models are chosen to emulate average proportion/percentage/rate differences of pre-specified magnitudes. Following simulation of the experimental data we estimate average proportion/percentage/rate differences. We compare the estimators in terms of bias, variance, type-1 error and power. Estimates of Monte Carlo error associated with these quantities are provided.ResultsIf response data are beta distributed with constant dispersion parameters across the two samples, then all models are unbiased and have reasonable type-1 error rates and power profiles. If the response data in the two samples have different dispersion parameters, then the simple beta regression model is biased. When the sample size is small (N0 = N1 = 25) linear regression has superior type-1 error rates compared to the other models. Small sample type-1 error rates can be improved in beta regression models using bias correction/reduction methods. In the power experiments, variable-dispersion beta regression and fractional logit regression models have slightly elevated power compared to linear regression models. Similar results were observed if the response data are generated from a discrete multinomial distribution with support on (0,1).ConclusionsThe linear regression model, the variable-dispersion beta regression model and the fractional logit regression model all perform well across the simulation experiments under consideration. When employing beta regression to estimate covariate effects on (0,1) response data, researchers should ensure their dispersion sub-model is properly specified, else inferential errors could arise.

A modified chi-square statistics of the linear estimator for inter-laboratory comparison

A note on extending Scheffé's modified multiple-comparison procedure to other analysis situations

On comparison of estimators for proportional error nonlinear regression models in the limit of small measurement error

When Pearson $χ^2$ and other divisible statistics are not goodness-of-fit tests

Improving Pearson's chi-squared test: hypothesis testing of distributions -- optimally

A test of measurement results with increased sensitivity to inconsistency

A novel statistical method for comparing effectiveness of two treatments-simulated randomized controlled trials

Asymptotic Intermediate Efficiency of the Chi-square and Likelihood Ratio Goodness of Fit Tests

A Consistent ICM-based $χ^2$ Specification Test

Comparisons of various estimates of the [math] statistic for quantifying between-study heterogeneity in meta-analysis

Multiple Comparisons of Several Log-normal Means under Heteroscedasticity

An Improvement on the Hotelling $T^2$ Test Using the Ledoit-Wolf Nonlinear Shrinkage Estimator

Quadratic Form based Multiple Contrast Tests for Comparison of Group Means

Assessing compatibility of two laboratories: formulations as a statistical hypothesis testing problem

A Monte Carlo simulation study comparing linear regression, beta regression, variable-dispersion beta regression and fractional logit regression at recovering average difference measures in a two sample design

An efficient asymptotic approach for testing monotone proportions assuming an underlying logit based order dose-response model

Testing two variances for superiority/non-inferiority and equivalence: Using the exhaustion algorithm for sample size allocation with cost

Decomposing Pearson's Χ2 Test: A Linear Regression and Its Departure from Linearity

A Critique and Improvement of the CL Common Language Effect Size Statistics of McGraw and Wong

Comparison of Difference Based Variance Estimators for Partially Linear Models

A modified regression method to test publication bias in meta-analyses with binary outcomes