Abstract:We propose a new prior distribution for classical (nonhierarchical) logistic regression models, constructed by first scaling all nonbinary variables to have mean 0 and standard deviation 0.5, and then placing independent Student-$t$ prior distributions on the coefficients. As a default choice, we recommend the Cauchy distribution with center 0 and scale 2.5, which in the simplest setting is a longer-tailed version of the distribution attained by assuming one-half additional success and one-half additional failure in a logistic regression. Cross-validation on a corpus of datasets shows the Cauchy class of prior distributions to outperform existing implementations of Gaussian and Laplace priors. We recommend this prior distribution as a default choice for routine applied use. It has the advantage of always giving answers, even when there is complete separation in logistic regression (a common problem, even when the sample size is large and the number of predictors is small), and also automatically applying more shrinkage to higher-order interactions. This can be useful in routine data analysis as well as in automated procedures such as chained equations for missing-data imputation. We implement a procedure to fit generalized linear models in R with the Student-$t$ prior distribution by incorporating an approximate EM algorithm into the usual iteratively weighted least squares. We illustrate with several applications, including a series of logistic regressions predicting voting preferences, a small bioassay experiment, and an imputation model for a public health data set.

Logistic or not Logistic?

On the E ffi ciency of Generalized Likelihood Ratio Tests

Goodness-of-fit testing in high-dimensional generalized linear models

A comprehensive comparison of goodness-of-fit tests for logistic regression models

Using a monotonic density ratio model to increase the power of the goodness-of-fit test for logistic regression models with case-control data

Is the Gompertz family a good fit to your data?

Characteristic Function-Based Testing for Multifactor Continuous-Time Markov Models Via Nonparametric Regression

A Loss Function Approach to Model Specification Testing and Its Relative Efficiency

Goodness-of-fit test for count distributions with finite second moment

A Viable Method for Goodness-of-fit Test in Maximum Likelihood Fit

A weakly informative default prior distribution for logistic and other regression models

Testing goodness-of-fit for logistic regression

On classes of consistent tests for the Type I Pareto distribution based on a characterization involving order statistics

On goodness-of-fit tests for arbitrary multivariate models

A Goodness-of-fit Test for Parametric and Semi-Parametric Models in Multiresponse Regression

A goodness-of-fit test for the functional linear model with functional response

The generalized odd log-logistic family of distributions: properties, regression models and applications

Almost goodness-of-fit tests

New classes of goodness‐of‐fit tests for the one‐sided Lévy distribution

Integrated empirical measures and generalizations of classical goodness-of-fit statistics

Characterizations of the Logistic and Related Distributions