Abstract:We propose a new prior distribution for classical (nonhierarchical) logistic regression models, constructed by first scaling all nonbinary variables to have mean 0 and standard deviation 0.5, and then placing independent Student-$t$ prior distributions on the coefficients. As a default choice, we recommend the Cauchy distribution with center 0 and scale 2.5, which in the simplest setting is a longer-tailed version of the distribution attained by assuming one-half additional success and one-half additional failure in a logistic regression. Cross-validation on a corpus of datasets shows the Cauchy class of prior distributions to outperform existing implementations of Gaussian and Laplace priors. We recommend this prior distribution as a default choice for routine applied use. It has the advantage of always giving answers, even when there is complete separation in logistic regression (a common problem, even when the sample size is large and the number of predictors is small), and also automatically applying more shrinkage to higher-order interactions. This can be useful in routine data analysis as well as in automated procedures such as chained equations for missing-data imputation. We implement a procedure to fit generalized linear models in R with the Student-$t$ prior distribution by incorporating an approximate EM algorithm into the usual iteratively weighted least squares. We illustrate with several applications, including a series of logistic regressions predicting voting preferences, a small bioassay experiment, and an imputation model for a public health data set.

A new distribution for robust least squares

A new multivariate t distribution with variant tail weights and its application in robust regression analysis

The multivariate tail-inflated normal distribution and its application in finance

A Multivariate Skew-Normal-Tukey-h Distribution

A novel flexible T-X family for generating new distributions with applications to lifetime data

T-normal family of distributions: a new approach to generalize the normal distribution

A new robust class of skew elliptical distributions

Distribution-Free Robust Linear Regression

Mastering the Body and Tail Shape of a Distribution

A New Class of Symmetric Distributions Including the Elliptically Symmetric Logistic

Log-regularly varying scale mixture of normals for robust regression

Bayesian Inference and Application of Robust Growth Curve Models Using Student'S T Distribution

A new generalized normal distribution: Properties and applications

A new (T-X ) family of distributions: properties, discretization and estimation with applications

DS Normal Distribution: Properties and Applications

A new approach in two-dimensional heavy-tailed distributions

Robustness and accuracy of methods for high dimensional data analysis based on Student's t statistic

A weakly informative default prior distribution for logistic and other regression models

A New One Parameter Bimodal Skew Logistic Distribution and its Applications

The Topp–Leone odd log-logistic family of distributions

The generalized odd log-logistic family of distributions: properties, regression models and applications