Abstract:BackgroundWhen developing risk models for binary data with small or sparse data sets, the standard maximum likelihood estimation (MLE) based logistic regression faces several problems including biased or infinite estimate of the regression coefficient and frequent convergence failure of the likelihood due to separation. The problem of separation occurs commonly even if sample size is large but there is sufficient number of strong predictors. In the presence of separation, even if one develops the model, it produces overfitted model with poor predictive performance. Firth-and logF-type penalized regression methods are popular alternative to MLE, particularly for solving separation-problem. Despite the attractive advantages, their use in risk prediction is very limited. This paper evaluated these methods in risk prediction in comparison with MLE and other commonly used penalized methods such as ridge.MethodsThe predictive performance of the methods was evaluated through assessing calibration, discrimination and overall predictive performance using an extensive simulation study. Further an illustration of the methods were provided using a real data example with low prevalence of outcome.ResultsThe MLE showed poor performance in risk prediction in small or sparse data sets. All penalized methods offered some improvements in calibration, discrimination and overall predictive performance. Although the Firth-and logF-type methods showed almost equal amount of improvement, Firth-type penalization produces some bias in the average predicted probability, and the amount of bias is even larger than that produced by MLE. Of the logF(1,1) and logF(2,2) penalization, logF(2,2) provides slight bias in the estimate of regression coefficient of binary predictor and logF(1,1) performed better in all aspects. Similarly, ridge performed well in discrimination and overall predictive performance but it often produces underfitted model and has high rate of convergence failure (even the rate is higher than that for MLE), probably due to the separation problem.ConclusionsThe logF-type penalized method, particularly logF(1,1) could be used in practice when developing risk model for small or sparse data sets.

Logarithmic type predictive estimators under simple random sampling

Enhanced Estimation of Population Mean in the Presence of Auxiliary Information

Improved Ratio Type Estimators of Population Mean Based on Median of a Study Variable and an Auxiliary Variable

Precise Rates in the Law of Logarithm for I.i.d. Random Variables

Improved Estimation of Population Mean Through Known Conventional and Non-Conventional Measures of Auxiliary Variable

Optimized estimation for population mean using conventional and non-conventional measures under the joint influence of measurement error and non-response

Optimizing Variance Estimation in Stratified Random Sampling through a Log-Type Estimator for Finite Populations

Small area estimation using design based direct and synthetic logarithmic estimators

Enhanced direct and synthetic estimators for domain mean with simulation and applications

Novel logarithmic imputation procedures using multi auxiliary information under ranked set sampling

Electronic structure study by means of X-ray spectroscopy and theoretical calculations of the "ferric star" single molecule magnet

Precise Rates in the Law of the Logarithm for Negatively Associated Random Variables

A Provably Accurate Randomized Sampling Algorithm for Logistic Regression

Memory type general class of estimators for population variance under simple random sampling

Double Exponential Ratio Estimator of a Finite Population Variance under Extreme Values in Simple Random Sampling

Statistical Inference for Lognormal Distribution with Type-I Progressive Hybrid Censored Data

Efficient Estimators of Finite Population Mean Based on Extreme Values in Simple Random Sampling

Utilising bivariate auxiliary information for enhanced estimation of population mean under simple and stratified random sampling schemes

Performance of Firth-and logF-type penalized methods in risk prediction for small or sparse binary data

Estimating the failure rate of the log-logistic distribution by smooth adaptive and bias-correction methods

Robust estimators for the log-logistic model based on ranked set sampling