Abstract:In developing regression models, data analysts are often faced with many predictor variables that may influence an outcome variable. After more than half a century of research, the 'best' way of selecting a multivariable model is still unresolved. It is generally agreed that subject matter knowledge, when available, should guide model building. However, such knowledge is often limited, and data-dependent model building is required. We limit the scope of the modelling exercise to selecting important predictors and choosing interpretable and transportable functions for continuous predictors. Assuming linear functions, stepwise selection and all-subset strategies are discussed; the key tuning parameters are the nominal P-value for testing a variable for inclusion and the penalty for model complexity, respectively. We argue that stepwise procedures perform better than a literature-based assessment would suggest. Concerning selection of functional form for continuous predictors, the principal competitors are fractional polynomial functions and various types of spline techniques. We note that a rigorous selection strategy known as multivariable fractional polynomials (MFP) has been developed. No spline-based procedure for simultaneously selecting variables and functional forms has found wide acceptance. Results of FP and spline modelling are compared in two data sets. It is shown that spline modelling, while extremely flexible, can generate fitted curves with uninterpretable 'wiggles', particularly when automatic methods for choosing the smoothness are employed. We give general recommendations to practitioners for carrying out variable and function selection. While acknowledging that further research is needed, we argue why MFP is our preferred approach for multivariable model building with continuous covariates.

SELECTING THE “BEST” REGRESSION WHEN FACED WITH MISSING OBSERVATIONS

Comparing Regressions when Some Predictor Values Are Missing

Regression with Highly Correlated Predictors: Variable Omission Is Not the Solution

Residuals and Regression Diagnostics: Focusing on Logistic Regression

Penalized Independence Rule for Testing High-Dimensional Hypotheses

Predicting Multivariate Responses in Multiple Linear Regression

Examining variable selection methods for the predictive performance of regression models and the proportion of selected variables and selected random variables

Multicollinearity and Regression Analysis

Regression with missing Ys: An improved strategy for analyzing multiply imputed data

Selection Inconsistency for Factor-Augmented Regressions

Diagnosing missing always at random in multivariate data

THE ASSESSMENT OF A TREATMENT EFFECT WHEN A COVARIATE IS OBSERVED ON A SUBSET OF THE UNITS: I. SIMPLE ESTIMATORS

Pearson's correlation under the scope: Assessment of the efficiency of Pearson's correlation to select predictor variables for linear models

Selection of important variables and determination of functional form for continuous predictors in multivariable model building

The Analysis of Social-Science Data with Missing Values

Flexible variable selection in the presence of missing data

Statistical Inference for a Robust Measure of Multiple Correlation

Statistical Analysis with Missing Data

Random forest analysis and lasso regression outperform traditional methods in identifying missing data auxiliary variables when the MAR mechanism is nonlinear (p.s. Stop using Little's MCAR test)

Assessing Variable Importance for Best Subset Selection

Model selection and estimation in regression with grouped variables