Abstract:Traditional variable-selection strategies in generalized linear models (GLMs) seek to optimize a measure of predictive accuracy without regard for the cost of data collection. When the purpose of such model building is the creation of predictive scales to be used in future studies with constrained budgets, the standard approach may not be optimal. We propose a Bayesian decision-theoretic framework for variable selection in binary-outcome GLMs where the budget for data collection is constrained and potential predictors may vary considerably in cost. The method is illustrated using data from a large study of quality of hospital care in the U.S. in the 1980s. Especially when the number of available predictors p is large, it is important to use an appropriate technique for optimization (e.g., in an application presented here where p = 83, the space over which we search has 283 ≐ 1025 elements, which is too large to explore using brute force enumeration). Specifically, we investigate simulated annealing (SA), genetic algorithms (GAs), and the tabu search (TS) method used in operations research, and we develop a context-specific version of SA, improved simulated annealing (ISA), that performs better than its generic counterpart. When p was modest in our study, we found that GAs performed relatively poorly for all but the very best user-defined input configurations, generic SA did not perform well, and TS had excellent median performance and was much less sensitive to suboptimal choice of user-defined inputs. When p was large in our study, the best versions of GA and ISA outperformed TS and generic SA. Our results are presented in the context of health policy but can apply to other quality assessment settings with dichotomous outcomes as well.

To Select or to Weigh: A Comparative Study of Linear Combination Schemes for SuperParent-One-Dependence Estimators

To select or to weigh: a comparative study of model selection and model weighing for SPODE ensembles

Ensemble selection for superparent-one-dependence estimators

Instance-based weighting filter for superparent one-dependence estimators

Efficient Learning Ensemble SuperParent-one-dependence Estimator by Maximizing Conditional Log Likelihood

Model Weighting for One-Dependence Estimators by Measuring the Independence Assumptions

Semi-supervised Weighting for Averaged One-Dependence Estimators

Weighted One-Dependence Forests Classifier.

Self-Adaptive Attribute Value Weighting for Averaged One-Dependence Estimators.

Alleviating the Attribute Conditional Independence and I.I.D. Assumptions of Averaged One-Dependence Estimator by Double Weighting

Multi-Slot Distributed Measurement Selection: A Sparsity Learning Approach

Attribute Value Weighted Averaged One-Dependence Estimators with Kullback–Leibler Divergence

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Alleviating the independence assumptions of averaged one-dependence estimators by model weighting

Extracting Credible Dependencies for Averaged One-Dependence Estimator Analysis

Attribute Value Weighted Average of One-Dependence Estimators

Averaged Tree-Augmented One-Dependence Estimators

Ranking and Combining Latent Structured Predictive Scores without Labeled Data

Flexible model weighting for one-dependence estimators based on point-wise independence analysis

Comparing Stochastic Optimization Methods for Variable Selection in Binary Outcome Prediction, With Application to Health Policy

Nonparametric Assessment of Variable Selection and Ranking Algorithms