Abstract:This text is intended for a broad audience as both an introduction to predictive models as well as a guide to applying them. Non-mathematical readers will appreciate the intuitive explanations of the techniques while an emphasis on problem-solving with real data across a wide variety of applications will aid practitioners who wish to extend their expertise. Readers should have knowledge of basic statistical ideas, such as correlation and linear regression analysis. While the text is biased against complex equations, a mathematical background is needed for advanced topics. Dr. Kuhn is a Director of Non-Clinical Statistics at Pfizer Global R&D in Groton Connecticut. He has been applying predictive models in the pharmaceutical and diagnostic industries for over 15 years and is the author of a number of R packages. Dr. Johnson has more than a decade of statistical consulting and predictive modeling experience in pharmaceutical research and development. He is a co-founder of Arbor Analytics, a firm specializing in predictive modeling and is a former Director of Statistics at Pfizer Global R&D. His scholarly work centers on the application and development of statistical methodology and learning algorithms. Applied Predictive Modeling covers the overall predictive modeling process, beginning with the crucial steps of data preprocessing, data splitting and foundations of model tuning. The text then provides intuitive explanations of numerous common and modern regression and classification techniques, always with an emphasis on illustrating and solving real data problems. Addressing practical concerns extends beyond model fitting to topics such as handling class imbalance, selecting predictors, and pinpointing causes of poor model performance—all of which are problems that occur frequently in practice. The text illustrates all parts of the modeling process through many hands-on, real-life examples. And every chapter contains extensive R code for each step of the process. The data sets and corresponding code are available in the book’s companion AppliedPredictiveModeling R package, which is freely available on the CRAN archive. This multi-purpose text can be used as an introduction to predictive models and the overall modeling process, a practitioner’s reference handbook, or as a text for advanced undergraduate or graduate level predictive modeling courses. To that end, each chapter contains problem sets to help solidify the covered concepts and uses data available in the book’s R package. Readers and students interested in implementing the methods should have some basic knowledge of R. And a handful of the more advanced topics require some mathematical knowledge.

Feature Engineering and Selection: A Practical Approach for Predictive Models

An Empirical Analysis of Feature Engineering for Predictive Modeling

Feature Selection: A Data Perspective

Model Selection Techniques -- An Overview

Special issue on feature engineering editorial

A practical guide to selecting models for exploration, inference, and prediction in ecology

Feature Selection: Role in Designing Smart Healthcare Models

Feature selection using principal component analysis and genetic algorithm

The Significance of Feature Selection Techniques in Machine Learning

Statistically Enhanced Learning: a feature engineering framework to boost (any) learning algorithms

Applied Predictive Modeling

Enhancing data pipelines for forecasting student performance: integrating feature selection with cross-validation

Causality-based Feature Selection: Methods and Evaluations

A comprehensive survey on feature selection in the various fields of machine learning

MFeature: Towards high performance evolutionary tools for feature selection

Causality-based Feature Selection

<i>MFeature</i>: Towards high performance evolutionary tools for feature selection

Analysis and comparison of feature selection methods towards performance and stability

A Study on Feature Selection Techniques in Educational Data Mining

A novel feature selection method based on global sensitivity analysis with application in machine learning-based prediction model

FeatureEnVi: Visual Analytics for Feature Engineering Using Stepwise Selection and Semi-Automatic Extraction Approaches