Abstract:Predictive modeling often ignores interaction effects among predictors in high-dimensional data because of analytical and computational challenges. Research in interaction selection has been galvanized along with methodological and computational advances. In this study, we aim to investigate the performance of two types of predictive algorithms that can perform interaction selection. Specifically, we compare the predictive performance and interaction selection accuracy of both penalty-based and tree-based predictive algorithms. Penalty-based algorithms included in our comparative study are the regularization path algorithm under the marginality principle (RAMP), the least absolute shrinkage selector operator (LASSO), the smoothed clipped absolute deviance (SCAD), and the minimax concave penalty (MCP). The tree-based algorithms considered are random forest (RF) and iterative random forest (iRF). We evaluate the effectiveness of these algorithms under various regression and classification models with varying structures and dimensions. We assess predictive performance using the mean squared error for regression and accuracy, sensitivity, specificity, balanced accuracy, and F1 score for classification. We use interaction coverage to judge the algorithm’s efficacy for interaction selection. Our findings reveal that the effectiveness of the selected algorithms varies depending on the number of predictors (data dimension) and the structure of the data-generating model, i.e., linear or nonlinear, hierarchical or non-hierarchical. There were at least one or more scenarios that favored each of the algorithms included in this study. However, from the general pattern, we are able to recommend one or more specific algorithm(s) for some specific scenarios. Our analysis helps clarify each algorithm’s strengths and limitations, offering guidance to researchers and data analysts in choosing an appropriate algorithm for their predictive modeling task based on their data structure.

Apply Classification Tree to Automatically Screen Some Potential Interaction Factors in Logistic Regression

Study on the Application of Classification Tree Model in Screening the Risk Factors of Malignant Tumor

An Automatic Interaction Detection Hybrid Model for Bankcard Response Classification

A Novel Fuzzy Classification to Enhance Software Regression Testing

Interaction Selection and Prediction Performance in High-Dimensional Data: A Comparative Study of Statistical and Tree-Based Methods

Logistic and ZIP Regression Model for Forest Fire Data

Analyze Additive and Interaction Effects via Collaborative Trees

Subgroup identification in clinical trials: an overview of available methods and their implementations with R

Residuals and Regression Diagnostics: Focusing on Logistic Regression

Model Building Strategy for Logistic Regression: Purposeful Selection

An Information Analysis on Modeling Interaction Effects in Logistic Regression

Application of a Decision Tree Model for Predicting Diabetic Retinopathy

Applying Random Forest To Drive Recommendation

The Use of Classification Trees for Bioinformatics

Simulation Studies on Identification of Interaction Markers Representing QTL Epistasis by Stepwise Regression

Novel Design of Decision-Tree-Based Support Vector Machines Multi-Class Classifier

Partial Least Squares Regression Trees for Multivariate Response Data With Multicollinear Predictors

Main and Interaction Effects Selection for Quadratic Discriminant Analysis via Penalized Linear Regression

Combination Classification Method for Customer Relationship Management

APPLYING THE CLASSIFICATION TREE MODEL IN CREDIT RISK ASSESSMENT

Interaction screening in high-dimensional multi-response regression via projected distance correlation