Abstract:Predictive modeling often ignores interaction effects among predictors in high-dimensional data because of analytical and computational challenges. Research in interaction selection has been galvanized along with methodological and computational advances. In this study, we aim to investigate the performance of two types of predictive algorithms that can perform interaction selection. Specifically, we compare the predictive performance and interaction selection accuracy of both penalty-based and tree-based predictive algorithms. Penalty-based algorithms included in our comparative study are the regularization path algorithm under the marginality principle (RAMP), the least absolute shrinkage selector operator (LASSO), the smoothed clipped absolute deviance (SCAD), and the minimax concave penalty (MCP). The tree-based algorithms considered are random forest (RF) and iterative random forest (iRF). We evaluate the effectiveness of these algorithms under various regression and classification models with varying structures and dimensions. We assess predictive performance using the mean squared error for regression and accuracy, sensitivity, specificity, balanced accuracy, and F1 score for classification. We use interaction coverage to judge the algorithm’s efficacy for interaction selection. Our findings reveal that the effectiveness of the selected algorithms varies depending on the number of predictors (data dimension) and the structure of the data-generating model, i.e., linear or nonlinear, hierarchical or non-hierarchical. There were at least one or more scenarios that favored each of the algorithms included in this study. However, from the general pattern, we are able to recommend one or more specific algorithm(s) for some specific scenarios. Our analysis helps clarify each algorithm’s strengths and limitations, offering guidance to researchers and data analysts in choosing an appropriate algorithm for their predictive modeling task based on their data structure.

Revealing the Structure of Prediction Models Through Feature Interaction Detection

Feature Selection with Conditional Mutual Information Considering Feature Interaction

Error-controlled non-additive interaction discovery in machine learning models

Detecting Beneficial Feature Interactions for Recommender Systems

Hybrid Predictive Model: When an Interpretable Model Collaborates with a Black-box Model

Effective Model Integration Algorithm for Improving Link and Sign Prediction in Complex Networks

Asymmetric feature interaction for interpreting model predictions

Neural Hierarchical Factorization Machines for User's Event Sequence Analysis

Empowering individual trait prediction using interactions

Detecting Interaction for Quantitative Trait by Generalized Multifactor Dimensionality Reduction

High-dimensional Interactions Detection with Sparse Principal Hessian Matrix

Remote Sensing and Time Series Data Fused Multimodal Prediction Model Based on Interaction Analysis

Interaction Selection and Prediction Performance in High-Dimensional Data: A Comparative Study of Statistical and Tree-Based Methods

Bayesian feature interaction selection for factorization machines

Towards Unifying Feature Interaction Models for Click-Through Rate Prediction

A Novel Hybrid Feature Importance and Feature Interaction Detection Framework for Predictive Optimization in Industry 4.0 Applications

REPID: Regional Effect Plots with implicit Interaction Detection

High Dimensional Model Representation as a Glass Box in Supervised Machine Learning

Interaction Pursuit with Feature Screening and Selection

Recognising human interaction from videos by a discriminative model

Fast and More Powerful Selective Inference for Sparse High-Order Interaction Model