Abstract:One component of precision medicine is to construct prediction models with their predictive ability as high as possible, e.g. to enable individual risk prediction. In genetic epidemiology, complex diseases have a polygenic basis and a common assumption is that biological and genetic features affect the outcome under consideration via interactions. In the case of omics data, the use of standard approaches such as generalized linear models may be suboptimal and machine learning methods are appealing to make individual predictions. However, most of these algorithms focus mostly on main or marginal effects of the single features in a dataset. On the other hand, the detection of interacting features is an active area of research in the realm of genetic epidemiology. One big class of algorithms to detect interacting features is based on the multifactor dimensionality reduction (MDR). Here, we extend the model-based MDR (MB-MDR), a powerful extension of the original MDR algorithm, to enable interaction empowered individual prediction. Using a comprehensive simulation study we show that our new algorithm can use information hidden in interactions more efficiently than two other state-of-the-art algorithms, namely the Random Forest and Elastic Net, and clearly outperforms these if interactions are present. The performance of these algorithms is comparable if no interactions are present. Further, we show that our new algorithm is applicable to real data by comparing the performance of the three algorithms on a dataset of rheumatoid arthritis cases and healthy controls. As our new algorithm is not only applicable to biological/genetic data but to all datasets with discrete features, it may have practical implications in other applications as well, and we made our method available as an R package.

Learning interactions through hierarchical group-lasso regularization

A lasso for hierarchical interactions

Reluctant Interaction Modeling in Generalized Linear Models

High-dimensional Interactions Detection with Sparse Principal Hessian Matrix

Group Regularized Estimation under Structural Hierarchy

Pliable lasso for the multinomial logistic regression

Pliable Lasso for the Support Vector Machine

Integrative interaction analysis using threshold gradient directed regularization: Integrative interaction analysis

Nonnegative hierarchical lasso with a mixed (1,1/2)-penalty and a fast solver

A General Framework for Identifying Hierarchical Interactions and Its Application to Genomics Data

Interaction Measures, Partition Lattices and Kernel Tests for High-Order Interactions

High-order covariate interacted Lasso for feature selection.

A binarization approach to model interactions between categorical predictors in Generalized Linear Models

Hierarchical selection of genetic and gene by environment interaction effects in high-dimensional mixed models

Penalized Interaction Estimation for Ultrahigh Dimensional Quadratic Regression

A Self-Penalizing Objective Function for Scalable Interaction Detection

Empowering individual trait prediction using interactions

Higher-order interactions in statistical physics and machine learning: A model-independent solution to the inverse problem at equilibrium

Nonlinear Interaction Detection Through Model-Based Sufficient Dimension Reduction

Predicting pairwise interaction affinities with l0-penalized least squares–a nonsmooth bi-objective optimization based approach*

Computational Tools for Probing Interactions in Multiple Linear Regression, Multilevel Modeling, and Latent Curve Analysis