Abstract:Abstract Background In this era of data science-driven bioinformatics, machine learning research has focused on feature selection as users want more interpretation and post-hoc analyses for biomarker detection. However, when there are more features (i.e., transcripts) than samples (i.e., mice or human samples) in a study, it poses major statistical challenges in biomarker detection tasks as traditional statistical techniques are underpowered in high dimension. Second and third order interactions of these features pose a substantial combinatoric dimensional challenge. In computational biology, random forest ( RF ) classifiers are widely used due to their flexibility, powerful performance, their ability to rank features, and their robustness to the “P > > N ” high-dimensional limitation that many matrix regression algorithms face. We propose binomialRF, a feature selection technique in RFs that provides an alternative interpretation for features using a correlated binomial distribution and scales efficiently to analyze multiway interactions. Results In both simulations and validation studies using datasets from the TCGA and UCI repositories, binomialRF showed computational gains (up to 5 to 300 times faster) while maintaining competitive variable precision and recall in identifying biomarkers’ main effects and interactions. In two clinical studies, the binomialRF algorithm prioritizes previously-published relevant pathological molecular mechanisms (features) with high classification precision and recall using features alone, as well as with their statistical interactions alone. Conclusion binomialRF extends upon previous methods for identifying interpretable features in RFs and brings them together under a correlated binomial distribution to create an efficient hypothesis testing algorithm that identifies biomarkers’ main effects and interactions. Preliminary results in simulations demonstrate computational gains while retaining competitive model selection and classification accuracies. Future work will extend this framework to incorporate ontologies that provide pathway-level feature selection from gene expression input data.

A survey and taxonomy of methods interpreting random forest models

Forest-ORE: Mining Optimal Rule Ensemble to interpret Random Forest models

LionForests: Local Interpretation of Random Forests

Understanding Random Forests: From Theory to Practice

Importance measures derived from random forests: characterisation and extension

Interpreting random forest classification models using a feature contribution method

Comparison of the Predictive Performance and Interpretability of Random Forest and Linear Models on Benchmark Data Sets

Forest Floor Visualizations of Random Forests

Visualisation of Random Forest classification

Demystifying Functional Random Forests: Novel Explainability Tools for Model Transparency in High-Dimensional Spaces

Common, uncommon, and novel applications of random forest in psychological research

Random Forests: some methodological insights

Hyperparameters and tuning strategies for random forest

Minimal-unsatisfiable-core-driven Local Explainability Analysis for Random Forest

binomialRF: interpretable combinatoric efficiency of random forests to identify biomarker interactions

Random forests for global sensitivity analysis: A selective review

Explaining Random Forests As Single Decision Trees Through Distance Functional Optimization

Review Study of Interpretation Methods for Future Interpretable Machine Learning

Machine Learning Interpretability: A Survey on Methods and Metrics

A random forest guided tour

Enhancing interpretability in random forest: Leveraging inTrees for association rule extraction insights