Abstract:Abstract Background In this era of data science-driven bioinformatics, machine learning research has focused on feature selection as users want more interpretation and post-hoc analyses for biomarker detection. However, when there are more features (i.e., transcripts) than samples (i.e., mice or human samples) in a study, it poses major statistical challenges in biomarker detection tasks as traditional statistical techniques are underpowered in high dimension. Second and third order interactions of these features pose a substantial combinatoric dimensional challenge. In computational biology, random forest ( RF ) classifiers are widely used due to their flexibility, powerful performance, their ability to rank features, and their robustness to the “P > > N ” high-dimensional limitation that many matrix regression algorithms face. We propose binomialRF, a feature selection technique in RFs that provides an alternative interpretation for features using a correlated binomial distribution and scales efficiently to analyze multiway interactions. Results In both simulations and validation studies using datasets from the TCGA and UCI repositories, binomialRF showed computational gains (up to 5 to 300 times faster) while maintaining competitive variable precision and recall in identifying biomarkers’ main effects and interactions. In two clinical studies, the binomialRF algorithm prioritizes previously-published relevant pathological molecular mechanisms (features) with high classification precision and recall using features alone, as well as with their statistical interactions alone. Conclusion binomialRF extends upon previous methods for identifying interpretable features in RFs and brings them together under a correlated binomial distribution to create an efficient hypothesis testing algorithm that identifies biomarkers’ main effects and interactions. Preliminary results in simulations demonstrate computational gains while retaining competitive model selection and classification accuracies. Future work will extend this framework to incorporate ontologies that provide pathway-level feature selection from gene expression input data.

Random Forest for Bioinformatics

binomialRF: interpretable combinatoric efficiency of random forests to identify biomarker interactions

Random Forest: A Classification and Regression Tool for Compound Classification and QSAR Modeling

Random Bits Forest: a Strong Classifier/Regressor for Big Data

Heterogeneous Random Forest

Iterative Random Forests to detect predictive and stable high-order interactions

A Novel Consistent Random Forest Framework: Bernoulli Random Forests

Unsupervised Learning With Random Forest Predictors

The random forest algorithm for statistical learning

A Dynamic Boosted Ensemble Learning Method Based on Random Forest

A New Rotation Forest Ensemble Algorithm

Decision Tree and Ensemble Learning Algorithms with Their Applications in Bioinformatics

New machine learning algorithm: random forest

Random Forest for Genomic Prediction

Random Forests for Big Data

Leveraging random forest techniques for enhanced microbiological analysis: a machine learning approach to investigating microbial communities and their interactions

Decision Variants for the Automatic Determination of Optimal Feature Subset in RF-RFE

A random forest based biomarker discovery and power analysis framework for diagnostics research

Common, uncommon, and novel applications of random forest in psychological research

Extreme random forest method for machine fault classification

Banzhaf Random Forests