Abstract:Abstract Background In this era of data science-driven bioinformatics, machine learning research has focused on feature selection as users want more interpretation and post-hoc analyses for biomarker detection. However, when there are more features (i.e., transcripts) than samples (i.e., mice or human samples) in a study, it poses major statistical challenges in biomarker detection tasks as traditional statistical techniques are underpowered in high dimension. Second and third order interactions of these features pose a substantial combinatoric dimensional challenge. In computational biology, random forest ( RF ) classifiers are widely used due to their flexibility, powerful performance, their ability to rank features, and their robustness to the “P > > N ” high-dimensional limitation that many matrix regression algorithms face. We propose binomialRF, a feature selection technique in RFs that provides an alternative interpretation for features using a correlated binomial distribution and scales efficiently to analyze multiway interactions. Results In both simulations and validation studies using datasets from the TCGA and UCI repositories, binomialRF showed computational gains (up to 5 to 300 times faster) while maintaining competitive variable precision and recall in identifying biomarkers’ main effects and interactions. In two clinical studies, the binomialRF algorithm prioritizes previously-published relevant pathological molecular mechanisms (features) with high classification precision and recall using features alone, as well as with their statistical interactions alone. Conclusion binomialRF extends upon previous methods for identifying interpretable features in RFs and brings them together under a correlated binomial distribution to create an efficient hypothesis testing algorithm that identifies biomarkers’ main effects and interactions. Preliminary results in simulations demonstrate computational gains while retaining competitive model selection and classification accuracies. Future work will extend this framework to incorporate ontologies that provide pathway-level feature selection from gene expression input data.

Multinomial random forest

Multinomial Random Forest: Toward Consistency and Privacy-Preservation

Data-driven multinomial random forest: A new random forest variant with strong consistency

A Novel Consistent Random Forest Framework: Bernoulli Random Forests

A two-phase random forest with differential privacy

Heterogeneous Random Forest

Bernoulli Random Forests: Closing the Gap Between Theoretical Consistency and Empirical Soundness.

Verifiable Privacy-preserving Scheme based on Vertical Federated Random Forest

binomialRF: interpretable combinatoric efficiency of random forests to identify biomarker interactions

Banzhaf Random Forests

Probabilistic Random Forest: A machine learning algorithm for noisy datasets

Asymptotic Properties of High-Dimensional Random Forests

Random Bits Forest: a Strong Classifier/Regressor for Big Data

Random Subsequence Forests

On the Gini-impurity Preservation for Privacy Random Forests

Random Similarity Forests

Consistency of random forests

Multiple imputation using chained random forests: a preliminary study based on the empirical distribution of out-of-bag prediction errors

Consistency of Random Forest Type Algorithms under a Probabilistic Impurity Decrease Condition

Randomization Can Reduce Both Bias and Variance: A Case Study in Random Forests

Non-asymptotic Properties of Generalized Mondrian Forests in Statistical Learning