Abstract:Abstract Background In this era of data science-driven bioinformatics, machine learning research has focused on feature selection as users want more interpretation and post-hoc analyses for biomarker detection. However, when there are more features (i.e., transcripts) than samples (i.e., mice or human samples) in a study, it poses major statistical challenges in biomarker detection tasks as traditional statistical techniques are underpowered in high dimension. Second and third order interactions of these features pose a substantial combinatoric dimensional challenge. In computational biology, random forest ( RF ) classifiers are widely used due to their flexibility, powerful performance, their ability to rank features, and their robustness to the “P > > N ” high-dimensional limitation that many matrix regression algorithms face. We propose binomialRF, a feature selection technique in RFs that provides an alternative interpretation for features using a correlated binomial distribution and scales efficiently to analyze multiway interactions. Results In both simulations and validation studies using datasets from the TCGA and UCI repositories, binomialRF showed computational gains (up to 5 to 300 times faster) while maintaining competitive variable precision and recall in identifying biomarkers’ main effects and interactions. In two clinical studies, the binomialRF algorithm prioritizes previously-published relevant pathological molecular mechanisms (features) with high classification precision and recall using features alone, as well as with their statistical interactions alone. Conclusion binomialRF extends upon previous methods for identifying interpretable features in RFs and brings them together under a correlated binomial distribution to create an efficient hypothesis testing algorithm that identifies biomarkers’ main effects and interactions. Preliminary results in simulations demonstrate computational gains while retaining competitive model selection and classification accuracies. Future work will extend this framework to incorporate ontologies that provide pathway-level feature selection from gene expression input data.

Combine Pathway Analysis with Random Forests to Hunting for Feature Genes

Pathway-based feature selection algorithms identify genes discriminating patients with multiple sclerosis apart from controls

Pathway Detection Based on Hierarchical LASSO Regression Model

A Robust Statistical Procedure to Discover Expression Biomarkers Using Microarray Genomic Expression Data.

Evaluation of network-guided random forest for disease gene discovery

Using NMFAS to Identify Key Biological Pathways Associated with Human Diseases

A combinational feature selection and ensemble neural network method for classification of gene expression data

Identifying Disease Related Sub-Pathways for Analysis of Genome-Wide Association Studies

Feature selection for longitudinal microarray data by adapting a pathway analysis method

Topologically inferring risk-active pathways toward precise cancer classification by directed random walk.

Gene Features Selection for Three-Class Disease Classification via Multiple Orthogonal Partial Least Square Discriminant Analysis and S-Plot Using Microarray Data

A Genome-Wide Association Study of Alzheimer’s Disease Using Random Forests and Enrichment Analysis

binomialRF: interpretable combinatoric efficiency of random forests to identify biomarker interactions

Walking on Multiple Disease-Gene Networks to Prioritize Candidate Genes.

Gene selection and classification for cancer microarray data based on machine learning and similarity measures

Identifying Biological Pathways Via Phase Decomposition and Profile Extraction.

Combining machine learning algorithms and single-cell data to study the pathogenesis of Alzheimer’s disease

Integrating Multiple Gene Semantic Similarity Profiles to Infer Disease Genes

A robust statistical approach for finding informative spatially associated pathways

Identification of important gene signatures in schizophrenia through feature fusion and genetic algorithm