Abstract:Background: Biomarker identification is one of the major and important goal of functional genomics and translational medicine studies. Large scale -omics data are increasingly being accumulated and can provide vital means for the identification of biomarkers for the early diagnosis of complex disease and/or for advanced patient/diseases stratification. These tasks are clearly interlinked, and it is essential that an unbiased and stable methodology is applied in order to address them. Although, recently, many, primarily machine learning based, biomarker identification approaches have been developed, the exploration of potential associations between biomarker identification and the design of future experiments remains a challenge. Methods: In this study, using both simulated and published experimentally derived datasets, we assessed the performance of several state-of-the-art Random Forest (RF) based decision approaches, namely the Boruta method, the permutation based feature selection without correction method, the permutation based feature selection with correction method, and the backward elimination based feature selection method. Moreover, we conducted a power analysis to estimate the number of samples required for potential future studies. Results: We present a number of different RF based stable feature selection methods and compare their performances using simulated, as well as published, experimentally derived, datasets. Across all of the scenarios considered, we found the Boruta method to be the most stable methodology, whilst the Permutation (Raw) approach offered the largest number of relevant features, when allowed to stabilise over a number of iterations. Finally, we developed and made available a web interface ( https://joelarkman.shinyapps.io/PowerTools/ ) to streamline power calculations thereby aiding the design of potential future studies within a translational medicine context. Conclusions: We developed a RF-based biomarker discovery framework and provide a web interface for our framework, termed PowerTools, that caters the design of appropriate and cost-effective subsequent future omics study.

Computation and Selection of Optimal Biomarker Combinations by Integrative ROC Analysis Using CombiROC

CombiROC: an interactive web tool for selecting accurate marker combinations of omics data

On the Optimal Combination of Elliptically Distributed Biomarkers to Improve Diagnostic Accuracy

A General AUC-Type Measure and Biomarker Selection

Selection and combination of biomarkers using ROC method for disease classification and prediction

Marker selection via maximizing the partial area under the ROC curve of linear risk scores.

Boosting the concordance index for survival data - a unified framework to derive and evaluate biomarker combinations

Logistic regression analysis with standardized markers

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

ROBI: a Robust and Optimized Biomarker Identifier to increase the likelihood of discovering relevant radiomic features.

ROCnReg: An R Package for Receiver Operating Characteristic Curve Inference with and without Covariate Information

ROC curve analysis: a useful statistic multi-tool in the research of nephrology

On the combination of omics data for prediction of binary outcomes

Significance Tests for Covariates in the Diagnostic Accuracy Index of a Biomarker Against a Continuous Gold Standard.

Nonparametric ROC Summary Statistics for Correlated Diagnostic Marker Data

A novel approach for biomarker selection and the integration of repeated measures experiments from two assays

Developing Biomarker Combinations in Multicenter Studies via Direct Maximization and Penalization

Impact of methodological assumptions and covariates on the cutoff estimation in ROC analysis

Sample size and performance estimation for biomarker combinations based on pilot studies with small sample sizes

Methods of determining optimal cut-point of diagnostic biomarkers with application of clinical data in ROC analysis: an update review

A random forest based biomarker discovery and power analysis framework for diagnostics research