Abstract:Background: The accuracy of a prognostic prediction model has become an essential aspect of the quality and reliability of the health-related decisions made by clinicians in modern medicine. Unfortunately, individual institutions often lack sufficient samples, which might not provide sufficient statistical power for models. One mitigation is to expand data collection from a single institution to multiple centers to collectively increase the sample size. However, sharing sensitive biomedical data for research involves complicated issues. Machine learning models such as random forests (RF), though they are commonly used and achieve good performances for prognostic prediction, usually suffer worse performance under multicenter privacy-preserving data mining scenarios compared to a centrally trained version. Methods and materials: In this study, a multicenter random forest prognosis prediction model is proposed that enables federated clinical data mining from horizontally partitioned datasets. By using a novel data enhancement approach based on a differentially private generative adversarial network customized to clinical prognosis data, the proposed model is able to provide a multicenter RF model with performances on par with-or even better than-centrally trained RF but without the need to aggregate the raw data. Moreover, our model also incorporates an importance ranking step designed for feature selection without sharing patient-level information. Result: The proposed model was evaluated on colorectal cancer datasets from the US and China. Two groups of datasets with different levels of heterogeneity within the collaborative research network were selected. First, we compare the performance of the distributed random forest model under different privacy parameters with different percentages of enhancement datasets and validate the effectiveness and plausibility of our approach. Then, we compare the discrimination and calibration ability of the proposed multicenter random forest with a centrally trained random forest model and other tree-based classifiers as well as some commonly used machine learning methods. The results show that the proposed model can provide better prediction performance in terms of discrimination and calibration ability than the centrally trained RF model or the other candidate models while following the privacy-preserving rules in both groups. Additionally, good discrimination and calibration ability are shown on the simplified model based on the feature importance ranking in the proposed approach. Conclusion: The proposed random forest model exhibits ideal prediction capability using multicenter clinical data and overcomes the performance limitation arising from privacy guarantees. It can also provide feature importance ranking across institutions without pooling the data at a central site. This study offers a practical solution for building a prognosis prediction model in the collaborative clinical research network and solves practical issues in real-world applications of medical artificial intelligence.

A random forest based biomarker discovery and power analysis framework for diagnostics research

binomialRF: interpretable combinatoric efficiency of random forests to identify biomarker interactions

Random Forest In Clinical Metabolomics For Phenotypic Discrimination And Biomarker Selection

RFtest: A Robust and Flexible Community-Level Test for Microbiome Data Powerfully Detects Phylogenetically Clustered Signals

Selective of informative metabolites using random forests based on model population analysis.

Sample size and statistical power considerations in high-dimensionality data settings: a comparative study of classification algorithms

biosigner: A New Method for the Discovery of Significant Molecular Signatures from Omics Data

A Flexible Approach for Predictive Biomarker Discovery

Computation and Selection of Optimal Biomarker Combinations by Integrative ROC Analysis Using CombiROC

Statistical Methods for Selective Biomarker Testing

Decision Variants for the Automatic Determination of Optimal Feature Subset in RF-RFE

AI–Driven Predictive Biomarker Discovery with Contrastive Learning to Improve Clinical Trial Outcomes

Strategies for power calculations in predictive biomarker studies in survival data

Forward variable selection improves the power of random forest for high-dimensional microbiome data

PDXpower: A Power Analysis Tool for Experimental Design in Pre-clinical Xenograft Studies for Uncensored and Censored Outcomes

Random feature baselines provide distributional performance and feature selection benchmarks for clinical and 'omic machine learning

Common, uncommon, and novel applications of random forest in psychological research

Detecting gene-gene interactions using a permutation-based random forest method

A multicenter random forest model for effective prognosis prediction in collaborative clinical research network

Knowledge-slanted random forest method for high-dimensional data and small sample size with a feature selection application for gene expression data

MetaFS: Performance assessment of biomarker discovery in metaproteomics