Abstract:Background: The accuracy of a prognostic prediction model has become an essential aspect of the quality and reliability of the health-related decisions made by clinicians in modern medicine. Unfortunately, individual institutions often lack sufficient samples, which might not provide sufficient statistical power for models. One mitigation is to expand data collection from a single institution to multiple centers to collectively increase the sample size. However, sharing sensitive biomedical data for research involves complicated issues. Machine learning models such as random forests (RF), though they are commonly used and achieve good performances for prognostic prediction, usually suffer worse performance under multicenter privacy-preserving data mining scenarios compared to a centrally trained version. Methods and materials: In this study, a multicenter random forest prognosis prediction model is proposed that enables federated clinical data mining from horizontally partitioned datasets. By using a novel data enhancement approach based on a differentially private generative adversarial network customized to clinical prognosis data, the proposed model is able to provide a multicenter RF model with performances on par with-or even better than-centrally trained RF but without the need to aggregate the raw data. Moreover, our model also incorporates an importance ranking step designed for feature selection without sharing patient-level information. Result: The proposed model was evaluated on colorectal cancer datasets from the US and China. Two groups of datasets with different levels of heterogeneity within the collaborative research network were selected. First, we compare the performance of the distributed random forest model under different privacy parameters with different percentages of enhancement datasets and validate the effectiveness and plausibility of our approach. Then, we compare the discrimination and calibration ability of the proposed multicenter random forest with a centrally trained random forest model and other tree-based classifiers as well as some commonly used machine learning methods. The results show that the proposed model can provide better prediction performance in terms of discrimination and calibration ability than the centrally trained RF model or the other candidate models while following the privacy-preserving rules in both groups. Additionally, good discrimination and calibration ability are shown on the simplified model based on the feature importance ranking in the proposed approach. Conclusion: The proposed random forest model exhibits ideal prediction capability using multicenter clinical data and overcomes the performance limitation arising from privacy guarantees. It can also provide feature importance ranking across institutions without pooling the data at a central site. This study offers a practical solution for building a prognosis prediction model in the collaborative clinical research network and solves practical issues in real-world applications of medical artificial intelligence.

Multinomial Random Forest: Toward Consistency and Privacy-Preservation

Multinomial random forest

Data-driven multinomial random forest: A new random forest variant with strong consistency

A Novel Consistent Random Forest Framework: Bernoulli Random Forests

A two-phase random forest with differential privacy

Bernoulli Random Forests: Closing the Gap Between Theoretical Consistency and Empirical Soundness.

Consistency of Random Forest Type Algorithms under a Probabilistic Impurity Decrease Condition

Heterogeneous Random Forest

Asymptotic Properties of High-Dimensional Random Forests

Consistency of random forests

Verifiable Privacy-preserving Scheme based on Vertical Federated Random Forest

Probabilistic Random Forest: A machine learning algorithm for noisy datasets

binomialRF: interpretable combinatoric efficiency of random forests to identify biomarker interactions

Randomization Can Reduce Both Bias and Variance: A Case Study in Random Forests

On the Gini-impurity Preservation for Privacy Random Forests

Banzhaf Random Forests

A multicenter random forest model for effective prognosis prediction in collaborative clinical research network

Differentially- and non-differentially-private random decision trees

Non-asymptotic Properties of Generalized Mondrian Forests in Statistical Learning

Narrowing the Gap: Random Forests In Theory and In Practice

Multiple imputation using chained random forests: a preliminary study based on the empirical distribution of out-of-bag prediction errors