Abstract:Background: The survival rate of patients with distant metastasis (DM) of papillary thyroid carcinoma (PTC) is significantly reduced. It is of great significance to find an effective method for early prediction of the risk of DM for formulating individualized diagnosis and treatment plans and improving prognosis. Previous studies have significant limitations, and it is still necessary to develop new models for predicting the risk of DM of PTC. We aimed to develop and validate interpretable machine learning (ML) models for early prediction of DM in patients with PTC using a multicenter cohort. Methods: We collected data on patients with PTC who were admitted between June 2013 and May 2023. Data from 1430 patients at Yunnan Cancer Hospital (YCH) served as the training and internal validation set, while data from 434 patients at the First Affiliated Hospital of Kunming Medical University (KMU 1st AH) was used as the external test set. Nine ML methods such as random forest (RF) were used to construct the model. Model prediction performance was compared using evaluation indicators such as the area under the receiver operating characteristic curve (AUC). The SHapley Additive exPlanation (SHAP) method was used to rank the feature importance and explain the final model. Findings: Among the nine ML models, the RF model performed the best. The RF model accurately predicted the risk of DM in patients with PTC in both the internal validation of the training set [AUC: 0.913, 95% confidence interval (CI) (0.9075-0.9185)] and the external test set [AUC: 0.8996, 95% CI (0.8483-0.9509)]. The calibration curve showed high agreement between the predicted and observed risks. In the sensitivity analysis focusing on DM sites of PTC, the RF model exhibited outstanding performance in predicting "lung-only metastasis" showing high AUC, specificity, sensitivity, F1 score, and a low Brier score. SHAP analysis identified variables that contributed to the model predictions. An online calculator based on the RF model was developed and made available for clinicians at https://predictingdistantmetastasis.shinyapps.io/shiny1/. 11 variables were included in the final RF model: age of the patient with PTC, whether the tumor size is > 2 cm, whether the tumor size is ≤ 1 cm, lymphocyte (LYM) count, monocyte (MONO) count, monocyte/lymphocyte ratio (MLR), thyroglobulin (TG) level, thyroid peroxidase antibody (TPOAb) level, whether the T stage is T1/2, whether the T stage is T3/4, and whether the N stage is N0. Interpretation: On the basis of large-sample and multicenter data, we developed and validated an explainable ML model for predicting the risk of DM in patients with PTC. The model helps clinicians to identify high-risk patients early and provides a basis for individualized patient treatment plans. Funding: This work was supported by the National Natural Science Foundation of China (No. 81960426, 82360345 and 82001986), the Outstanding Youth Science Foundation of Yunnan Basic Research Project (No. 202401AY070001-316), Yunnan Province Applied and Basic Research Foundation (No. 202401AT070008), and Ten Thousand Talent Plans for Young Top-notch Talents of Yunnan Province.

Machine learning prediction of pancreatitis risk with antithyroid drugs: a nationwide retrospective observational study

Prediction of the Severity of Acute Pancreatitis Using Machine Learning Models.

A machine learning-based approach for the prediction of periprocedural myocardial infarction by using routine data

Comparison of agranulocytosis and anti‐neutrophil cytoplasmic antibody‐associated vasculitis caused by two antithyroid drugs: A pharmacovigilance study using the WHO international database

Machine Learning Predictive Models for Acute Pancreatitis: A Systematic Review.

Interpretable machine learning model predicting immune checkpoint inhibitor‐induced hypothyroidism: A retrospective cohort study

Machine learning for post-acute pancreatitis diabetes mellitus prediction and personalized treatment recommendations

Association of dipeptidyl peptidase-4 inhibitor and recurrent pancreatitis risk among patients with type 2 diabetes: A retrospective cohort study

Predicting the Need for Therapeutic Intervention and Mortality in Acute Pancreatitis: A Two-Center International Study Using Machine Learning

Development and validation of an interpretable machine learning model for predicting the risk of distant metastasis in papillary thyroid cancer: a multicenter study

An Evaluation of the Efficacy of Machine Learning in Predicting Thyrotoxicosis and Hypothyroidism: A Comparative Assessment of Biochemical Test Parameters Used in Different Health Checkups

Using Real-World Data to Evaluate the Association of Incretin-Based Therapies with Risk of Acute Pancreatitis: a Meta-Analysis of 1,324,515 Patients from Observational Studies.

Machine Learning Approach for Thyroid Cancer Diagnosis Using Clinical Data

The prevalence and target antigens of antithyroid drugs induced antineutrophil cytoplasmic antibodies (ANCA) in Chinese patients with hyperthyroidism.

Anti-thyroid antibodies and thyroid echo pattern at baseline as risk factors for thyroid dysfunction induced by anti-programmed cell death-1 antibodies: a prospective study

Using an Artificial Intelligence Approach to Predict the Adverse Effects and Prognosis of Tuberculosis

Artificial neural network prediction of postoperative complications in papillary thyroid microcarcinoma based on preoperative ultrasonographic features

Comparison of drug-induced liver injury risk between propylthiouracil and methimazole: A quantitative systems toxicology approach

Computed tomography-based body composition indicative of diabetes after hypertriglyceridemic acute pancreatitis

Analysis of 90 Cases of Antithyroid Drug-Induced Severe Hepatotoxicity over 13 Years in China

Construction and validation of a diagnostic model for high-risk papillary thyroid microcarcinoma