Abstract:Artificial intelligence (AI) and machine learning (ML) are becoming critical in developing and deploying personalized medicine and targeted clinical trials. Recent advances in ML have enabled the integration of wider ranges of data including both medical records and imaging (radiomics). However, the development of prognostic models is complex as no modeling strategy is universally superior to others and validation of developed models requires large and diverse datasets to demonstrate that prognostic models developed (regardless of method) from one dataset are applicable to other datasets both internally and externally. Using a retrospective dataset of 2,552 patients from a single institution and a strict evaluation framework that included external validation on three external patient cohorts (873 patients), we crowdsourced the development of ML models to predict overall survival in head and neck cancer (HNC) using electronic medical records (EMR) and pretreatment radiological images. To assess the relative contributions of radiomics in predicting HNC prognosis, we compared 12 different models using imaging and/or EMR data. The model with the highest accuracy used multitask learning on clinical data and tumor volume, achieving high prognostic accuracy for 2-year and lifetime survival prediction, outperforming models relying on clinical data only, engineered radiomics, or complex deep neural network architecture. However, when we attempted to extend the best performing models from this large training dataset to other institutions, we observed significant reductions in the performance of the model in those datasets, highlighting the importance of detailed population-based reporting for AI/ML model utility and stronger validation frameworks. We have developed highly prognostic models for overall survival in HNC using EMRs and pretreatment radiological images based on a large, retrospective dataset of 2,552 patients from our institution.Diverse ML approaches were used by independent investigators. The model with the highest accuracy used multitask learning on clinical data and tumor volume.External validation of the top three performing models on three datasets (873 patients) with significant differences in the distributions of clinical and demographic variables demonstrated significant decreases in model performance. Significance: ML combined with simple prognostic factors outperformed multiple advanced CT radiomics and deep learning methods. ML models provided diverse solutions for prognosis of patients with HNC but their prognostic value is affected by differences in patient populations and require extensive validation.

A Novel Integrated Machine Learning Model for Preoperative Evaluation and Postoperative Prognosis-prediction in Cervical Cancer Based on Clinical-pathological Parameters and MR Radiomics (Preprint)

Novel artificial intelligence machine learning approaches to precisely predict survival and site-specific recurrence in cervical cancer: A multi-institutional study

Machine Learning-Based Models for Assessing Postoperative Risk Factors in Patients with Cervical Cancer

A Novel Ultrasound-Based Radiomics Model for the Preoperative Prediction of Lymph Node Metastasis in Cervical Cancer

Radiogenomics for Predicting Microsatellite Instability Status and PD-L1 Expression with Machine Learning in Endometrial Cancers: A Multicenter Study

Machine Learning-Based Multiparametric Magnetic Resonance Imaging Radiomics Model for Preoperative Predicting the Deep Stromal Invasion in Patients with Early Cervical Cancer

Radiomics based on magnetic resonance imaging for preoperative prediction of lymph node metastasis in head and neck cancer: Machine learning study

Value of the Application of CE-MRI Radiomics and Machine Learning in Preoperative Prediction of Sentinel Lymph Node Metastasis in Breast Cancer

Integrating MRI-based radiomics and clinicopathological features for preoperative prognostication of early-stage cervical adenocarcinoma patients: in comparison to deep learning approach

A MRI radiomics-based model for prediction of pelvic lymph node metastasis in cervical cancer

Preoperative Prediction of Axillary Lymph Node Metastasis in Patients With Breast Cancer Through Multimodal Deep Learning Based on Ultrasound and Magnetic Resonance Imaging Images

Preoperative magnetic resonance imaging-radiomics in cervical cancer: a systematic review and meta-analysis

MRI-based deep learning and radiomics for prediction of occult cervical lymph node metastasis and prognosis in early-stage oral and oropharyngeal squamous cell carcinoma: a diagnostic study

Multimodal MRI-based deep-radiomics model predicts response in cervical cancer treated with neoadjuvant chemoradiotherapy

Combination of Radiomics and Machine Learning with Diffusion-Weighted MR Imaging for Clinical Outcome Prognostication in Cervical Cancer

Multi-institutional Prognostic Modeling in Head and Neck Cancer: Evaluating Impact and Generalizability of Deep Learning and Radiomics

Machine Learning-Based Radiomics for Predicting Outcomes in Cervical Cancer Patients Undergoing Concurrent Chemoradiotherapy

Optimal Machine Learning Methods for Radiomic Prediction Models: Clinical Application for Preoperative T2*-weighted Images of Cervical Spondylotic Myelopathy

Development and Validation of Radiomics-Based Models for Predicting the Parametrial Invasion in Stage IB1 to IIA2 Cervical Cancer

A meta-analysis of the diagnostic performance of machine learning-based MRI in the prediction of axillary lymph node metastasis in breast cancer patients

Multi-Parametric Magnetic Resonance Imaging-Based Radiomics Analysis of Cervical Cancer for Preoperative Prediction of Lymphovascular Space Invasion