Abstract:Abstract Goal We present a deep learning framework to predict survival prognosis of patients with non-small cell lung cancer using CT images and clinical data developed and validated in multi-institutional cohorts. Methods We developed 3D convolutional neural networks (CNNs) using CT images, tumor nodule segmentation, clinical data (i.e. age, sex, histology, and stage) and survival times as input to predict survival of non-small cell lung cancer. Both the CT images and the segmentations were used as inputs for the CNN, the latter to localize the volumes-of-interests (VOIs) in the CT scans. We used three cohorts to evaluate our framework: Moffitt (n=186), Maastro (n=311), and Stanford (n=130). We investigated pre-training with the LIDC-IDRI dataset (n=1010) and compared deep learning performance with 1674 manually-curated radiomics features and clinical data. We used two ways to evaluate the models. First, we split the three cohorts into training and test sets by selecting two of the cohorts for training and the remaining for testing. Secondly, we combined all cohorts and performed a 10-fold stratified cross-validation. We used the Concordance Index (CI) to estimate model performance. Next, we evaluated priming whereby we use 10% of the validation cohort during training and test on the remaining patients in the test cohort. To ensure that the test set was identical for both priming and non-priming experiments, we discarded these samples for the non-priming tests. Results Table 1 shows the results of the two evaluation strategies. We observed consistently high CIs for all three cohorts. LIDC pretraining and priming yielded the highest CIs as compared to radiomic and clinical-only pipelines. For the 10-fold cross-validation experiment, our pipeline achieved an average CI=0.64. Conclusion Our study highlights the promising results of our pipeline to predict survival prognosis across three cohorts without the need to define radiomics features. Train on two cohorts, test on 3rd cohortpretrain on LIDC-IDRItest w/o primingtest w/ primingtest w/o priming (only radiomics features / clinical)test w/ priming (only radiomics features / clinical)train on Moffitt + Maastro, test on Stanfordyes0.620.630.52 (radiomics only)0.53 (radiomics only)train on Moffitt + Maastro, test on Stanfordno0.610.620.57 (clinical only)0.57 (clinical only)train on Moffitt + Stanford, test on Maastroyes0.60.60.55 (radiomics only)0.55 (radiomics only)train on Moffitt + Stanford, test on Maastrono0.580.60.56 (clinical only)0.56 (clinical only)train on Stanford + Maastro, test on Moffittyes0.580.60.53 (radiomics only)0.53 (radiomics only)train on Stanford + Maastro, test on Moffittno0.60.570.56 (clinical only)0.56 (clinical only) Citation Format: Edward H. Lee, Mu Zhou, Noah Gamboa, Kevin Brennan, Haruka Itakura, Viswam Nair, Sandy Napel, Simon Wong, Olivier Gevaert. Deep learning to predict survival prognosis for patients with non-small cell lung cancer using images and clinical data [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2018; 2018 Apr 14-18; Chicago, IL. Philadelphia (PA): AACR; Cancer Res 2018;78(13 Suppl):Abstract nr 3048.

Deep Learning-Based Prognostic Prediction for Early Stage Laryngeal Cancer Patients Post-Radiotherapy: Utilizing 3D CBCT and EMR Data

Machine learning for prediction of chemoradiation therapy response in rectal cancer using pre-treatment and mid-radiation multi-parametric MRI

CT-Based Deep Learning Model for Predicting Local Recurrence-Free Survival in Esophageal Squamous Cell Carcinoma Patients Received Concurrent Chemo-Radiotherapy: A Multicenter Study

A Deep Learning Radiomics Analysis for Survival Prediction in Esophageal Cancer

Deep learning for lung cancer prognostication: A retrospective multi-cohort radiomics study

Predicting early stage lung cancer recurrence and survival from combined tumor motion amplitude and radiomics on free-breathing 4D-CT.

A deep learning‐ and CT image‐based prognostic model for the prediction of survival in non‐small cell lung cancer

Imaging-based Prognostic Artificial Intelligence Model for Oropharyngeal Carcinoma after Radiation Therapy

Computed Tomography-based Prognostication in Lung Adenocarcinomas through Histopathological Feature Learning: A Retrospective Multicenter Study

Prediction of 5-year Progression-Free Survival in Advanced Nasopharyngeal Carcinoma with Pretreatment PET/CT using Multi-Modality Deep Learning-based Radiomics

Deep learning approach of diffusion-weighted imaging as an outcome predictor in laryngeal and hypopharyngeal cancer patients with radiotherapy-related curative treatment: a preliminary study

Deep learning for locally advanced nasopharyngeal carcinoma prognostication based on pre- and post-treatment MRI

The use of artificial intelligence models to predict survival in patients with laryngeal squamous cell carcinoma

Abstract 3048: Deep Learning to Predict Survival Prognosis for Patients with Non-Small Cell Lung Cancer Using Images and Clinical Data

Automated Prediction of Early Recurrence in Advanced Sinonasal Squamous Cell Carcinoma with Deep Learning and Multi-parametric MRI-based Radiomics Nomogram.

Deep learning model for predicting treatment response for patients with rectal cancer using 3D medical imaging.

MRI-based deep learning and radiomics for prediction of occult cervical lymph node metastasis and prognosis in early-stage oral and oropharyngeal squamous cell carcinoma: a diagnostic study

Computed tomography-based deep-learning prediction of neoadjuvant chemoradiotherapy treatment response in esophageal squamous cell carcinoma

A Combined Model Integrating Radiomics and Deep Learning Based on Contrast-Enhanced CT for Preoperative Staging of Laryngeal Carcinoma

Prediction of Disease-Free Survival in Breast Cancer using Deep Learning with Ultrasound and Mammography: A Multicenter Study

Deep Learning Based Time-to-event Analysis with PET, CT and Joint PET/CT for Head and Neck Cancer Prognosis