Abstract:BACKGROUND: Non-small-cell lung cancer (NSCLC) patients often demonstrate varying clinical courses and outcomes, even within the same tumor stage. This study explores deep learning applications in medical imaging allowing for the automated quantification of radiographic characteristics and potentially improving patient stratification.METHODS AND FINDINGS: We performed an integrative analysis on 7 independent datasets across 5 institutions totaling 1,194 NSCLC patients (age median = 68.3 years [range 32.5-93.3], survival median = 1.7 years [range 0.0-11.7]). Using external validation in computed tomography (CT) data, we identified prognostic signatures using a 3D convolutional neural network (CNN) for patients treated with radiotherapy (n = 771, age median = 68.0 years [range 32.5-93.3], survival median = 1.3 years [range 0.0-11.7]). We then employed a transfer learning approach to achieve the same for surgery patients (n = 391, age median = 69.1 years [range 37.2-88.0], survival median = 3.1 years [range 0.0-8.8]). We found that the CNN predictions were significantly associated with 2-year overall survival from the start of respective treatment for radiotherapy (area under the receiver operating characteristic curve [AUC] = 0.70 [95% CI 0.63-0.78], p < 0.001) and surgery (AUC = 0.71 [95% CI 0.60-0.82], p < 0.001) patients. The CNN was also able to significantly stratify patients into low and high mortality risk groups in both the radiotherapy (p < 0.001) and surgery (p = 0.03) datasets. Additionally, the CNN was found to significantly outperform random forest models built on clinical parameters-including age, sex, and tumor node metastasis stage-as well as demonstrate high robustness against test-retest (intraclass correlation coefficient = 0.91) and inter-reader (Spearman's rank-order correlation = 0.88) variations. To gain a better understanding of the characteristics captured by the CNN, we identified regions with the most contribution towards predictions and highlighted the importance of tumor-surrounding tissue in patient stratification. We also present preliminary findings on the biological basis of the captured phenotypes as being linked to cell cycle and transcriptional processes. Limitations include the retrospective nature of this study as well as the opaque black box nature of deep learning networks.CONCLUSIONS: Our results provide evidence that deep learning networks may be used for mortality risk stratification based on standard-of-care CT images from NSCLC patients. This evidence motivates future research into better deciphering the clinical and biological basis of deep learning networks as well as validation in prospective data.

Computed Tomography-based Prognostication in Lung Adenocarcinomas through Histopathological Feature Learning: A Retrospective Multicenter Study

LUADpp: an Effective Prediction Model on Prognosis of Lung Adenocarcinomas Based on Somatic Mutational Features

Histopathologic Basis for a Chest CT Deep Learning Survival Prediction Model in Patients with Lung Adenocarcinoma.

Deep Learning Analysis of CT Images Reveals High-Grade Pathological Features to Predict Survival in Lung Adenocarcinoma

Comprehensive Computed Tomography Radiomics Analysis of Lung Adenocarcinoma for Prognostication

PET/CT radiomics and machine learning enable non-invasive survival stratification and histologic tumor risk profiling in patients with lung adenocarcinoma

Deep Learning for Predicting Subtype Classification and Survival of Lung Adenocarcinoma on Computed Tomography.

Histopathological Images and Multi-Omics Integration Predict Molecular Characteristics and Survival in Lung Adenocarcinoma

Outcome prediction in resectable lung adenocarcinoma patients: value of CT radiomics

Improving Prediction Accuracy of Spread Through Air Spaces in Clinical-Stage T1N0 Lung Adenocarcinoma Using Computed Tomography Imaging Models

Deep Learning Model for Pathological Grading and Prognostic Assessment of Lung Cancer Using CT Imaging: A Study on NLST and External Validation Cohorts

Prognostic impact of deep learning–based quantification in clinical stage 0-I lung adenocarcinoma

Prediction of lung malignancy progression and survival with machine learning based on pre-treatment FDG-PET/CT

Deep learning for lung cancer prognostication: A retrospective multi-cohort radiomics study

PET/CT-based deep learning grading signature to optimize surgical decisions for clinical stage I invasive lung adenocarcinoma and biologic basis under its prediction: a multicenter study

Computed Tomography Radiomics for Preoperative Prediction of Spread Through Air Spaces in the Early Stage of Surgically Resected Lung Adenocarcinomas

Predicting Gene Comutation of EGFR and TP53 by Radiomics and Deep Learning in Patients With Lung Adenocarcinomas

A large cohort study identifying a novel prognosis prediction model for lung adenocarcinoma through machine learning strategies

3D deep learning versus the current methods for predicting tumor invasiveness of lung adenocarcinoma based on high-resolution computed tomography images

A deep learning‐ and CT image‐based prognostic model for the prediction of survival in non‐small cell lung cancer

Prognostic Prediction of Cancer Based on Radiomics Features of Diagnostic Imaging: The Performance of Machine Learning Strategies