Abstract:BACKGROUND: Non-small-cell lung cancer (NSCLC) patients often demonstrate varying clinical courses and outcomes, even within the same tumor stage. This study explores deep learning applications in medical imaging allowing for the automated quantification of radiographic characteristics and potentially improving patient stratification.METHODS AND FINDINGS: We performed an integrative analysis on 7 independent datasets across 5 institutions totaling 1,194 NSCLC patients (age median = 68.3 years [range 32.5-93.3], survival median = 1.7 years [range 0.0-11.7]). Using external validation in computed tomography (CT) data, we identified prognostic signatures using a 3D convolutional neural network (CNN) for patients treated with radiotherapy (n = 771, age median = 68.0 years [range 32.5-93.3], survival median = 1.3 years [range 0.0-11.7]). We then employed a transfer learning approach to achieve the same for surgery patients (n = 391, age median = 69.1 years [range 37.2-88.0], survival median = 3.1 years [range 0.0-8.8]). We found that the CNN predictions were significantly associated with 2-year overall survival from the start of respective treatment for radiotherapy (area under the receiver operating characteristic curve [AUC] = 0.70 [95% CI 0.63-0.78], p < 0.001) and surgery (AUC = 0.71 [95% CI 0.60-0.82], p < 0.001) patients. The CNN was also able to significantly stratify patients into low and high mortality risk groups in both the radiotherapy (p < 0.001) and surgery (p = 0.03) datasets. Additionally, the CNN was found to significantly outperform random forest models built on clinical parameters-including age, sex, and tumor node metastasis stage-as well as demonstrate high robustness against test-retest (intraclass correlation coefficient = 0.91) and inter-reader (Spearman's rank-order correlation = 0.88) variations. To gain a better understanding of the characteristics captured by the CNN, we identified regions with the most contribution towards predictions and highlighted the importance of tumor-surrounding tissue in patient stratification. We also present preliminary findings on the biological basis of the captured phenotypes as being linked to cell cycle and transcriptional processes. Limitations include the retrospective nature of this study as well as the opaque black box nature of deep learning networks.CONCLUSIONS: Our results provide evidence that deep learning networks may be used for mortality risk stratification based on standard-of-care CT images from NSCLC patients. This evidence motivates future research into better deciphering the clinical and biological basis of deep learning networks as well as validation in prospective data.

Radiomics and deep learning in lung cancer

Machine and deep learning methods for radiomics

Machine Learning in Lung Cancer Radiomics

Radiomics and artificial intelligence in lung cancer screening

Clinical applications of radiomics and deep learning in breast and lung cancer: A narrative literature review on current evidence and future perspectives

Deep Learning With Radiomics for Disease Diagnosis and Treatment: Challenges and Potential

Radiomics in Lung Diseases Imaging: State-of-the-Art for Clinicians

[Research Advances and Obstacles of CT-based Radiomics in Diagnosis and Treatment of Lung Cancer].

Structural and functional radiomics for lung cancer

A deep look into radiomics

Radiomics: an Overview in Lung Cancer Management—a Narrative Review

Application of Radiomics and Artificial Intelligence for Lung Cancer Precision Medicine

How Radiomics Can Improve Breast Cancer Diagnosis and Treatment

PET radiomics in lung cancer: advances and translational challenges

Deep learning for lung cancer prognostication: A retrospective multi-cohort radiomics study

[Advancements in Radiomics for Immunotherapy of Non-small Cell Lung Cancer]

Exploring non-invasive precision treatment in non-small cell lung cancer patients through deep learning radiomics across imaging features and molecular phenotypes

PET/CT radiomics and deep learning in the diagnosis of benign and malignant pulmonary nodules: progress and challenges

Imaging Biomarkers and Gene Expression Data Correlation Framework for Lung Cancer Radiogenomics Analysis Based on Deep Learning

Application of radiomics in diagnosis and treatment of lung cancer

Development and clinical application of radiomics in lung cancer