Abstract:BACKGROUND: Non-small-cell lung cancer (NSCLC) patients often demonstrate varying clinical courses and outcomes, even within the same tumor stage. This study explores deep learning applications in medical imaging allowing for the automated quantification of radiographic characteristics and potentially improving patient stratification.METHODS AND FINDINGS: We performed an integrative analysis on 7 independent datasets across 5 institutions totaling 1,194 NSCLC patients (age median = 68.3 years [range 32.5-93.3], survival median = 1.7 years [range 0.0-11.7]). Using external validation in computed tomography (CT) data, we identified prognostic signatures using a 3D convolutional neural network (CNN) for patients treated with radiotherapy (n = 771, age median = 68.0 years [range 32.5-93.3], survival median = 1.3 years [range 0.0-11.7]). We then employed a transfer learning approach to achieve the same for surgery patients (n = 391, age median = 69.1 years [range 37.2-88.0], survival median = 3.1 years [range 0.0-8.8]). We found that the CNN predictions were significantly associated with 2-year overall survival from the start of respective treatment for radiotherapy (area under the receiver operating characteristic curve [AUC] = 0.70 [95% CI 0.63-0.78], p < 0.001) and surgery (AUC = 0.71 [95% CI 0.60-0.82], p < 0.001) patients. The CNN was also able to significantly stratify patients into low and high mortality risk groups in both the radiotherapy (p < 0.001) and surgery (p = 0.03) datasets. Additionally, the CNN was found to significantly outperform random forest models built on clinical parameters-including age, sex, and tumor node metastasis stage-as well as demonstrate high robustness against test-retest (intraclass correlation coefficient = 0.91) and inter-reader (Spearman's rank-order correlation = 0.88) variations. To gain a better understanding of the characteristics captured by the CNN, we identified regions with the most contribution towards predictions and highlighted the importance of tumor-surrounding tissue in patient stratification. We also present preliminary findings on the biological basis of the captured phenotypes as being linked to cell cycle and transcriptional processes. Limitations include the retrospective nature of this study as well as the opaque black box nature of deep learning networks.CONCLUSIONS: Our results provide evidence that deep learning networks may be used for mortality risk stratification based on standard-of-care CT images from NSCLC patients. This evidence motivates future research into better deciphering the clinical and biological basis of deep learning networks as well as validation in prospective data.

Learning from Experts: Developing Transferable Deep Features for Patient-Level Lung Cancer Prediction

A Hybrid CNN Feature Model for Pulmonary Nodule Malignancy Risk Differentiation.

Deep CNN models for pulmonary nodule classification: Model modification, model integration, and transfer learning

Toward an Expert Level of Lung Cancer Detection and Classification Using a Deep Convolutional Neural Network.

Predicting Lung Nodule Malignancies by Combining Deep Convolutional Neural Network and Handcrafted Features

Using Deep Learning for Classification of Lung Nodules on Computed Tomography Images

Deep Learning Features For Lung Adenocarcinoma Classification With Tissue Pathology Images

[Pathological diagnosis of lung cancer based on deep transfer learning]

A Transfer Learning Approach with a Convolutional Neural Network for the Classification of Lung Carcinoma

Multi-source Transfer Learning with Convolutional Neural Networks for Lung Pattern Analysis

Lung Nodule Detection using Convolutional Neural Networks with Transfer Learning on CT Images

Computer-Aided Diagnosis (CAD) of Pulmonary Nodule of Thoracic CT Image Using Transfer Learning

DeepLRHE: A Deep Convolutional Neural Network Framework to Evaluate the Risk of Lung Cancer Recurrence and Metastasis From Histopathology Images

Cascaded-Recalibrated Multiple Instance Deep Model for Pathologic-Level Lung Cancer Prediction in CT Images

Precise and automated lung cancer cell classification using deep neural network with multiscale features and model distillation

Semi-Supervised Deep Transfer Learning for Benign-Malignant Diagnosis of Pulmonary Nodules in Chest CT Images

Deep Transfer Convolutional Neural Network and Extreme Learning Machine for lung nodule diagnosis on CT images

Deep learning classification of lung cancer histology using CT images

Deep learning for lung cancer prognostication: A retrospective multi-cohort radiomics study

Enhancing transferability of features from pretrained deep neural networks for lung nodule classification

Pulmonary Nodule Risk Classification in Adenocarcinoma from CT Images Using Deep CNN with Scale Transfer Module