Abstract:Purpose/Objective(s) To develop an automated lung cancer segmentation method using dual-modality imaging and deep learning, and to perform clinical evaluation of the method. Materials/Methods A 3D neural network with dual inputs from diagnostic PET and simulation CT was constructed based on U-Net. The architecture consisted of two parallel convolution paths for independent feature extractions from PET and CT at multiple resolution levels and a single deconvolution path. At each resolution level, the extracted features from the convolution arms were concatenated and fed into the deconvolution path through skip connections. The network was trained/validated/tested by a 3:1:1 split on a dataset of 290 pairs of PET and CT from lung cancer patients treated at our institution, with manual physician contours as the ground truth. The performance of the 3D dual-modality network was compared against that of a CT-only network. evaluated both the manual and the network-produced tumor contours of a randomly selected subset of 20 cases (10 large and 10 small) in a blinded fashion. Results The mean Dice similarity coefficient (DSC), Hausdorff Distance (HD), and bi-directional local distance (BLD) comparing the automatic contours versus the ground truth were 0.77 ± 0.12, 7.6 ± 4.7 mm, and 2.9 ± 1.4 mm, and 0.79 ± 0.10, 5.8 ± 3.2 mm, and 2.8 ± 1.5 mm for dual modality inputs, respectively. The stratification method delivered the best results when the model for the large GTV subset (> 25 ml) was trained with GTVs of all sizes (DSC, HD, BLD of 0.85 ± 0.05, 9.5 ± 3.8 mm, and 3.8 ± 1.8 mm), and that for the small GTV subset (< 25 ml) was trained with small GTVs only (DSC, HD, BLD of 0.82 ± 0.08, 3.7 ± 1.7 mm, and 2.2 ± 1.1 mm). From the stratified results, the best combined overall DSC, HD, and BLD were 0.83 ± 0.07, 5.9 ± 2.5 mm, and 2.8 ± 1.4 mm, respectively. In the multi-observer review, on average 91.25% of manual vs. 88.75% of automatic contours were Accepted or Accepted with Modifications. (50% Accepted, 41.25% Accepted w/ Mods and 6.25% Rejected for manual vs. 18.75%, 70%, and 8.75% for automatic), the modifications on the automatic contours were relatively minor with a mean DSC of 0.92 ± 0.04 between the original and modified, comparable to the mean DSC of 0.90 ± 0.04 between all the modified contours and their manual ground truths. Conclusion By utilizing an expansive clinical PET and CT image database and a dual-modality architecture, the proposed 3D network with a novel GTV volume-based stratification strategy was able to generate clinically useful lung cancer contours that were quantitatively similar to the ground truth and highly acceptable in physician review.

Lung Cancer Identification Based On Image Content

Intelligent Lung Cancer Identification Based on Image Features

Research on Application of Morphological, Color Features and Neural Network to the Recognition of Lung Cancer Cells

Image segmentation algorithm of lung cancer based on neural network model

A Chromatic Image Understanding System for Lung Cancer Cell Identification Based on Fuzzy Knowledge

An Explainable Classification Method Based on Complex Scaling in Histopathology Images for Lung and Colon Cancer

Clinical Application of Image Processing and Neural Network in Cytopathological Diagnosis of Lung Cancer

Computer-Aided Lung Cancer Diagnosis Approaches Based on Deep Learning

Design and Implementation of Lung Cancer Diagnosis System Based on Cell Images

Automated Lung Cancer Diagnosis Applying Butterworth Filtering, Bi-Level Feature Extraction, and Sparce Convolutional Neural Network to Luna 16 CT Images

A Neural Network and Optimization Based Lung Cancer Detection System in CT Images

Lung cancer diagnosis in CT images based on Alexnet optimized by modified Bowerbird optimization algorithm

Using Deep Learning for Classification of Lung Nodules on Computed Tomography Images

An intelligent medical image understanding method using two-tier neural network ensembles

Artificial Intelligence Recognition Model Using Liquid-based Cytology Images to Discriminate Malignancy and Histological Types of Non-small-cell Lung Cancer

Lung Cancer Classification Using Image Enhancement and CNN-Based Pre-Trained Models

An Interpretable Three-Dimensional Artificial Intelligence Model for Computer-Aided Diagnosis of Lung Nodules in Computed Tomography Images

Automated Lung Cancer Segmentation Using a Dual-Modality Deep Learning Network with PET and CT Images

Identification of Pulmonary Nodules Via CT Images with Hierarchical Fully Convolutional Networks.

Precise and automated lung cancer cell classification using deep neural network with multiscale features and model distillation

Lung cancer detection using co-learning from chest CT images and clinical demographics