Abstract:PURPOSE:Segmentation of pulmonary nodules is critical for the analysis of nodules and lung cancer diagnosis. We present a novel framework of segmentation for various types of nodules using convolutional neural networks (CNNs).METHODS:The proposed framework is composed of two major parts. The first part is to increase the variety of samples and build a more balanced dataset. A conditional generative adversarial network (cGAN) is employed to produce synthetic CT images. Semantic labels are generated to impart spatial contextual knowledge to the network. Nine attribute scoring labels are combined as well to preserve nodule features. To refine the realism of synthesized samples, reconstruction error loss is introduced into cGAN. The second part is to train a nodule segmentation network on the extended dataset. We build a three-dimensional (3D) CNN model that exploits heterogeneous maps including edge maps and local binary pattern maps. The incorporation of these maps informs the model of texture patterns and boundary information of nodules, which assists high-level feature learning for segmentation. Residual unit, which learns to reduce residual error, is adopted to accelerate training and improve accuracy.RESULTS:Validation on LIDC-IDRI dataset demonstrates that the generated samples are realistic. The mean squared error and average cosine similarity between real and synthesized samples are 1.55 × 10 - 2 and 0.9534, respectively. The Dice coefficient, positive predicted value, sensitivity, and accuracy are, respectively, 0.8483, 0.8895, 0.8511, and 0.9904 for the segmentation results.CONCLUSIONS:The proposed 3D CNN segmentation framework, based on the use of synthesized samples and multiple maps with residual learning, achieves more accurate nodule segmentation compared to existing state-of-the-art methods. The proposed CT image synthesis method can not only output samples close to real images but also allow for stochastic variation in image diversity.

A Novel Data Augmentation Method Using Style-Based GAN for Robust Pulmonary Nodule Segmentation

CT-realistic Data Augmentation Using Generative Adversarial Network for Robust Lymph Node Segmentation.

CT-Realistic Lung Nodule Simulation from 3D Conditional Generative Adversarial Networks for Robust Lung Segmentation

Tunable CT Lung Nodule Synthesis Conditioned on Background Image and Semantic Features

Improving CT Image Segmentation Accuracy Using StyleGAN Driven Data Augmentation

Pulmonary Nodule Segmentation with CT Sample Synthesis Using Adversarial Networks

Image Synthesis with Disentangled Attributes for Chest X-Ray Nodule Augmentation and Detection

A Data Augmentation Method and the Embedding Mechanism for Detection and Classification of Pulmonary Nodules on Small Samples

3D conditional generative adversarial network‐based synthetic medical image augmentation for lung nodule detection

Lung Nodule Data Enhancement Algorithm Based on Generative Adversarial Network

SAG-GAN: Semi-Supervised Attention-Guided GANs for Data Augmentation on Medical Images

Softgan: Towards Accurate Lung Nodule Segmentation Via Soft Mask Supervision

Lung cancer CT image generation from a free-form sketch using style-based pix2pix for data augmentation

MTGAN: Mask and Texture-driven Generative Adversarial Network for Lung Nodule Segmentation

Functional-realistic CT Image Super-Resolution for Early-Stage Pulmonary Nodule Detection

Additional Look into GAN-based Augmentation for Deep Learning COVID-19 Image Classification

Data Augmentation For Medical MR Image Using Generative Adversarial Networks

DACov: A Deeper Analysis of Data Augmentation on the Computed Tomography Segmentation Problem

Realistic Lung Nodule Synthesis with Multi-Target Co-Guided Adversarial Mechanism

GAN Augmentation: Augmenting Training Data using Generative Adversarial Networks

An Enhanced Priori Knowledge GAN for CT Images Generation of Early Lung Nodules with Small-Size Labelled Samples