Abstract:Pancreatic ductal adenocarcinoma (PDAC) presents a critical global health challenge, and early detection is crucial for improving the 5-year survival rate. Recent medical imaging and computational algorithm advances offer potential solutions for early diagnosis. Deep learning, particularly in the form of convolutional neural networks (CNNs), has demonstrated success in medical image analysis tasks, including classification and segmentation. However, the limited availability of clinical data for training purposes continues to provide a significant obstacle. Data augmentation, generative adversarial networks (GANs), and cross-validation are potential techniques to address this limitation and improve model performance, but effective solutions are still rare for 3D PDAC, where contrast is especially poor owing to the high heterogeneity in both tumor and background tissues. In this study, we developed a new GAN-based model, named 3DGAUnet, for generating realistic 3D CT images of PDAC tumors and pancreatic tissue, which can generate the interslice connection data that the existing 2D CT image synthesis models lack. Our innovation is to develop a 3D U-Net architecture for the generator to improve shape and texture learning for PDAC tumors and pancreatic tissue. Our approach offers a promising path to tackle the urgent requirement for creative and synergistic methods to combat PDAC. The development of this GAN-based model has the potential to alleviate data scarcity issues, elevate the quality of synthesized data, and thereby facilitate the progression of deep learning models to enhance the accuracy and early detection of PDAC tumors, which could profoundly impact patient outcomes. Furthermore, this model has the potential to be adapted to other types of solid tumors, hence making significant contributions to the field of medical imaging in terms of image processing models.

MAGAN: Mask Attention Generative Adversarial Network for Liver Tumor CT Image Synthesis

OA-GAN: Organ-Aware Generative Adversarial Network for Synthesizing Contrast-Enhanced Medical Images

Synthesizing Contrast-enhanced Computed Tomography Images with an Improved Conditional Generative Adversarial Network

Light&Fast Generative Adversarial Network for high-fidelity CT image synthesis of liver tumor

End-to-End 3D Liver CT Image Synthesis from Vasculature Using a Multi-Task Conditional Generative Adversarial Network

GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classification

3DGAUnet: 3D generative adversarial networks with a 3D U-Net based generator to achieve the accurate and effective synthesis of clinical tumor image data for pancreatic cancer

Mask-guided generative adversarial network for MRI-based CT synthesis

Multi-Scale Attention Generative Adversarial Network for Medical Image Enhancement

HAGAN: Hybrid Augmented Generative Adversarial Network for Medical Image Synthesis

Attention-Based Multi-Scale Generative Adversarial Network for synthesizing contrast-enhanced MRI

Medical Image Synthesis with Generative Adversarial Networks for Tissue Recognition

Free-form Tumor Synthesis in Computed Tomography Images Via Richer Generative Adversarial Network

Automatic Liver Segmentation in CT Images with Enhanced GAN and Mask Region-Based CNN Architectures

Multi-Modality Generative Adversarial Networks with Tumor Consistency Loss for Brain MR Image Synthesis

Generative Adversarial Network for Medical Images (MI-GAN)

Mask-guided Data Augmentation for Multiparametric MRI Generation with a Rare Hepatocellular Carcinoma

Enhancing Medical Imaging with GANs Synthesizing Realistic Images from Limited Data

Retinal Image Synthesis from Multiple-Landmarks Input with Generative Adversarial Networks.

TCGAN: a transformer-enhanced GAN for PET synthetic CT