Abstract:Synthesis of a large set of high-quality medical images with variability in anatomical representation and image appearance has the potential to provide solutions for tackling the scarcity of properly annotated data in medical image analysis research. In this paper, we propose a novel framework consisting of image segmentation and synthesis based on mask-conditional GANs for generating high-fidelity and diverse Cardiac Magnetic Resonance (CMR) images. The framework consists of two modules: i) a segmentation module trained using a physics-based simulated database of CMR images to provide multi-tissue labels on real CMR images, and ii) a synthesis module trained using pairs of real CMR images and corresponding multi-tissue labels, to translate input segmentation masks to realistic-looking cardiac images. The anatomy of synthesized images is based on labels, whereas the appearance is learned from the training images. We investigate the effects of the number of tissue labels, quantity of training data, and multi-vendor data on the quality of the synthesized images. Furthermore, we evaluate the effectiveness and usability of the synthetic data for a downstream task of training a deep-learning model for cardiac cavity segmentation in the scenarios of data replacement and augmentation. The results of the replacement study indicate that segmentation models trained with only synthetic data can achieve comparable performance to the baseline model trained with real data, indicating that the synthetic data captures the essential characteristics of its real counterpart. Furthermore, we demonstrate that augmenting real with synthetic data during training can significantly improve both the Dice score (maximum increase of 4%) and Hausdorff Distance (maximum reduction of 40%) for cavity segmentation, suggesting a good potential to aid in tackling medical data scarcity.

Echocardiography Segmentation Based on Cross-modal Data Augmentation Method

An efficient annotated data generation method for echocardiographic image segmentation

Segmentation of Cardiac Tissues and Organs for CCTA Images Based on a Deep Learning Model

A Data Augmentation Pipeline to Generate Synthetic Labeled Datasets of 3D Echocardiography Images using a GAN

A Disentanglement and Fusion Data Augmentation Approach for Echocardiography Segmentation

Transesophageal Echocardiography Generation using Anatomical Models

CT2US: Cross-modal transfer learning for kidney segmentation in ultrasound images with synthesized data

Echo from noise: synthetic ultrasound image generation using diffusion models for real image segmentation

Fully Automated Machine Learning Pipeline for Echocardiogram Segmentation

GSDA: Generative Adversarial Network-based Semi-Supervised Data Augmentation for Ultrasound Image Classification

Cardiac LGE MRI Segmentation with Cross-Modality Image Augmentation and Improved U-Net

Cross-modal Transfer Learning Based on an Improved CycleGAN Model for Accurate Kidney Segmentation in Ultrasound Images

Cross-Domain Echocardiography Segmentation with Multi-Space Joint Adaptation.

Towards cross-modal organ translation and segmentation: A cycle- and shape-consistent generative adversarial network

S-CycleGAN: Semantic Segmentation Enhanced CT-Ultrasound Image-to-Image Translation for Robotic Ultrasonography

XCAT-GAN for Synthesizing 3D Consistent Labeled Cardiac MR Images on Anatomically Variable XCAT Phantoms

Annotation Cost Minimization for Ultrasound Image Segmentation Using Cross-domain Transfer Learning.

Label-informed cardiac magnetic resonance image synthesis through conditional generative adversarial networks

Data augmentation for computed tomography angiography via synthetic image generation and neural domain adaptation

Synthetic augmentation for semantic segmentation of class imbalanced biomedical images: A data pair generative adversarial network approach

Data Augmentation Using Learned Transformations for One-Shot Medical Image Segmentation