Abstract:Synthesis of a large set of high-quality medical images with variability in anatomical representation and image appearance has the potential to provide solutions for tackling the scarcity of properly annotated data in medical image analysis research. In this paper, we propose a novel framework consisting of image segmentation and synthesis based on mask-conditional GANs for generating high-fidelity and diverse Cardiac Magnetic Resonance (CMR) images. The framework consists of two modules: i) a segmentation module trained using a physics-based simulated database of CMR images to provide multi-tissue labels on real CMR images, and ii) a synthesis module trained using pairs of real CMR images and corresponding multi-tissue labels, to translate input segmentation masks to realistic-looking cardiac images. The anatomy of synthesized images is based on labels, whereas the appearance is learned from the training images. We investigate the effects of the number of tissue labels, quantity of training data, and multi-vendor data on the quality of the synthesized images. Furthermore, we evaluate the effectiveness and usability of the synthetic data for a downstream task of training a deep-learning model for cardiac cavity segmentation in the scenarios of data replacement and augmentation. The results of the replacement study indicate that segmentation models trained with only synthetic data can achieve comparable performance to the baseline model trained with real data, indicating that the synthetic data captures the essential characteristics of its real counterpart. Furthermore, we demonstrate that augmenting real with synthetic data during training can significantly improve both the Dice score (maximum increase of 4%) and Hausdorff Distance (maximum reduction of 40%) for cavity segmentation, suggesting a good potential to aid in tackling medical data scarcity.

Active Image Synthesis for Efficient Labeling

Learning to Simulate Labelled Datasets with an Image-Level Content Consistent Graph Constraint

OA-GAN: Organ-Aware Generative Adversarial Network for Synthesizing Contrast-Enhanced Medical Images

Label-informed cardiac magnetic resonance image synthesis through conditional generative adversarial networks

Reducing annotating load: Active learning with synthetic images in surgical instrument segmentation

Embracing Annotation Efficient Learning (AEL) for Digital Pathology and Natural Images

Interactive Data Synthesis for Systematic Vision Adaptation via LLMs-AIGCs Collaboration

MAISI: Medical AI for Synthetic Imaging

Transesophageal Echocardiography Generation using Anatomical Models

A Data Augmentation Pipeline to Generate Synthetic Labeled Datasets of 3D Echocardiography Images using a GAN

SSIS-Seg: Simulation-Supervised Image Synthesis for Surgical Instrument Segmentation

An efficient annotated data generation method for echocardiographic image segmentation

AnySynth: Harnessing the Power of Image Synthetic Data Generation for Generalized Vision-Language Tasks

Robust deep learning for eye fundus images: Bridging real and synthetic data for enhancing generalization

HAL-IA: A Hybrid Active Learning framework using Interactive Annotation for medical image segmentation

Combining Synthetic Images and Deep Active Learning: Data-Efficient Training of an Industrial Object Detection Model

Deep Learning-Based In Situ Micrograph Synthesis and Augmentation for Crystallization Process Image Analysis

Vision-Language Synthetic Data Enhances Echocardiography Downstream Tasks

AI can evolve without labels: self-evolving vision transformer for chest X-ray diagnosis through knowledge distillation

Generalizable Synthetic Image Detection via Language-guided Contrastive Learning

Auto-Generating Weak Labels for Real & Synthetic Data to Improve Label-Scarce Medical Image Segmentation