Abstract:Purpose: The limited volume of medical training data remains one of the leading challenges for machine learning for diagnostic applications. Object detectors that identify and localize pathologies require training with a large volume of labeled images, which are often expensive and time-consuming to curate. To reduce this challenge, we present a method to support distant supervision of object detectors through generation of synthetic pathology-present labeled images. Approach: Our method employs the previously proposed cyclic generative adversarial network (cycleGAN) with two key innovations: (1) use of "near-pair" pathology-present regions and pathology-absent regions from similar locations in the same subject for training and (2) the addition of a realism metric (Fréchet inception distance) to the generator loss term. We trained and tested this method with 2800 fracture-present and 2800 fracture-absent image patches from 704 unique pediatric chest radiographs. The trained model was then used to generate synthetic pathology-present images with exact knowledge of location (labels) of the pathology. These synthetic images provided an augmented training set for an object detector. Results: In an observer study, four pediatric radiologists used a five-point Likert scale indicating the likelihood of a real fracture (1 = definitely not a fracture and 5 = definitely a fracture) to grade a set of real fracture-absent, real fracture-present, and synthetic fracture-present images. The real fracture-absent images scored 1.7±1.0, real fracture-present images 4.1±1.2, and synthetic fracture-present images 2.5±1.2. An object detector model (YOLOv5) trained on a mix of 500 real and 500 synthetic radiographs performed with a recall of 0.57±0.05 and an F2 score of 0.59±0.05. In comparison, when trained on only 500 real radiographs, the recall and F2 score were 0.49±0.06 and 0.53±0.06, respectively. Conclusions: Our proposed method generates visually realistic pathology and that provided improved object detector performance for the task of rib fracture detection.

Medical Data Augmentation Using Generative Adversarial Networks : X-ray Image Generation for Transfer Learning of Hip Fracture Detection

GAN Augmentation: Augmenting Training Data using Generative Adversarial Networks

Generative Adversarial Networks for Data Augmentation

GAN-based one dimensional medical data augmentation

Generative Image Translation for Data Augmentation of Bone Lesion Pathology

Synthetic Medical Imaging Generation with Generative Adversarial Networks For Plain Radiographs

Conditional Infilling GANs for Data Augmentation in Mammogram Classification

Data Augmentation Using Generative Adversarial Networks (GANs) For GAN-Based Detection Of Pneumonia And COVID-19 In Chest X-Ray Images

Towards generative adversarial networks as a new paradigm for radiology education

A Critical Assessment of Generative Models for Synthetic Data Augmentation on Limited Pneumonia X-ray Data

Evaluation of Deep Convolutional Generative Adversarial Networks for data augmentation of chest X-ray images

Generating Realistic X-ray Images Using GANs

Near-pair patch generative adversarial network for data augmentation of focal pathology object detection models

How Good Are Synthetic Medical Images? An Empirical Study with Lung Ultrasound

Medical Image Generation Techniques for Data Augmentation: Disc-VAE versus GAN

SAG-GAN: Semi-Supervised Attention-Guided GANs for Data Augmentation on Medical Images

Evaluating GAN-Based Image Augmentation for Threat Detection in Large-Scale Xray Security Images

Synthetic Data Augmentation using GAN for Improved Liver Lesion Classification

Cross-Modality Synthetic Data Augmentation using GANs: Enhancing Brain MRI and Chest X-ray Classification

Generalization of Deep Neural Networks for Chest Pathology Classification in X-Rays Using Generative Adversarial Networks

Learning More with Less: GAN-based Medical Image Augmentation