Abstract:Chest X-rays are a vital diagnostic tool in the workup of many patients. Similar to most medical imaging modalities, they are profoundly multi-modal and are capable of visualising a variety of combinations of conditions. There is an ever pressing need for greater quantities of labelled images to drive forward the development of diagnostic tools; however, this is in direct opposition to concerns regarding patient confidentiality which constrains access through permission requests and ethics approvals. Previous work has sought to address these concerns by creating class-specific generative adversarial networks (GANs) that synthesise images to augment training data. These approaches cannot be scaled as they introduce computational trade offs between model size and class number which places fixed limits on the quality that such generates can achieve. We address this concern by introducing latent class optimisation which enables efficient, multi-modal sampling from a GAN and with which we synthesise a large archive of labelled generates. We apply a Progressive Growing GAN (PGGAN) to the task of unsupervised X-ray synthesis and have radiologists evaluate the clinical realism of the resultant samples. We provide an in depth review of the properties of varying pathologies seen on generates as well as an overview of the extent of disease diversity captured by the model. We validate the application of the Fréchet Inception Distance (FID) to measure the quality of X-ray generates and find that they are similar to other high-resolution tasks. We quantify X-ray clinical realism by asking radiologists to distinguish between real and fake scans and find that generates are more likely to be classed as real than by chance, but there is still progress required to achieve true realism. We confirm these findings by evaluating synthetic classification model performance on real scans. We conclude by discussing the limitations of PGGAN generates and how to achieve controllable, realistic generates going forward. We release our source code, model weights, and an archive of labelled generates.

Realistic Chest X‐Ray Image Synthesis via Generative Network with Stochastic Memristor Array for Machine Learning‐Based Medical Diagnosis

Image Turing test and its applications on synthetic chest radiographs by using the progressive growing generative adversarial network

Synthetic Medical Imaging Generation with Generative Adversarial Networks For Plain Radiographs

Evaluating diagnostic content of AI-generated chest radiography: A multi-center visual Turing test

Evaluating the Clinical Realism of Synthetic Chest X-Rays Generated Using Progressively Growing GANs

Generating Realistic X-ray Images Using GANs

Controllable Medical Image Generation via GAN

Realistic High-Resolution Body Computed Tomography Image Synthesis by Using Progressive Growing Generative Adversarial Network: Visual Turing Test

High-resolution medical image synthesis using progressively grown generative adversarial networks

Medical Image Synthesis for Data Augmentation and Anonymization using Generative Adversarial Networks

Evaluating the feasibility of using Generative Models to generate Chest X-Ray Data

Controllable Medical Image Generation via Generative Adversarial Networks

Generating Realistic COVID19 X-rays with a Mean Teacher + Transfer Learning GAN

Enhancing Medical Imaging with GANs Synthesizing Realistic Images from Limited Data

Label-informed cardiac magnetic resonance image synthesis through conditional generative adversarial networks

A Critical Assessment of Generative Models for Synthetic Data Augmentation on Limited Pneumonia X-ray Data

Method for Generating Synthetic Data Combining Chest Radiography Images with Tabular Clinical Information Using Dual Generative Models

Insights and Considerations in Development and Performance Evaluation of Generative Adversarial Networks (GANs): What Radiologists Need to Know

Prior-guided generative adversarial network for mammogram synthesis

Cross-Modality Synthetic Data Augmentation using GANs: Enhancing Brain MRI and Chest X-ray Classification

Generalization of Deep Neural Networks for Chest Pathology Classification in X-Rays Using Generative Adversarial Networks