Abstract:Importance: Deep learning (DL) used for discriminative tasks in ophthalmology, such as diagnosing diabetic retinopathy or age-related macular degeneration (AMD), requires large image data sets graded by human experts to train deep convolutional neural networks (DCNNs). In contrast, generative DL techniques could synthesize large new data sets of artificial retina images with different stages of AMD. Such images could enhance existing data sets of common and rare ophthalmic diseases without concern for personally identifying information to assist medical education of students, residents, and retinal specialists, as well as for training new DL diagnostic models for which extensive data sets from large clinical trials of expertly graded images may not exist. Objective: To develop DL techniques for synthesizing high-resolution realistic fundus images serving as proxy data sets for use by retinal specialists and DL machines. Design, setting, and participants: Generative adversarial networks were trained on 133 821 color fundus images from 4613 study participants from the Age-Related Eye Disease Study (AREDS), generating synthetic fundus images with and without AMD. We compared retinal specialists' ability to diagnose AMD on both real and synthetic images, asking them to assess image gradability and testing their ability to discern real from synthetic images. The performance of AMD diagnostic DCNNs (referable vs not referable AMD) trained on either all-real vs all-synthetic data sets was compared. Main outcomes and measures: Accuracy of 2 retinal specialists (T.Y.A.L. and K.D.P.) for diagnosing and distinguishing AMD on real vs synthetic images and diagnostic performance (area under the curve) of DL algorithms trained on synthetic vs real images. Results: The diagnostic accuracy of 2 retinal specialists on real vs synthetic images was similar. The accuracy of diagnosis as referable vs nonreferable AMD compared with certified human graders for retinal specialist 1 was 84.54% (error margin, 4.06%) on real images vs 84.12% (error margin, 4.16%) on synthetic images and for retinal specialist 2 was 89.47% (error margin, 3.45%) on real images vs 89.19% (error margin, 3.54%) on synthetic images. Retinal specialists could not distinguish real from synthetic images, with an accuracy of 59.50% (error margin, 3.93%) for retinal specialist 1 and 53.67% (error margin, 3.99%) for retinal specialist 2. The DCNNs trained on real data showed an area under the curve of 0.9706 (error margin, 0.0029), and those trained on synthetic data showed an area under the curve of 0.9235 (error margin, 0.0045). Conclusions and relevance: Deep learning-synthesized images appeared to be realistic to retinal specialists, and DCNNs achieved diagnostic performance on synthetic data close to that for real images, suggesting that DL generative techniques hold promise for training humans and machines.

Synthetic artificial intelligence using generative adversarial network for retinal imaging in detection of age-related macular degeneration

Synthesizing New Retinal Symptom Images by Multiple Generative Models

Assessment of Deep Generative Models for High-Resolution Synthetic Retinal Image Generation of Age-Related Macular Degeneration

Robust deep learning for eye fundus images: Bridging real and synthetic data for enhancing generalization

A deep learning model for generating fundus autofluorescence images from color fundus photography

Translating color fundus photography to indocyanine green angiography using deep-learning for age-related macular degeneration screening

Assessment of Generative Adversarial Networks Model for Synthetic Optical Coherence Tomography Images of Retinal Disorders

Prediction of OCT Images of Short-Term Response to Anti-Vegf Treatment for Neovascular Age-Related Macular Degeneration Using Generative Adversarial Network.

Synthesizing realistic high-resolution retina image by style-based generative adversarial network and its utilization

Automated Grading of Age-Related Macular Degeneration From Color Fundus Images Using Deep Convolutional Neural Networks

Predicting Progression of Age-related Macular Degeneration from Fundus Images using Deep Learning

DR-GAN: Conditional Generative Adversarial Network for Fine-Grained Lesion Synthesis on Diabetic Retinopathy Images

AMD-GAN: Attention Encoder and Multi-Branch Structure Based Generative Adversarial Networks for Fundus Disease Detection from Scanning Laser Ophthalmoscopy Images.

Generative adversarial networks synthetic optical coherence tomography images as an education tool for image diagnosis of macular diseases: a randomized trial

Fundus Image Analysis for Age Related Macular Degeneration: ADAM-2020 Challenge Report

High-Resolution Diabetic Retinopathy Image Synthesis Manipulated by Grading and Lesions

Assessment of Generative Adversarial Networks for Synthetic Anterior Segment Optical Coherence Tomography Images in Closed-Angle Detection.

Controllable retinal image synthesis using conditional StyleGAN and latent space manipulation for improved diagnosis and grading of diabetic retinopathy

Retinal Image Synthesis from Multiple-Landmarks Input with Generative Adversarial Networks.

Generating Synthesized Fluorescein Angiography Images From Color Fundus Images by Generative Adversarial Networks for Macular Edema Assessment

Artificial Intelligence for the Detection of Age-Related Macular Degeneration in Color Fundus Photographs: A Systematic Review and Meta-Analysis