Abstract:Introduction: Age-related macular degeneration (AMD) is one of the leading causes of vision impairment globally and early detection is crucial to prevent vision loss. However, the screening of AMD is resource dependent and demands experienced healthcare providers. Recently, deep learning (DL) systems have shown the potential for effective detection of various eye diseases from retinal fundus images, but the development of such robust systems requires a large amount of datasets, which could be limited by prevalence of the disease and privacy of patient. As in the case of AMD, the advanced phenotype is often scarce for conducting DL analysis, which may be tackled via generating synthetic images using Generative Adversarial Networks (GANs). This study aims to develop GAN-synthesized fundus photos with AMD lesions, and to assess the realness of these images with an objective scale. Methods: To build our GAN models, a total of 125,012 fundus photos were used from a real-world non-AMD phenotypical dataset. StyleGAN2 and human-in-the-loop (HITL) method were then applied to synthesize fundus images with AMD features. To objectively assess the quality of the synthesized images, we proposed a novel realness scale based on the frequency of the broken vessels observed in the fundus photos. Four residents conducted two rounds of gradings on 300 images to distinguish real from synthetic images, based on their subjective impression and the objective scale respectively. Results and discussion: The introduction of HITL training increased the percentage of synthetic images with AMD lesions, despite the limited number of AMD images in the initial training dataset. Qualitatively, the synthesized images have been proven to be robust in that our residents had limited ability to distinguish real from synthetic ones, as evidenced by an overall accuracy of 0.66 (95% CI: 0.61-0.66) and Cohen's kappa of 0.320. For the non-referable AMD classes (no or early AMD), the accuracy was only 0.51. With the objective scale, the overall accuracy improved to 0.72. In conclusion, GAN models built with HITL training are capable of producing realistic-looking fundus images that could fool human experts, while our objective realness scale based on broken vessels can help identifying the synthetic fundus photos.

Revealing speckle obscured living human retinal cells with artificial intelligence assisted adaptive optics optical coherence tomography

A generative adversarial network with multi-scale convolution and dilated convolution res-network for OCT retinal image despeckling

Multifunctional adaptive optics optical coherence tomography allows cellular scale reflectometry, polarimetry, and angiography in the living human eye

Optical coherence tomography choroidal enhancement using generative deep learning

Generating retinal flow maps from structural optical coherence tomography with artificial intelligence

Deep Learning Based Retinal Layer Segmentation in Optical Coherence Tomography Scans of Patients with Inherited Retinal Diseases

A new microscopy for imaging retinal cells

Resolution enhancement and realistic speckle recovery with generative adversarial modeling of micro-optical coherence tomography

OCT-GAN: Single Step Shadow and Noise Removal from Optical Coherence Tomography Images of the Human Optic Nerve Head

Generative Adversarial Networks Synthesize Realistic OCT Images of the Retina

Quantification of Human Photoreceptor-Retinal Pigment Epithelium Macular Topography with Adaptive Optics-Optical Coherence Tomography

Image enhancement of wide-field retinal optical coherence tomography angiography by super-resolution angiogram reconstruction generative adversarial network

Synthetic artificial intelligence using generative adversarial network for retinal imaging in detection of age-related macular degeneration

Adaptive Optics Rolling Slit Ophthalmoscope: Combining cellular-resolution, high-speed and large field-of-view in a multimodal retinal imager

Generative adversarial networks synthetic optical coherence tomography images as an education tool for image diagnosis of macular diseases: a randomized trial

Deep learning-enabled volumetric cone photoreceptor segmentation in adaptive optics optical coherence tomography images of normal and diseased eyes

High-resolution Imaging of Living Retina Through Optic Adaptive Retinal Imaging System.

Assessment of Generative Adversarial Networks Model for Synthetic Optical Coherence Tomography Images of Retinal Disorders

AI in ophthalmology: From invisible to visible

Application and progress of artificial intelligence technology in the segmentation of hyperreflective foci in OCT images for ophthalmic disease research

Cellular-Level Visualization of Retinal Pathology in Multiple Sclerosis With Adaptive Optics