Abstract:BACKGROUND:Medical datasets, especially medical images, are often imbalanced due to the different incidences of various diseases. To address this problem, many methods have been proposed to synthesize medical images using generative adversarial networks (GANs) to enlarge training datasets for facilitating medical image analysis. For instance, conventional methods such as image-to-image translation techniques are used to synthesize fundus images with their respective vessel trees in the field of fundus image.METHODS:In order to improve the image quality and details of the synthetic images, three key aspects of the pipeline are mainly elaborated: the input mask, architecture of GANs, and the resolution of paired images. We propose a new preprocessing pipeline named multiple-channels-multiple-landmarks (MCML), aiming to synthesize color fundus images from a combination of vessel tree, optic disc, and optic cup images. We compared both single vessel mask input and MCML mask input on two public fundus image datasets (DRIVE and DRISHTI-GS) with different kinds of Pix2pix and Cycle-GAN architectures. A new Pix2pix structure with ResU-net generator is also designed, which has been compared with the other models.RESULTS AND CONCLUSION:As shown in the results, the proposed MCML method outperforms the single vessel-based methods for each architecture of GANs. Furthermore, we find that our Pix2pix model with ResU-net generator achieves superior PSNR and SSIM performance than the other GANs. High-resolution paired images are also beneficial for improving the performance of each GAN in this work. Finally, a Pix2pix network with ResU-net generator using MCML and high-resolution paired images are able to generate good and realistic fundus images in this work, indicating that our MCML method has great potential in the field of glaucoma computer-aided diagnosis based on fundus image.

Retinal fundus image superresolution generated by optical coherence tomography based on a realistic mixed attention GAN

A generative adversarial network with multi-scale convolution and dilated convolution res-network for OCT retinal image despeckling

Image enhancement of wide-field retinal optical coherence tomography angiography by super-resolution angiogram reconstruction generative adversarial network

Resolution enhancement and realistic speckle recovery with generative adversarial modeling of micro-optical coherence tomography

Assessment of Generative Adversarial Networks Model for Synthetic Optical Coherence Tomography Images of Retinal Disorders

Improved generative adversarial network for retinal image super-resolution

Learning Structral Coherence Via Generative Adversarial Network for Single Image Super-Resolution

Retinal fundus image super-resolution based on generative adversarial network guided with vascular structure prior

Super-resolution technology to simultaneously improve optical & digital resolution of optical coherence tomography via deep learning.

GAN-based Super-Resolution and Segmentation of Retinal Layers in Optical coherence tomography Scans

RIRGAN: an End-to-end Lightweight Multi-Task Learning Method for Brain MRI Super-Resolution and Denoising

Unpaired Optical Coherence Tomography Angiography Image Super-Resolution via Frequency-Aware Inverse-Consistency GAN

VSG-GAN: A high-fidelity image synthesis method with semantic manipulation in retinal fundus image

Sharp And Real Image Super-Resolution Using Generative Adversarial Network

Superresolution reconstruction of optical remote sensing images based on a multiscale attention adversarial network

Creating Realistic Anterior Segment Optical Coherence Tomography Images using Generative Adversarial Networks

Retinal Image Synthesis from Multiple-Landmarks Input with Generative Adversarial Networks.

Image super-resolution reconstruction based on generative adversarial network model with feedback and attention mechanisms

High-Resolution Diabetic Retinopathy Image Synthesis Manipulated by Grading and Lesions

Generative Adversarial Networks Synthesize Realistic OCT Images of the Retina

A fundus image enhancer based on illumination-guided attention and optic disc perception GAN