Abstract:BACKGROUND:Medical datasets, especially medical images, are often imbalanced due to the different incidences of various diseases. To address this problem, many methods have been proposed to synthesize medical images using generative adversarial networks (GANs) to enlarge training datasets for facilitating medical image analysis. For instance, conventional methods such as image-to-image translation techniques are used to synthesize fundus images with their respective vessel trees in the field of fundus image.METHODS:In order to improve the image quality and details of the synthetic images, three key aspects of the pipeline are mainly elaborated: the input mask, architecture of GANs, and the resolution of paired images. We propose a new preprocessing pipeline named multiple-channels-multiple-landmarks (MCML), aiming to synthesize color fundus images from a combination of vessel tree, optic disc, and optic cup images. We compared both single vessel mask input and MCML mask input on two public fundus image datasets (DRIVE and DRISHTI-GS) with different kinds of Pix2pix and Cycle-GAN architectures. A new Pix2pix structure with ResU-net generator is also designed, which has been compared with the other models.RESULTS AND CONCLUSION:As shown in the results, the proposed MCML method outperforms the single vessel-based methods for each architecture of GANs. Furthermore, we find that our Pix2pix model with ResU-net generator achieves superior PSNR and SSIM performance than the other GANs. High-resolution paired images are also beneficial for improving the performance of each GAN in this work. Finally, a Pix2pix network with ResU-net generator using MCML and high-resolution paired images are able to generate good and realistic fundus images in this work, indicating that our MCML method has great potential in the field of glaucoma computer-aided diagnosis based on fundus image.

GAN-Based Focusing-Enhancement Method for Monochromatic Synthetic Aperture Imaging

Chip-compatible wide-field 3D nanoscopy through tunable spatial frequency shift effect

Optimizing the Quality of Fourier Single-Pixel Imaging Via Generative Adversarial Network

Focal modulation microscopy with annular apertures: a numerical study.

Multi-image-distance Imaging System for Extending Depth-of-field

Machine learning guided rapid focusing with sensor-less aberration corrections.

MFIF-GAN: A New Generative Adversarial Network for Multi-Focus Image Fusion

MFF-GAN: An unsupervised generative adversarial network with adaptive and gradient joint constraints for multi-focus image fusion

Reconstruct high-resolution multi-focal plane images from a single 2D wide field image

A GAN-based fast focusing method for circular SAR images

Parallelized aperture synthesis using multi-aperture Fourier ptychographic microscopy

Synthetic multi-focus optical-resolution photoacoustic microscope using multi-scale weighted gradient-based fusion

Fusion-UDCGAN: Multifocus Image Fusion via a U-Type Densely Connected Generation Adversarial Network

Super-resolution reconstruction method of the optical synthetic aperture image using generative adversarial network

Retinal Image Synthesis from Multiple-Landmarks Input with Generative Adversarial Networks.

Synthetic multi-focus optical-resolution photoacoustic microscope for large volumetric imaging

Neural-Network-Enhanced Metalens Camera for High-Definition, Dynamic Imaging in the Long-Wave Infrared Spectrum

Deep Attentional GAN-based High-Resolution Ultrasound Imaging

Super-Resolution Enhancement Method Based on Generative Adversarial Network for Integral Imaging Microscopy

MEFSR-GAN: A Multi-Exposure Feedback and Super-Resolution Multitask Network via Generative Adversarial Networks

Resolution enhancement and realistic speckle recovery with generative adversarial modeling of micro-optical coherence tomography