Abstract:Background and objective: Fundus fluorescein angiography (FFA) is widely used in clinical ophthalmic diagnosis and treatment with the requirement of adverse fluorescent dyes injection. Recently, many deep Convolutional Neural Network(CNN)-based methods have been proposed to estimate FFA from color fundus (CF) images to eliminate the use of adverse fluorescent dyes. However, the robustness of these methods is affected by pathological changes. Method: In this work, we present a CNN-based approach, lesion-aware generative adversarial networks (LA-GAN), to enhance the visual effect of lesion characteristics in the generated FFA images. First, we lead the generator notice lesion information by joint learning with lesion region segmentation. A new hierarchical correlation multi-task framework for high-resolution images is designed. Second, to enhance the visual contrast between normal regions and lesion regions, a newly designed region-level adversarial loss is used rather than the image-level adversarial loss. The code is publicly available at: https://github.com/nicetomeetu21/LA-GAN. Results: The effectiveness of LA-Net has been verified in data with branch retinal vein occlusion. The proposed model reported as measures of generation performance a mean structural similarity (SSIM) of 0.536, mean learned perceptual image patch similarity (LPIPS) 0.312, outperforming other FFA generation and general image generation methods. Further, due to the proposed multi-task learning framework, the lesion-region segmentation performance was further reported as the mean Dice increased from 0.714 to 0.797 and the mean accuracy increased from 0.873 to 0.905, outperforming general single-task image segmentation methods. Conclusions: The results show that the visual effect of lesion characteristics can be improved by employing the region-level adversarial loss and the hierarchical correlation multi-task framework respectively. Based on the results of comparison with the state-of-the-art methods, LA-GAN is not only effective for CF-to-FFA translation, but also effective for lesion-region segmentation. Thus, it may be used for various image translation and lesion segmentation tasks in future research.

UWAFA-GAN: Ultra-Wide-Angle Fluorescein Angiography Transformation via Multi-Scale Generation and Registration Enhancement

UWAFA-GAN: Ultra-Wide-Angle Fluorescein Angiography Transformation via Multi-scale Generation and Registration Enhancement

UWAT-GAN: Fundus Fluorescein Angiography Synthesis via Ultra-wide-angle Transformation Multi-scale GAN

UWF-RI2FA: Generating Multi-frame Ultrawide-field Fluorescein Angiography from Ultrawide-field Retinal Imaging Improves Diabetic Retinopathy Stratification

Optimizing the Quality of Fourier Single-Pixel Imaging Via Generative Adversarial Network

FQ-UWF: Unpaired Generative Image Enhancement for Fundus Quality Ultra-Widefield Retinal Images

LPUWF-LDM: Enhanced Latent Diffusion Model for Precise Late-phase UWF-FA Generation on Limited Dataset

OA-GAN: Organ-Aware Generative Adversarial Network for Synthesizing Contrast-Enhanced Medical Images

Development and Validation of an Automatic Ultrawide-Field Fundus Imaging Enhancement System for Facilitating Clinical Diagnosis: A Cross-sectional Multicenter Study

Fundus2Angio: A Conditional GAN Architecture for Generating Fluorescein Angiography Images from Retinal Fundus Photography

Synthesizing multi-frame high-resolution fluorescein angiography images from retinal fundus images using generative adversarial networks

Fundus2Video: Cross-Modal Angiography Video Generation from Static Fundus Photography with Clinical Knowledge Guidance

Generating Fundus Fluorescence Angiography Images from Structure Fundus Images Using Generative Adversarial Networks

Attention2AngioGAN: Synthesizing Fluorescein Angiography from Retinal Fundus Images using Generative Adversarial Networks

Leveraging Regular Fundus Images for Training UWF Fundus Diagnosis Models via Adversarial Learning and Pseudo-Labeling

Fundus to Fluorescein Angiography Video Generation as a Retinal Generative Foundation Model

Lesion-aware generative adversarial networks for color fundus image to fundus fluorescein angiography translation

Non-Invasive to Invasive: Enhancing FFA Synthesis from CFP with a Benchmark Dataset and a Novel Network

Unpaired fundus image enhancement based on constrained generative adversarial networks

Multiple-ResNet GAN: An enhanced high-resolution image generation method for translation from fundus structure image to fluorescein angiography

Generating Synthesized Fluorescein Angiography Images From Color Fundus Images by Generative Adversarial Networks for Macular Edema Assessment