Abstract:Purpose Fundus fluorescein angiography (FFA) is essential for diagnosing and managing retinal vascular diseases, while its evaluation is time-consuming and subject to inter-observer variability. We aim to develop a deep-learning-based model for accurate multi-lesion segmentation for these diseases. Methods A dataset comprising 428 standard 55 degrees and 53 ultra-wide-field (UWF) FFA images was labeled for various lesions, including non-perfusion areas (NPA), microaneurysms (MA), neovascularization (NV) and laser spots. A U-net-based network was trained and validated (80%) to segment FFA lesions and then tested (20%), with performance assessed via Dice score and Intersection over Union (IoU). Results Our model achieved Dice scores for NPA, MA, NV, and Laser on 55 degrees FFA images at 0.65 plus or minus 0.24, 0.70 plus or minus 0.13, 0.73 plus or minus 0.23, and 0.70 plus or minus 0.17, respectively. UWF results were slightly lower for NPA (0.48 plus or minus 0.21, p=0.02), MA (0.58 plus or minus 0.19, p=0.01), NV (0.50 plus or minus 0.34, p=0.14), but similar for Laser (0.74 plus or minus 0.03, p=0.90). Notably, NV segmentation in choroidal neovascularization achieved a high Dice score of 0.90 plus or minus 0.09, surpassing those in DR (0.68 plus or minus 0.22) and RVO (0.62 plus or minus 0.28), p<0.01. In RVO, NPA segmentation outperformed that in DR, scoring 0.77 plus or minus 0.25 versus 0.59 plus or minus 0.22, p<0.01, while in DR, MA segmentation was superior to that in RVO, with scores of 0.70 plus or minus 0.18 compared to 0.53 plus or minus 0.20, p<0.01. Moreover, NV segmentation was significantly stronger in venous phase (0.77 plus or minus 0.17) and late phase (0.75 plus or minus 0.24) compared to arteriovenous phase (0.50 plus or minus 0.32), p<0.05. Conclusion This study has established a model for precise multi-lesion segmentation in retinal vascular diseases using 55 degrees and UWF FFA images. This multi-lesion segmentation model has the potential to expand databases, ease grader burden and standardize FFA image interpretation, thereby improving disease management. Furthermore, it enhances interpretable AI, fostering the development of sophisticated systems and promoting cross-modal image generation for medical applications.

Detecting Diverse Retinal Lesions Based on Low-Rank-Plus-Sparse Factorization over Normal Retinal Images

Diverse Lesion Detection from Retinal Images by Subspace Learning over Normal Samples.

Weakly Supervised Lesion Detection from Fundus Images

Hyperspectral Anomaly Detection Via Locally Enhanced Low-Rank Prior

Unsupervised Retinal Lesion Detection by Learning to Restore Corrupted Fundus Images

Automatic Detection of Longitudinal Changes for Retinal Fundus Images Based on Low-Rank Decomposition

Individualized Statistical Modeling of Lesions in Fundus Images for Anomaly Detection

Mini Lesions Detection on Diabetic Retinopathy Images via Large Scale CNN Features

Pseudo-Labeling for Small Lesion Detection on Diabetic Retinopathy Images

Exploiting the Transferability of Deep Learning Systems Across Multi-modal Retinal Scans for Extracting Retinopathy Lesions

A Framework for Identifying Diabetic Retinopathy Based on Anti-noise Detection and Attention-Based Fusion.

A Novel Lesion Detection Algorithm Based on Multi-Scale Input Convolutional Neural Network Model for Diabetic Retinopathy

Lesion detection in ultra-wide field retinal images for diabetic retinopathy diagnosis

Abnormality Detection in Retinal Image by Individualized Background Learning

Rotation-Oriented Collaborative Self-Supervised Learning for Retinal Disease Diagnosis

Learn to Segment Retinal Lesions and Beyond

Hierarchical Detection of Red Lesions in Retinal Images by Multiscale Correlation Filtering.

Automated Interpretation of Fundus Fluorescein Angiography with Multi-Retinal Lesion Segmentation

Lesion-Aware Contrastive Learning for Diabetic Retinopathy Diagnosis

A Lesion-Fusion Neural Network for Multi-View Diabetic Retinopathy Grading

Diabetic Retinopathy Grading with Weakly-Supervised Lesion Priors