Abstract:Objective: As an extension of optical coherence tomography (OCT), optical coherence tomographic angiography (OCTA) provides information on the blood flow status at the microlevel and is sensitive to changes in the fundus vessels. However, due to the distinct imaging mechanism of OCTA, existing models, which are primarily used for analyzing fundus images, do not work well on OCTA images. Effectively extracting and analyzing the information in OCTA images remains challenging. To this end, a deep learning framework that fuses multilevel information in OCTA images is proposed in this study. The effectiveness of the proposed model was demonstrated in the task of diabetic retinopathy (DR) classification. Method: First, a U-Net-based segmentation model was proposed to label the boundaries of large retinal vessels and the foveal avascular zone (FAZ) in OCTA images. Then, we designed an isolated concatenated block (ICB) structure to extract and fuse information from the original OCTA images and segmentation results at different fusion levels. Results: The experiments were conducted on 301 OCTA images. Of these images, 244 were labeled by ophthalmologists as normal images, and 57 were labeled as DR images. An accuracy of 93.1% and a mean intersection over union (mIOU) of 77.1% were achieved using the proposed large vessel and FAZ segmentation model. In the ablation experiment with 6-fold validation, the proposed deep learning framework that combines the proposed isolated and concatenated convolution process significantly improved the DR diagnosis accuracy. Moreover, inputting the merged images of the original OCTA images and segmentation results further improved the model performance. Finally, a DR diagnosis accuracy of 88.1% (95%CI ± 3.6%) and an area under the curve (AUC) of 0.92 were achieved using our proposed classification model, which significantly outperforms the state-of-the-art classification models. As a comparison, an accuracy of 83.7 (95%CI ± 1.5%) and AUC of 0.76 were obtained using EfficientNet. Significance. The visualization results show that the FAZ and the vascular region close to the FAZ provide more information for the model than the farther surrounding area. Furthermore, this study demonstrates that a clinically sophisticated designed deep learning model is not only able to effectively assist in the diagnosis but also help to locate new indicators for certain illnesses.

A multi-level context fusion network for exudate segmentation in retinal images

Multi-Scale and Multi-Branch Convolutional Neural Network for Retinal Image Segmentation

CLC-Net: Contextual and Local Collaborative Network for Lesion Segmentation in Diabetic Retinopathy Images

A Residual Encoder-Decoder Network for Segmentation of Retinal Image-Based Exudates in Diabetic Retinopathy Screening

An Improved U-shape Neural Network for Soft Exudate Segmentation

A Location-to-segmentation Strategy for Automatic Exudate Segmentation in Colour Retinal Fundus Images

Graph-based multi-level feature fusion network for diabetic retinopathy grading using ultra-wide-field images

Feature fusion and optimization integrated refined deep residual network for diabetic retinopathy severity classification using fundus image

A Global and Patch-wise Contrastive Loss for Accurate Automated Exudate Detection

An attention enriched encoder–decoder architecture with CLSTM and RES unit for segmenting exudate in retinal images

Contextual Information Enhanced Convolutional Neural Networks for Retinal Vessel Segmentation in Color Fundus Images

A retinal vessel segmentation network with multiple-dimension attention and adaptive feature fusion

DRDr: Automatic Masking of Exudates and Microaneurysms Caused By Diabetic Retinopathy Using Mask R-CNN and Transfer Learning

A Framework for Identifying Diabetic Retinopathy Based on Anti-noise Detection and Attention-Based Fusion.

Retinal Vessels Segmentation Based on Dilated Multi-Scale Convolutional Neural Network

Prior-guided attention fusion transformer for multi-lesion segmentation of diabetic retinopathy

Learn to Segment Retinal Lesions and Beyond

DPF-Net: A Dual-Path Progressive Fusion Network for Retinal Vessel Segmentation

RMSDSC‐Net: A robust multiscale feature extraction with depthwise separable convolution network for optic disc and cup segmentation

Diagnosing Diabetic Retinopathy in OCTA Images Based on Multilevel Information Fusion Using a Deep Learning Framework

Enhanced diabetic retinopathy detection and exudates segmentation using deep learning: A promising approach for early disease diagnosis