Abstract:Objective: As an extension of optical coherence tomography (OCT), optical coherence tomographic angiography (OCTA) provides information on the blood flow status at the microlevel and is sensitive to changes in the fundus vessels. However, due to the distinct imaging mechanism of OCTA, existing models, which are primarily used for analyzing fundus images, do not work well on OCTA images. Effectively extracting and analyzing the information in OCTA images remains challenging. To this end, a deep learning framework that fuses multilevel information in OCTA images is proposed in this study. The effectiveness of the proposed model was demonstrated in the task of diabetic retinopathy (DR) classification. Method: First, a U-Net-based segmentation model was proposed to label the boundaries of large retinal vessels and the foveal avascular zone (FAZ) in OCTA images. Then, we designed an isolated concatenated block (ICB) structure to extract and fuse information from the original OCTA images and segmentation results at different fusion levels. Results: The experiments were conducted on 301 OCTA images. Of these images, 244 were labeled by ophthalmologists as normal images, and 57 were labeled as DR images. An accuracy of 93.1% and a mean intersection over union (mIOU) of 77.1% were achieved using the proposed large vessel and FAZ segmentation model. In the ablation experiment with 6-fold validation, the proposed deep learning framework that combines the proposed isolated and concatenated convolution process significantly improved the DR diagnosis accuracy. Moreover, inputting the merged images of the original OCTA images and segmentation results further improved the model performance. Finally, a DR diagnosis accuracy of 88.1% (95%CI ± 3.6%) and an area under the curve (AUC) of 0.92 were achieved using our proposed classification model, which significantly outperforms the state-of-the-art classification models. As a comparison, an accuracy of 83.7 (95%CI ± 1.5%) and AUC of 0.76 were obtained using EfficientNet. Significance. The visualization results show that the FAZ and the vascular region close to the FAZ provide more information for the model than the farther surrounding area. Furthermore, this study demonstrates that a clinically sophisticated designed deep learning model is not only able to effectively assist in the diagnosis but also help to locate new indicators for certain illnesses.

[Molecular biology of cell death].

Automated Segmentation of the Optic Disc Using the Deep Learning.

Automatic fluid segmentation in retinal optical coherence tomography images using attention based deep learning

A Coarse-to-fine Deep Learning Framework for Optic Disc Segmentation in Fundus Images

Automated segmentation of macular edema for the diagnosis of ocular disease using deep learning method

Automated segmentation of the optic disc from fundus images using an asymmetric deep learning network

Broadening the public perception of veterinarians: can we keep what we've got while transforming ourselves?

Recent Advanced Deep Learning Architectures for Retinal Fluid Segmentation on Optical Coherence Tomography Images

Localizing Optic Disc And Cup For Glaucoma Screening Via Deep Object Detection Networks

RMSDSC‐Net: A robust multiscale feature extraction with depthwise separable convolution network for optic disc and cup segmentation

Deep learning vessel segmentation and quantification of the foveal avascular zone using commercial and prototype OCT-A platforms

Deep-OCTA: Ensemble Deep Learning Approaches for Diabetic Retinopathy Analysis on OCTA Images

Automatic Segmentation of Diabetic Macular Edemas and ILM-RPE Layers in Retinal OCT Images Based on MFANet.

Performance Evaluation of Retinal OCT Fluid Segmentation, Detection, and Generalization Over Variations of Data Sources

Assessing Coarse-to-Fine Deep Learning Models for Optic Disc and Cup Segmentation in Fundus Images

Diagnosing Diabetic Retinopathy in OCTA Images Based on Multilevel Information Fusion Using a Deep Learning Framework

Segmentation of Low-Light Optical Coherence Tomography Angiography Images under the Constraints of Vascular Network Topology

A novel lightweight deep learning approach for simultaneous optic cup and optic disc segmentation in glaucoma detection

A review of optic disc and optic cup segmentation based on fundus images

Automated Segmentation of Choroidal Neovascularization on Optical Coherence Tomography Angiography Images of Neovascular Age-Related Macular Degeneration Patients Based on Deep Learning

Automated Segmentation of the Optic Disk and Cup using Dual-Stage Fully Convolutional Networks