Abstract:Objective: As an extension of optical coherence tomography (OCT), optical coherence tomographic angiography (OCTA) provides information on the blood flow status at the microlevel and is sensitive to changes in the fundus vessels. However, due to the distinct imaging mechanism of OCTA, existing models, which are primarily used for analyzing fundus images, do not work well on OCTA images. Effectively extracting and analyzing the information in OCTA images remains challenging. To this end, a deep learning framework that fuses multilevel information in OCTA images is proposed in this study. The effectiveness of the proposed model was demonstrated in the task of diabetic retinopathy (DR) classification. Method: First, a U-Net-based segmentation model was proposed to label the boundaries of large retinal vessels and the foveal avascular zone (FAZ) in OCTA images. Then, we designed an isolated concatenated block (ICB) structure to extract and fuse information from the original OCTA images and segmentation results at different fusion levels. Results: The experiments were conducted on 301 OCTA images. Of these images, 244 were labeled by ophthalmologists as normal images, and 57 were labeled as DR images. An accuracy of 93.1% and a mean intersection over union (mIOU) of 77.1% were achieved using the proposed large vessel and FAZ segmentation model. In the ablation experiment with 6-fold validation, the proposed deep learning framework that combines the proposed isolated and concatenated convolution process significantly improved the DR diagnosis accuracy. Moreover, inputting the merged images of the original OCTA images and segmentation results further improved the model performance. Finally, a DR diagnosis accuracy of 88.1% (95%CI ± 3.6%) and an area under the curve (AUC) of 0.92 were achieved using our proposed classification model, which significantly outperforms the state-of-the-art classification models. As a comparison, an accuracy of 83.7 (95%CI ± 1.5%) and AUC of 0.76 were obtained using EfficientNet. Significance. The visualization results show that the FAZ and the vascular region close to the FAZ provide more information for the model than the farther surrounding area. Furthermore, this study demonstrates that a clinically sophisticated designed deep learning model is not only able to effectively assist in the diagnosis but also help to locate new indicators for certain illnesses.

Fused Detection of Retinal Biomarkers in OCT Volumes

RetiNet: Automatic AMD identification in OCT volumetric data

Expert-level Automated Biomarker Identification in Optical Coherence Tomography Scans

Computational Retinal Microvascular Biomarkers from an OCTA Image in Clinical Investigation

Deep Learning Based Retinal Layer Segmentation in Optical Coherence Tomography Scans of Patients with Inherited Retinal Diseases

Automated segmentation of retinal fluid volumes from structural and angiographic optical coherence tomography using deep learning

Segment Anything in Optical Coherence Tomography: SAM 2 for Volumetric Segmentation of Retinal Biomarkers

Diagnosing Diabetic Retinopathy in OCTA Images Based on Multilevel Information Fusion Using a Deep Learning Framework

Retinal Fluid Segmentation and Detection in Optical Coherence Tomography Images using Fully Convolutional Neural Network

FN-OCT: Disease Detection Algorithm for Retinal Optical Coherence Tomography Based on a Fusion Network

Fully Automated Segmentation of Hyperreflective Foci in Optical Coherence Tomography Images

A feature agnostic approach for glaucoma detection in OCT volumes

Retinal Structure Detection in OCTA Image via Voting-Based Multitask Learning

Automatic Classification of Volumetric Optical Coherence Tomography Images via Recurrent Neural Network

Integrating Deep Learning with Fundus and Optical Coherence Tomography for Cardiovascular Disease Prediction

Anomaly Detection and Biomarkers Localization in Retinal Images

Automatic Diagnosis of Macular Diseases from OCT Volume Based on Its Two-Dimensional Feature Map and Convolutional Neural Network with Attention Mechanism.

Automated Retinal Layer Segmentation in Optical Coherence Tomography Images with Intraretinal Fluid

Multilevel Deep Feature Generation Framework for Automated Detection of Retinal Abnormalities Using OCT Images

Automated Volumetric Segmentation of Retinal Fluid on Optical Coherence Tomography

Predicting risk of cardiovascular disease using retinal OCT imaging