Abstract:Objective: As an extension of optical coherence tomography (OCT), optical coherence tomographic angiography (OCTA) provides information on the blood flow status at the microlevel and is sensitive to changes in the fundus vessels. However, due to the distinct imaging mechanism of OCTA, existing models, which are primarily used for analyzing fundus images, do not work well on OCTA images. Effectively extracting and analyzing the information in OCTA images remains challenging. To this end, a deep learning framework that fuses multilevel information in OCTA images is proposed in this study. The effectiveness of the proposed model was demonstrated in the task of diabetic retinopathy (DR) classification. Method: First, a U-Net-based segmentation model was proposed to label the boundaries of large retinal vessels and the foveal avascular zone (FAZ) in OCTA images. Then, we designed an isolated concatenated block (ICB) structure to extract and fuse information from the original OCTA images and segmentation results at different fusion levels. Results: The experiments were conducted on 301 OCTA images. Of these images, 244 were labeled by ophthalmologists as normal images, and 57 were labeled as DR images. An accuracy of 93.1% and a mean intersection over union (mIOU) of 77.1% were achieved using the proposed large vessel and FAZ segmentation model. In the ablation experiment with 6-fold validation, the proposed deep learning framework that combines the proposed isolated and concatenated convolution process significantly improved the DR diagnosis accuracy. Moreover, inputting the merged images of the original OCTA images and segmentation results further improved the model performance. Finally, a DR diagnosis accuracy of 88.1% (95%CI ± 3.6%) and an area under the curve (AUC) of 0.92 were achieved using our proposed classification model, which significantly outperforms the state-of-the-art classification models. As a comparison, an accuracy of 83.7 (95%CI ± 1.5%) and AUC of 0.76 were obtained using EfficientNet. Significance. The visualization results show that the FAZ and the vascular region close to the FAZ provide more information for the model than the farther surrounding area. Furthermore, this study demonstrates that a clinically sophisticated designed deep learning model is not only able to effectively assist in the diagnosis but also help to locate new indicators for certain illnesses.

A Deep Learning Based Pipeline for Optical Coherence Tomography Angiography

Weakly Supervised Deep Learning-Based Optical Coherence Tomography Angiography.

Comparative study of deep learning models for optical coherence tomography angiography

Deep-Learning-based Vasculature Extraction for Single-Scan Optical Coherence Tomography Angiography

Integrated deep learning framework for accelerated optical coherence tomography angiography

Deep‐learning visualization enhancement method for optical coherence tomography angiography in dermatology

Deep learning-based label-free imaging of lymphatics and aqueous veins in the eye using optical coherence tomography

Synthetic optical coherence tomography angiographs for detailed retinal vessel segmentation without human annotations

Unsupervised adversarial neural network for enhancing vasculature in photoacoustic tomography images using optical coherence tomography angiography

Choroidal Optical Coherence Tomography Angiography: Non-invasive Choroidal Vessel Analysis Via Deep Learning

Choroidal Optical Coherence Tomography Angiography: Noninvasive Choroidal Vessel Analysis via Deep Learning

Development and quantitative assessment of deep learning-based image enhancement for optical coherence tomography

High Performance OCTA Enabled by Combining Features of Shape, Intensity, and Complex Decorrelation

A hand-held optical coherence tomography angiography scanner based on angiography reconstruction transformer networks

Deep Learning for Anterior Segment OCT Angiography Automated Denoising and Vascular Quantitative Measurement

Deep-OCTA: Ensemble Deep Learning Approaches for Diabetic Retinopathy Analysis on OCTA Images

Diagnosing Diabetic Retinopathy in OCTA Images Based on Multilevel Information Fusion Using a Deep Learning Framework

Imaging depth adaptive resolution enhancement for optical coherence tomography via deep neural network with external attention

Generating retinal flow maps from structural optical coherence tomography with artificial intelligence

A Fast-scanning Protocol of Optical Coherence Tomography Angiography Based on Structure-Aware Attention.

Enhancement of OCT en face images by unsupervised deep learning