Abstract:Several studies published so far used highly selective image datasets from unclear sources to train computer vision models and that may lead to overestimated results, while those studies conducted in real-life remain scarce. To avoid image selection bias, we stacked convolutional and recurrent neural networks (CNN-RNN) to analyze complete optical coherence tomography (OCT) cubes in a row and predict diabetic macular edema (DME), in a real-world diabetic retinopathy screening program. A retrospective cohort study was carried out. Throughout 4-years, 5314 OCT cubes from 4408 subjects who attended to the diabetic retinopathy (DR) screening program were included. We arranged twenty-two (22) pre-trained CNNs in parallel with a bidirectional RNN layer stacked at the bottom, allowing the model to make a prediction for the whole OCT cube. The staff of retina experts built a ground truth of DME later used to train a set of these CNN-RNN models with different configurations. For each trained CNN-RNN model, we performed threshold tuning to find the optimal cut-off point for binary classification of DME. Finally, the best models were selected according to sensitivity, specificity, and area under the receiver operating characteristics curve (AUROC) with their 95% confidence intervals (95%CI). An ensemble of the best models was also explored. 5188 cubes were non-DME and 126 were DME. Three models achieved an AUROC of 0.94. Among these, sensitivity, and specificity (95%CI) ranged from 84.1-90.5 and 89.7-93.3, respectively, at threshold 1, from 89.7-92.1 and 80-83.1 at threshold 2, and from 80.2-81 and 93.8-97, at threshold 3. The ensemble model improved these results, and lower specificity was observed among subjects with sight-threatening DR. Analysis by age, gender, or grade of DME did not vary the performance of the models. CNN-RNN models showed high diagnostic accuracy for detecting DME in a real-world setting. This engine allowed us to detect extra-foveal DMEs commonly overlooked in other studies, and showed potential for application as the first filter of non-referable patients in an outpatient center within a population-based DR screening program, otherwise ended up in specialized care.

Ensembling U-Nets for microaneurysm segmentation in optical coherence tomography angiography in patients with diabetic retinopathy

Accurate Retinal Vessel Segmentation via Octave Convolution Neural Network

Ensemble Deep Learning for Diabetic Retinopathy Detection Using Optical Coherence Tomography Angiography

Deep-OCTA: Ensemble Deep Learning Approaches for Diabetic Retinopathy Analysis on OCTA Images

AI-Based Automatic Detection and Classification of Diabetic Retinopathy Using U-Net and Deep Learning

Automatic exudate and aneurysm segmentation in OCT images using UNET++ and hyperreflective-foci feature based bagged tree ensemble

An Improved U-net Based Retinal Vessel Image Segmentation Method.

An Ensemble Method to Automatically Grade Diabetic Retinopathy with Optical Coherence Tomography Angiography Images

A Cascade U‐Net with Transformer for Retinal Multi‐Lesion Segmentation

URNet: System for recommending referrals for community screening of diabetic retinopathy based on deep learning

Segmentation of Laser Marks of Diabetic Retinopathy in the Fundus Photographs Using Lightweight U-Net

Learning Mutually Local-Global U-Nets for High-Resolution Retinal Lesion Segmentation in Fundus Images

Segmentation and Classification of Diabetic Retinopathy using Ensemble Deep Neural Network

Development and evaluation of a deep learning model for automatic segmentation of non-perfusion area in fundus fluorescein angiography

RLeU-Net: Segmentation of blood vessels in retinal fundus images for Diabetic Retinopathy Screening

Optimizing ensemble U-Net architectures for robust coronary vessel segmentation in angiographic images

Adaptive ensembling of multi-modal deep spatial representations for diabetic retinopathy diagnosis

Retinal Vessel Segmentation Method Based on Improved U-NET Network

Microvasculature Segmentation and Inter-capillary Area Quantification of the Deep Vascular Complex using Transfer Learning

Dual-Branch U-Net Architecture for Retinal Lesions Segmentation on Fundus Image

Hybrid deep learning models for the screening of Diabetic Macular Edema in optical coherence tomography volumes