[Morphologic study of the vessels of the pars plana].

J. Saracco,P. Gastaud,A. Luciani,B. Ridings

1985-05-01

Abstract:

What problem does this paper attempt to address?

Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs.

J. Mega,L. Peng,R. Kim,Marc Coram,Derek J. Wu,Kasumi Widner,R. Raman,D. Webster,Martin C. Stumpe,T. Madams,Philip Nelson,Arunachalam Narayanaswamy,Subhashini Venugopalan,Varun Gulshan,Jorge A Cuadros

DOI: https://doi.org/10.1001/jama.2016.17216

2016-12-13

Abstract:Importance Deep learning is a family of computational methods that allow an algorithm to program itself by learning from a large set of examples that demonstrate the desired behavior, removing the need to specify rules explicitly. Application of these methods to medical imaging requires further assessment and validation. Objective To apply deep learning to create an algorithm for automated detection of diabetic retinopathy and diabetic macular edema in retinal fundus photographs. Design and Setting A specific type of neural network optimized for image classification called a deep convolutional neural network was trained using a retrospective development data set of 128 175 retinal images, which were graded 3 to 7 times for diabetic retinopathy, diabetic macular edema, and image gradability by a panel of 54 US licensed ophthalmologists and ophthalmology senior residents between May and December 2015. The resultant algorithm was validated in January and February 2016 using 2 separate data sets, both graded by at least 7 US board-certified ophthalmologists with high intragrader consistency. Exposure Deep learning-trained algorithm. Main Outcomes and Measures The sensitivity and specificity of the algorithm for detecting referable diabetic retinopathy (RDR), defined as moderate and worse diabetic retinopathy, referable diabetic macular edema, or both, were generated based on the reference standard of the majority decision of the ophthalmologist panel. The algorithm was evaluated at 2 operating points selected from the development set, one selected for high specificity and another for high sensitivity. Results The EyePACS-1 data set consisted of 9963 images from 4997 patients (mean age, 54.4 years; 62.2% women; prevalence of RDR, 683/8878 fully gradable images [7.8%]); the Messidor-2 data set had 1748 images from 874 patients (mean age, 57.6 years; 42.6% women; prevalence of RDR, 254/1745 fully gradable images [14.6%]). For detecting RDR, the algorithm had an area under the receiver operating curve of 0.991 (95% CI, 0.988-0.993) for EyePACS-1 and 0.990 (95% CI, 0.986-0.995) for Messidor-2. Using the first operating cut point with high specificity, for EyePACS-1, the sensitivity was 90.3% (95% CI, 87.5%-92.7%) and the specificity was 98.1% (95% CI, 97.8%-98.5%). For Messidor-2, the sensitivity was 87.0% (95% CI, 81.1%-91.0%) and the specificity was 98.5% (95% CI, 97.7%-99.1%). Using a second operating point with high sensitivity in the development set, for EyePACS-1 the sensitivity was 97.5% and specificity was 93.4% and for Messidor-2 the sensitivity was 96.1% and specificity was 93.9%. Conclusions and Relevance In this evaluation of retinal fundus photographs from adults with diabetes, an algorithm based on deep machine learning had high sensitivity and specificity for detecting referable diabetic retinopathy. Further research is necessary to determine the feasibility of applying this algorithm in the clinical setting and to determine whether use of the algorithm could lead to improved care and outcomes compared with current ophthalmologic assessment.

Computer Science,Medicine
Evaluating a Deep Learning Diabetic Retinopathy Grading System Developed on Mydriatic Retinal Images When Applied to Non-Mydriatic Community Screening

Joan M. Nunez do Rio,Paul Nderitu,Christos Bergeles,Sobha Sivaprasad,Gavin S. W. Tan,Rajiv Raman

DOI: https://doi.org/10.3390/jcm11030614

IF: 3.9

2022-01-26

Journal of Clinical Medicine

Abstract:Artificial Intelligence has showcased clear capabilities to automatically grade diabetic retinopathy (DR) on mydriatic retinal images captured by clinical experts on fixed table-top retinal cameras within hospital settings. However, in many low- and middle-income countries, screening for DR revolves around minimally trained field workers using handheld non-mydriatic cameras in community settings. This prospective study evaluated the diagnostic accuracy of a deep learning algorithm developed using mydriatic retinal images by the Singapore Eye Research Institute, commercially available as Zeiss VISUHEALTH-AI DR, on images captured by field workers on a Zeiss Visuscout® 100 non-mydriatic handheld camera from people with diabetes in a house-to-house cross-sectional study across 20 regions in India. A total of 20,489 patient eyes from 11,199 patients were used to evaluate algorithm performance in identifying referable DR, non-referable DR, and gradability. For each category, the algorithm achieved precision values of 29.60 (95% CI 27.40, 31.88), 92.56 (92.13, 92.97), and 58.58 (56.97, 60.19), recall values of 62.69 (59.17, 66.12), 85.65 (85.11, 86.18), and 65.06 (63.40, 66.69), and F-score values of 40.22 (38.25, 42.21), 88.97 (88.62, 89.31), and 61.65 (60.50, 62.80), respectively. Model performance reached 91.22 (90.79, 91.64) sensitivity and 65.06 (63.40, 66.69) specificity at detecting gradability and 72.08 (70.68, 73.46) sensitivity and 85.65 (85.11, 86.18) specificity for the detection of all referable eyes. Algorithm accuracy is dependent on the quality of acquired retinal images, and this is a major limiting step for its global implementation in community non-mydriatic DR screening using handheld cameras. This study highlights the need to develop and train deep learning-based screening tools in such conditions before implementation.

medicine, general & internal
Grading of diabetic retinopathy using a pre‐segmenting deep learning classification model: Validation of an automated algorithm

Dyllan Edson Similié,Jakob K. H. Andersen,Sebastian Dinesen,Thiusius R. Savarimuthu,Jakob Grauslund

DOI: https://doi.org/10.1111/aos.16781

2024-10-21

Acta Ophthalmologica

Abstract:Purpose To validate the performance of autonomous diabetic retinopathy (DR) grading by comparing a human grader and a self‐developed deep‐learning (DL) algorithm with gold‐standard evaluation. Methods We included 500, 6‐field retinal images graded by an expert ophthalmologist (gold standard) according to the International Clinical Diabetic Retinopathy Disease Severity Scale as represented with DR levels 0–4 (97, 100, 100, 103, 100, respectively). Weighted kappa was calculated to measure the DR classification agreement for (1) a certified human grader without, and (2) with assistance from a DL algorithm and (3) the DL operating autonomously. Using any DR (level 0 vs. 1–4) as a cutoff, we calculated sensitivity, specificity, as well as positive and negative predictive values (PPV and NPV). Finally, we assessed lesion discrepancies between Model 3 and the gold standard. Results As compared to the gold standard, weighted kappa for Models 1–3 was 0.88, 0.89 and 0.72, sensitivities were 95%, 94% and 78% and specificities were 82%, 84% and 81%. Extrapolating to a real‐world DR prevalence of 23.8%, the PPV were 63%, 64% and 57% and the NPV were 98%, 98% and 92%. Discrepancies between the gold standard and Model 3 were mainly incorrect detection of artefacts (n = 49), missed microaneurysms (n = 26) and inconsistencies between the segmentation and classification (n = 51). Conclusion While the autonomous DL algorithm for DR classification only performed on par with a human grader for some measures in a high‐risk population, extrapolations to a real‐world population demonstrated an excellent 92% NPV, which could make it clinically feasible to use autonomously to identify non‐DR patients.

ophthalmology
A deep learning system for detecting diabetic retinopathy across the disease spectrum

Ling Dai,Liang Wu,Huating Li,Chun Cai,Qiang Wu,Hongyu Kong,Ruhan Liu,Xiangning Wang,Xuhong Hou,Yuexing Liu,Xiaoxue Long,Yang Wen,Lina Lu,Yaxin Shen,Yan Chen,Dinggang Shen,Xiaokang Yang,Haidong Zou,Bin Sheng,Weiping Jia

DOI: https://doi.org/10.1038/s41467-021-23458-5

IF: 16.6

2021-05-28

Nature Communications

Abstract:Abstract Retinal screening contributes to early detection of diabetic retinopathy and timely treatment. To facilitate the screening process, we develop a deep learning system, named DeepDR, that can detect early-to-late stages of diabetic retinopathy. DeepDR is trained for real-time image quality assessment, lesion detection and grading using 466,247 fundus images from 121,342 patients with diabetes. Evaluation is performed on a local dataset with 200,136 fundus images from 52,004 patients and three external datasets with a total of 209,322 images. The area under the receiver operating characteristic curves for detecting microaneurysms, cotton-wool spots, hard exudates and hemorrhages are 0.901, 0.941, 0.954 and 0.967, respectively. The grading of diabetic retinopathy as mild, moderate, severe and proliferative achieves area under the curves of 0.943, 0.955, 0.960 and 0.972, respectively. In external validations, the area under the curves for grading range from 0.916 to 0.970, which further supports the system is efficient for diabetic retinopathy grading.

multidisciplinary sciences
Using deep learning to detect diabetic retinopathy on handheld non-mydriatic retinal images acquired by field workers in community settings

Joan M. Nunez do Rio,Paul Nderitu,Rajiv Raman,Ramachandran Rajalakshmi,Ramasamy Kim,Padmaja K. Rani,Sobha Sivaprasad,Christos Bergeles,Pramod Bhende,Janani Surya,Lingam Gopal,Radha Ramakrishnan,Rupak Roy,Supita Das,George Manayath,T. P. Vignesh,Giridhar Anantharaman,Mahesh Gopalakrishnan,Sundaram Natarajan,Radhika Krishnan,Sheena Liz Mani,Manisha Agarwal,Umesh Behera,Harsha Bhattacharjee,Manabjyoti Barman,Alok Sen,Moneesh Saxena,Asim K. Sil,Subhratanu Chakabarty,Thomas Cherian,Reesha Jitesh,Rushikesh Naigaonkar,Abishek Desai,Sucheta Kulkarni,for the SMART India Study Group

DOI: https://doi.org/10.1038/s41598-023-28347-z

IF: 4.6

2023-01-26

Scientific Reports

Abstract:Diabetic retinopathy (DR) at risk of vision loss (referable DR) needs to be identified by retinal screening and referred to an ophthalmologist. Existing automated algorithms have mostly been developed from images acquired with high cost mydriatic retinal cameras and cannot be applied in the settings used in most low- and middle-income countries. In this prospective multicentre study, we developed a deep learning system (DLS) that detects referable DR from retinal images acquired using handheld non-mydriatic fundus camera by non-technical field workers in 20 sites across India. Macula-centred and optic-disc-centred images from 16,247 eyes (9778 participants) were used to train and cross-validate the DLS and risk factor based logistic regression models. The DLS achieved an AUROC of 0.99 (1000 times bootstrapped 95% CI 0.98–0.99) using two-field retinal images, with 93.86 (91.34–96.08) sensitivity and 96.00 (94.68–98.09) specificity at the Youden's index operational point. With single field inputs, the DLS reached AUROC of 0.98 (0.98–0.98) for the macula field and 0.96 (0.95–0.98) for the optic-disc field. Intergrader performance was 90.01 (88.95–91.01) sensitivity and 96.09 (95.72–96.42) specificity. The image based DLS outperformed all risk factor-based models. This DLS demonstrated a clinically acceptable performance for the identification of referable DR despite challenging image capture conditions.

multidisciplinary sciences
Deep learning in estimating prevalence and systemic risk factors for diabetic retinopathy: a multi-ethnic study

Daniel S. W. Ting,Carol Y. Cheung,Quang Nguyen,Charumathi Sabanayagam,Gilbert Lim,Zhan Wei Lim,Gavin S. W. Tan,Yu Qiang Soh,Leopold Schmetterer,Ya Xing Wang,Jost B. Jonas,Rohit Varma,Mong Li Lee,Wynne Hsu,Ecosse Lamoureux,Ching-Yu Cheng,Tien Yin Wong

DOI: https://doi.org/10.1038/s41746-019-0097-x

IF: 15.2

2019-04-10

npj Digital Medicine

Abstract:In any community, the key to understanding the burden of a specific condition is to conduct an epidemiological study. The deep learning system (DLS) recently showed promising diagnostic performance for diabetic retinopathy (DR). This study aims to use DLS as the grading tool, instead of human assessors, to determine the prevalence and the systemic cardiovascular risk factors for DR on fundus photographs, in patients with diabetes. This is a multi-ethnic (5 races), multi-site (8 datasets from Singapore, USA, Hong Kong, China and Australia), cross-sectional study involving 18,912 patients (n = 93,293 images). We compared these results and the time taken for DR assessment by DLS versus 17 human assessors – 10 retinal specialists/ophthalmologists and 7 professional graders). The estimation of DR prevalence between DLS and human assessors is comparable for any DR, referable DR and vision–threatening DR (VTDR) (Human assessors: 15.9, 6.5% and 4.1%; DLS: 16.1%, 6.4%, 3.7%). Both assessment methods identified similar risk factors (with comparable AUCs), including younger age, longer diabetes duration, increased HbA1c and systolic blood pressure, for any DR, referable DR and VTDR (p > 0.05). The total time taken for DLS to evaluate DR from 93,293 fundus photographs was ~1 month compared to 2 years for human assessors. In conclusion, the prevalence and systemic risk factors for DR in multi-ethnic population could be determined accurately using a DLS, in significantly less time than human assessors. This study highlights the potential use of AI for future epidemiology or clinical trials for DR grading in the global communities.

health care sciences & services,medical informatics
Automatic Grading System for Diabetic Retinopathy Diagnosis Using Deep Learning Artificial Intelligence Software

Xiang-Ning Wang,Ling Dai,Shu-Ting Li,Hong-Yu Kong,Bin Sheng,Qiang Wu

DOI: https://doi.org/10.1080/02713683.2020.1764975

2020-05-15

Current Eye Research

Abstract:Purposes: To describe the development and validation of an artificial intelligence–based, deep learning algorithm (DeepDR) for the detection of diabetic retinopathy (DR) in retinal fundus photographs.Methods: Five hundred fundus images, which had detailed labelling of DR lesions, were transmitted to be analysed, including localization of the optic disk and macular, vessel segmentation, detection of lesions, and grading of DR. The multi-level iterative method of convolutional neural network and the strategy of enhanced learning were used to improve the accuracy of the system (DeepDR) for grading DR. Three public data sets were used to further train the software. The final grading results were tested based on the fundus images provided by the hospitals.Results: For 6788 fundus images (both macular and disc centred) of two Hospital Eye Center, the detection of microaneurysm, haemorrhage and hard exudates had an accuracy of 99.7%, 98.4% and 98.1%, respectively. The current algorithm accuracy was 0.96. Another 20,000 fundus images from community screening were selected, and 7593 photos of poor quality were excluded according to quality standards. Accuracy for accurate staging of fundus photos: accuracy was 0.9179. The sensitivity, specificity and area under the curve (AUC) were 80.58%, 95.77% and 0.9327, respectively.Conclusions: This artificial intelligence–based DeepDR can be used with high accuracy for the detection of DR in retinal images. This technology offers the potential to increase the efficiency and accessibility of DR screening programs.

ophthalmology
Deep Learning Fundus Image Analysis for Diabetic Retinopathy and Macular Edema Grading

Jaakko Sahlsten,Joel Jaskari,Jyri Kivinen,Lauri Turunen,Esa Jaanio,Kustaa Hietala,Kimmo Kaski

DOI: https://doi.org/10.1038/s41598-019-47181-w

IF: 4.6

2019-07-24

Scientific Reports

Abstract:Diabetes is a globally prevalent disease that can cause visible microvascular complications such as diabetic retinopathy and macular edema in the human eye retina, the images of which are today used for manual disease screening and diagnosis. This labor-intensive task could greatly benefit from automatic detection using deep learning technique. Here we present a deep learning system that identifies referable diabetic retinopathy comparably or better than presented in the previous studies, although we use only a small fraction of images (<1/4) in training but are aided with higher image resolutions. We also provide novel results for five different screening and clinical grading systems for diabetic retinopathy and macular edema classification, including state-of-the-art results for accurately classifying images according to clinical five-grade diabetic retinopathy and for the first time for the four-grade diabetic macular edema scales. These results suggest, that a deep learning system could increase the cost-effectiveness of screening and diagnosis, while attaining higher than recommended performance, and that the system could be applied in clinical examinations requiring finer grading.

multidisciplinary sciences
General deep learning model for detecting diabetic retinopathy

Ping-Nan Chen,Chia-Chiang Lee,Chang-Min Liang,Shu-I Pao,Ke-Hao Huang,Ke-Feng Lin

DOI: https://doi.org/10.1186/s12859-021-04005-x

IF: 3.307

2021-11-01

BMC Bioinformatics

Abstract:Abstract Background Doctors can detect symptoms of diabetic retinopathy (DR) early by using retinal ophthalmoscopy, and they can improve diagnostic efficiency with the assistance of deep learning to select treatments and support personnel workflow. Conventionally, most deep learning methods for DR diagnosis categorize retinal ophthalmoscopy images into training and validation data sets according to the 80/20 rule, and they use the synthetic minority oversampling technique (SMOTE) in data processing (e.g., rotating, scaling, and translating training images) to increase the number of training samples. Oversampling training may lead to overfitting of the training model. Therefore, untrained or unverified images can yield erroneous predictions. Although the accuracy of prediction results is 90%–99%, this overfitting of training data may distort training module variables. Results This study uses a 2-stage training method to solve the overfitting problem. In the training phase, to build the model, the Learning module 1 used to identify the DR and no-DR. The Learning module 2 on SMOTE synthetic datasets to identify the mild-NPDR, moderate NPDR, severe NPDR and proliferative DR classification. These two modules also used early stopping and data dividing methods to reduce overfitting by oversampling. In the test phase, we use the DIARETDB0, DIARETDB1, eOphtha, MESSIDOR, and DRIVE datasets to evaluate the performance of the training network. The prediction accuracy achieved to 85.38%, 84.27%, 85.75%, 86.73%, and 92.5%. Conclusions Based on the experiment, a general deep learning model for detecting DR was developed, and it could be used with all DR databases. We provided a simple method of addressing the imbalance of DR databases, and this method can be used with other medical images.

biochemical research methods,biotechnology & applied microbiology,mathematical & computational biology
Deep learning algorithms to detect diabetic kidney disease from retinal photographs in multiethnic populations with diabetes

Bjorn Kaijun Betzler,Evelyn Yi Lyn Chee,Feng He,Cynthia Ciwei Lim,Jinyi Ho,Haslina Hamzah,Ngiap Chuan Tan,Gerald Liew,Gareth J McKay,Ruth E Hogg,Ian S Young,Ching-Yu Cheng,Su Chi Lim,Aaron Y Lee,Tien Yin Wong,Mong Li Lee,Wynne Hsu,Gavin Siew Wei Tan,Charumathi Sabanayagam

DOI: https://doi.org/10.1093/jamia/ocad179

2023-09-02

Journal of the American Medical Informatics Association

Abstract:Abstract Objective To develop a deep learning algorithm (DLA) to detect diabetic kideny disease (DKD) from retinal photographs of patients with diabetes, and evaluate performance in multiethnic populations. Materials and methods We trained 3 models: (1) image-only; (2) risk factor (RF)-only multivariable logistic regression (LR) model adjusted for age, sex, ethnicity, diabetes duration, HbA1c, systolic blood pressure; (3) hybrid multivariable LR model combining RF data and standardized z-scores from image-only model. Data from Singapore Integrated Diabetic Retinopathy Program (SiDRP) were used to develop (6066 participants with diabetes, primary-care-based) and internally validate (5-fold cross-validation) the models. External testing on 2 independent datasets: (1) Singapore Epidemiology of Eye Diseases (SEED) study (1885 participants with diabetes, population-based); (2) Singapore Macroangiopathy and Microvascular Reactivity in Type 2 Diabetes (SMART2D) (439 participants with diabetes, cross-sectional) in Singapore. Supplementary external testing on 2 Caucasian cohorts: (3) Australian Eye and Heart Study (AHES) (460 participants with diabetes, cross-sectional) and (4) Northern Ireland Cohort for the Longitudinal Study of Ageing (NICOLA) (265 participants with diabetes, cross-sectional). Results In SiDRP validation, area under the curve (AUC) was 0.826(95% CI 0.818-0.833) for image-only, 0.847(0.840-0.854) for RF-only, and 0.866(0.859-0.872) for hybrid. Estimates with SEED were 0.764(0.743-0.785) for image-only, 0.802(0.783-0.822) for RF-only, and 0.828(0.810-0.846) for hybrid. In SMART2D, AUC was 0.726(0.686-0.765) for image-only, 0.701(0.660-0.741) in RF-only, 0.761(0.724-0.797) for hybrid. Discussion and conclusion There is potential for DLA using retinal images as a screening adjunct for DKD among individuals with diabetes. This can value-add to existing DLA systems which diagnose diabetic retinopathy from retinal images, facilitating primary screening for DKD.

information science & library science,computer science, information systems, interdisciplinary applications,health care sciences & services,medical informatics
An Automated Grading System for Detection of Vision-Threatening Referable Diabetic Retinopathy on the Basis of Color Fundus Photographs

Zhixi Li,Stuart Keel,Chi Liu,Yifan He,Wei Meng,Jane Scheetz,Pei Ying Lee,Jonathan Shaw,Daniel Ting,Tien Yin Wong,Hugh Taylor,Robert Chang,Mingguang He

DOI: https://doi.org/10.2337/dc18-0147

2018-10-01

Diabetes Care

Abstract:OBJECTIVE The goal of this study was to describe the development and validation of an artificial intelligence–based, deep learning algorithm (DLA) for the detection of referable diabetic retinopathy (DR). RESEARCH DESIGN AND METHODS A DLA using a convolutional neural network was developed for automated detection of vision-threatening referable DR (preproliferative DR or worse, diabetic macular edema, or both). The DLA was tested by using a set of 106,244 nonstereoscopic retinal images. A panel of ophthalmologists graded DR severity in retinal photographs included in the development and internal validation data sets (n = 71,043); a reference standard grading was assigned once three graders achieved consistent grading outcomes. For external validation, we tested our DLA using 35,201 images of 14,520 eyes (904 eyes with any DR; 401 eyes with vision-threatening referable DR) from population-based cohorts of Malays, Caucasian Australians, and Indigenous Australians. RESULTS Among the 71,043 retinal images in the training and validation data sets, 12,329 showed vision-threatening referable DR. In the internal validation data set, the area under the curve (AUC), sensitivity, and specificity of the DLA for vision-threatening referable DR were 0.989, 97.0%, and 91.4%, respectively. Testing against the independent, multiethnic data set achieved an AUC, sensitivity, and specificity of 0.955, 92.5%, and 98.5%, respectively. Among false-positive cases, 85.6% were due to a misclassification of mild or moderate DR. Undetected intraretinal microvascular abnormalities accounted for 77.3% of all false-negative cases. CONCLUSIONS This artificial intelligence–based DLA can be used with high accuracy in the detection of vision-threatening referable DR in retinal images. This technology offers potential to increase the efficiency and accessibility of DR screening programs.

endocrinology & metabolism
Risk Stratification for Diabetic Retinopathy Screening Order Using Deep Learning: A Multicenter Prospective Study

Ashish Bora,Richa Tiwari,Pinal Bavishi,Sunny Virmani,Rayman Huang,Ilana Traynis,Greg S Corrado,Lily Peng,Dale R Webster,Avinash V Varadarajan,Warisara Pattanapongpaiboon,Reena Chopra,Paisan Ruamviboonsuk

DOI: https://doi.org/10.1167/tvst.12.12.11

2023-12-01

Abstract:Purpose: Real-world evaluation of a deep learning model that prioritizes patients based on risk of progression to moderate or worse (MOD+) diabetic retinopathy (DR). Methods: This nonrandomized, single-arm, prospective, interventional study included patients attending DR screening at four centers across Thailand from September 2019 to January 2020, with mild or no DR. Fundus photographs were input into the model, and patients were scheduled for their subsequent screening from September 2020 to January 2021 in order of predicted risk. Evaluation focused on model sensitivity, defined as correctly ranking patients that developed MOD+ within the first 50% of subsequent screens. Results: We analyzed 1,757 patients, of which 52 (3.0%) developed MOD+. Using the model-proposed order, the model's sensitivity was 90.4%. Both the model-proposed order and mild/no DR plus HbA1c had significantly higher sensitivity than the random order (P < 0.001). Excluding one major (rural) site that had practical implementation challenges, the remaining sites included 567 patients and 15 (2.6%) developed MOD+. Here, the model-proposed order achieved 86.7% versus 73.3% for the ranking that used DR grade and hemoglobin A1c. Conclusions: The model can help prioritize follow-up visits for the largest subgroups of DR patients (those with no or mild DR). Further research is needed to evaluate the impact on clinical management and outcomes. Translational relevance: Deep learning demonstrated potential for risk stratification in DR screening. However, real-world practicalities must be resolved to fully realize the benefit.
Variability in Grading Diabetic Retinopathy Using Retinal Photography and Its Comparison with an Automated Deep Learning Diabetic Retinopathy Screening Software

Chin Sheng Teoh,Kah Hie Wong,Di Xiao,Hung Chew Wong,Paul Zhao,Hwei Wuen Chan,Yew Sen Yuen,Thet Naing,Kanagasingam Yogesan,Victor Teck Chang Koh

DOI: https://doi.org/10.3390/healthcare11121697

2023-06-10

Health Care

Abstract:Background: Diabetic retinopathy (DR) screening using colour retinal photographs is cost-effective and time-efficient. In real-world clinical settings, DR severity is frequently graded by individuals of different expertise levels. We aim to determine the agreement in DR severity grading between human graders of varying expertise and an automated deep learning DR screening software (ADLS). Methods: Using the International Clinical DR Disease Severity Scale, two hundred macula-centred fundus photographs were graded by retinal specialists, ophthalmology residents, family medicine physicians, medical students, and the ADLS. Based on referral urgency, referral grading was divided into no referral, non-urgent referral, and urgent referral to an ophthalmologist. Inter-observer and intra-group variations were analysed using Gwet's agreement coefficient, and the performance of ADLS was evaluated using sensitivity and specificity. Results: The agreement coefficient for inter-observer and intra-group variability ranged from fair to very good, and moderate to good, respectively. The ADLS showed a high area under curve of 0.879, 0.714, and 0.836 for non-referable DR, non-urgent referable DR, and urgent referable DR, respectively, with varying sensitivity and specificity values. Conclusion: Inter-observer and intra-group agreements among human graders vary widely, but ADLS is a reliable and reasonably sensitive tool for mass screening to detect referable DR and urgent referable DR.

health care sciences & services,health policy & services
The Validation of Deep Learning-Based Grading Model for Diabetic Retinopathy

Wen-fei Zhang,Dong-hong Li,Qi-jie Wei,Da-yong Ding,Li-hui Meng,Yue-lin Wang,Xin-yu Zhao,You-xin Chen

DOI: https://doi.org/10.3389/fmed.2022.839088

IF: 3.9

2022-05-16

Frontiers in Medicine

Abstract:Purpose To evaluate the performance of a deep learning (DL)-based artificial intelligence (AI) hierarchical diagnosis software, EyeWisdom V1 for diabetic retinopathy (DR). Materials and Methods The prospective study was a multicenter, double-blind, and self-controlled clinical trial. Non-dilated posterior pole fundus images were evaluated by ophthalmologists and EyeWisdom V1, respectively. The diagnosis of manual grading was considered as the gold standard. Primary evaluation index (sensitivity and specificity) and secondary evaluation index like positive predictive values (PPV), negative predictive values (NPV), etc., were calculated to evaluate the performance of EyeWisdom V1. Results A total of 1,089 fundus images from 630 patients were included, with a mean age of (56.52 ± 11.13) years. For any DR, the sensitivity, specificity, PPV, and NPV were 98.23% (95% CI 96.93–99.08%), 74.45% (95% CI 69.95-78.60%), 86.38% (95% CI 83.76-88.72%), and 96.23% (95% CI 93.50-98.04%), respectively; For sight-threatening DR (STDR, severe non-proliferative DR or worse), the above indicators were 80.47% (95% CI 75.07-85.14%), 97.96% (95% CI 96.75-98.81%), 92.38% (95% CI 88.07-95.50%), and 94.23% (95% CI 92.46-95.68%); For referral DR (moderate non-proliferative DR or worse), the sensitivity and specificity were 92.96% (95% CI 90.66-94.84%) and 93.32% (95% CI 90.65-95.42%), with the PPV of 94.93% (95% CI 92.89-96.53%) and the NPV of 90.78% (95% CI 87.81-93.22%). The kappa score of EyeWisdom V1 was 0.860 (0.827-0.890) with the AUC of 0.958 for referral DR. Conclusion The EyeWisdom V1 could provide reliable DR grading and referral recommendation based on the fundus images of diabetics.

medicine, general & internal
A stratified analysis of a deep learning algorithm in the diagnosis of diabetic retinopathy in a real‐world study

Na Li,Mingming Ma,Mengyu Lai,Liping Gu,Mei Kang,Zilong Wang,Shengyin Jiao,Kang Dang,Junxiao Deng,Xiaowei Ding,Qin Zhen,Aifang Zhang,Tingting Shen,Zhi Zheng,Yufan Wang,Yongde Peng

DOI: https://doi.org/10.1111/1753-0407.13241

IF: 4.53

2021-12-09

Journal of Diabetes

Abstract:BACKGROUND: The aim of our research was to prospectively explore the clinical value of a deep learning algorithm (DLA) to detect referable diabetic retinopathy (DR) in different subgroups stratified by types of diabetes, blood pressure, sex, BMI, age, glycosylated hemoglobin (HbA1c), diabetes duration, urine albumin-to-creatinine ratio (UACR), and estimated glomerular filtration rate (eGFR) at a real-world diabetes center in China.METHODS: A total of 1147 diabetic patients from Shanghai General Hospital were recruited from October 2018 to August 2019. Retinal fundus images were graded by the DLA, and the detection of referable DR (moderate nonproliferative DR or worse) was compared with a reference standard generated by one certified retinal specialist with more than 12 years of experience. The performance of DLA across different subgroups stratified by types of diabetes, blood pressure, sex, BMI, age, HbA1c, diabetes duration, UACR, and eGFR was evaluated.RESULTS: For all 1674 gradable images, the area under the receiver operating curve, sensitivity, and specificity of the DLA for referable DR were 0.942 (95% CI, 0.920-0.964), 85.1% (95% CI, 83.4%-86.8%), and 95.6% (95% CI, 94.6%-96.6%), respectively. The DLA showed consistent performance across most subgroups, while it showed superior performance in the subgroups of patients with type 1 diabetes, UACR ≥ 30 mg/g, and eGFR < 90 mL/min/1.73m2 .CONCLUSIONS: This study showed that the DLA was a reliable alternative method for the detection of referable DR and performed superior in patients with type 1 diabetes and diabetic nephropathy who were prone to DR.

endocrinology & metabolism
Predicting Risk of Developing Diabetic Retinopathy using Deep Learning

Ashish Bora,Siva Balasubramanian,Boris Babenko,Sunny Virmani,Subhashini Venugopalan,Akinori Mitani,Guilherme de Oliveira Marinho,Jorge Cuadros,Paisan Ruamviboonsuk,Greg S Corrado,Lily Peng,Dale R Webster,Avinash V Varadarajan,Naama Hammel,Yun Liu,Pinal Bavishi

DOI: https://doi.org/10.1016/S2589-7500%2820%2930250-8

2020-08-11

Abstract:Diabetic retinopathy (DR) screening is instrumental in preventing blindness, but faces a scaling challenge as the number of diabetic patients rises. Risk stratification for the development of DR may help optimize screening intervals to reduce costs while improving vision-related outcomes. We created and validated two versions of a deep learning system (DLS) to predict the development of mild-or-worse ("Mild+") DR in diabetic patients undergoing DR screening. The two versions used either three-fields or a single field of color fundus photographs (CFPs) as input. The training set was derived from 575,431 eyes, of which 28,899 had known 2-year outcome, and the remaining were used to augment the training process via multi-task learning. Validation was performed on both an internal validation set (set A; 7,976 eyes; 3,678 with known outcome) and an external validation set (set B; 4,762 eyes; 2,345 with known outcome). For predicting 2-year development of DR, the 3-field DLS had an area under the receiver operating characteristic curve (AUC) of 0.79 (95%CI, 0.78-0.81) on validation set A. On validation set B (which contained only a single field), the 1-field DLS's AUC was 0.70 (95%CI, 0.67-0.74). The DLS was prognostic even after adjusting for available risk factors (p<0.001). When added to the risk factors, the 3-field DLS improved the AUC from 0.72 (95%CI, 0.68-0.76) to 0.81 (95%CI, 0.77-0.84) in validation set A, and the 1-field DLS improved the AUC from 0.62 (95%CI, 0.58-0.66) to 0.71 (95%CI, 0.68-0.75) in validation set B. The DLSs in this study identified prognostic information for DR development from CFPs. This information is independent of and more informative than the available risk factors.

Image and Video Processing,Computer Vision and Pattern Recognition
Cost-Utility Analysis of Deep Learning and Trained Human Graders for Diabetic Retinopathy Screening in a Nationwide Program

Attasit Srisubat,Kankamon Kittrongsiri,Sermsiri Sangroongruangsri,Chalida Khemvaranan,Jacqueline Baras Shreibati,Jack Ching,John Hernandez,Richa Tiwari,Fred Hersch,Yun Liu,Prut Hanutsaha,Varis Ruamviboonsuk,Saowalak Turongkaravee,Rajiv Raman,Paisan Ruamviboonsuk

DOI: https://doi.org/10.1007/s40123-023-00688-y

Abstract:Introduction: Deep learning (DL) for screening diabetic retinopathy (DR) has the potential to address limited healthcare resources by enabling expanded access to healthcare. However, there is still limited health economic evaluation, particularly in low- and middle-income countries, on this subject to aid decision-making for DL adoption. Methods: In the context of a middle-income country (MIC), using Thailand as a model, we constructed a decision tree-Markov hybrid model to estimate lifetime costs and outcomes of Thailand's national DR screening program via DL and trained human graders (HG). We calculated the incremental cost-effectiveness ratio (ICER) between the two strategies. Sensitivity analyses were performed to probe the influence of modeling parameters. Results: From a societal perspective, screening with DL was associated with a reduction in costs of ~ US$ 2.70, similar quality-adjusted life-years (QALY) of + 0.0043, and an incremental net monetary benefit of ~ US$ 24.10 in the base case. In sensitivity analysis, DL remained cost-effective even with a price increase from US$ 1.00 to US$ 4.00 per patient at a Thai willingness-to-pay threshold of ~ US$ 4.997 per QALY gained. When further incorporating recent findings suggesting improved compliance to treatment referral with DL, our analysis models effectiveness benefits of ~ US$ 20 to US$ 50 depending on compliance. Conclusion: DR screening using DL in an MIC using Thailand as a model may result in societal cost-savings and similar health outcomes compared with HG. This study may provide an economic rationale to expand DL-based DR screening in MICs as an alternative solution for limited availability of skilled human resources for primary screening, particularly in MICs with similar prevalence of diabetes and low compliance to referrals for treatment.
Deep Learning based Early Detection and Grading of Diabetic Retinopathy Using Retinal Fundus Images

Sheikh Muhammad Saiful Islam,Md Mahedi Hasan,Sohaib Abdullah

DOI: https://doi.org/10.48550/arXiv.1812.10595

2018-12-27

Computer Vision and Pattern Recognition

Abstract:Diabetic Retinopathy (DR) is a constantly deteriorating disease, being one of the leading causes of vision impairment and blindness. Subtle distinction among different grades and existence of many significant small features make the task of recognition very challenging. In addition, the present approach of retinopathy detection is a very laborious and time-intensive task, which heavily relies on the skill of a physician. Automated detection of diabetic retinopathy is essential to tackle these problems. Early-stage detection of diabetic retinopathy is also very important for diagnosis, which can prevent blindness with proper treatment. In this paper, we developed a novel deep convolutional neural network, which performs the early-stage detection by identifying all microaneurysms (MAs), the first signs of DR, along with correctly assigning labels to retinal fundus images which are graded into five categories. We have tested our network on the largest publicly available Kaggle diabetic retinopathy dataset, and achieved 0.851 quadratic weighted kappa score and 0.844 AUC score, which achieves the state-of-the-art performance on severity grading. In the early-stage detection, we have achieved a sensitivity of 98% and specificity of above 94%, which demonstrates the effectiveness of our proposed method. Our proposed architecture is at the same time very simple and efficient with respect to computational time and space are concerned.
Screening and evaluation of diabetic retinopathy via a deep learning network model: A prospective study

Li Yao,Chan-Yuan Cao,Guo-Xiao Yu,Xu-Peng Shu,Xiao-Nan Fan,Yi-Fan Zhang

DOI: https://doi.org/10.4239/wjd.v15.i12.2302

2024-11-24

World Journal of Diabetes

Abstract:BACKGROUND Diabetic retinopathy (DR) is one of the most common serious complications in diabetic patients, and early screening and diagnosis are essential to prevent visual impairment. With the rapid development of deep learning technology, network models based on attention mechanisms have shown significant advantages in medical image analysis, which can improve the accuracy and efficiency of screening. AIM To evaluate the efficacy of an attention mechanism-based deep learning network model in screening for DR in natural and diabetic populations, as well as in screening with unilateral and bilateral fundus photography. METHODS From January 2023 to June 2024, a stratified multistage cluster sampling method was adopted to select a representative sample of permanent residents aged 18-70 years from our hospital. A total of 948 fundus images from 474 participants were included in the "deep learning model" system for scoring. The fundus images were graded via the early treatment of DR [Early Treatment Diabetic Retinopathy Study (ETDRS)] scoring system as the gold standard for the diagnosis of DR. With "DR to be referred (ETDRS > 31)" as the reference variable, a receiver operating characteristic curve was drawn to evaluate the area under the curve (AUC), sensitivity and specificity of the "deep learning model" to determine the screening efficiency of the system. RESULTS For each subject, in the natural population, the AUC of using the "deep learning model system" to screen "DR-requiring referral" was 0.941, and the sensitivity and specificity were 98.15% and 90.08%, respectively. The sensitivity and specificity of two-directional fundus photography were 100% and 86.91%, respectively. In the diabetic population, the AUC, sensitivity and specificity were 0.901, 98.08% and 82.10%, respectively, when "wise eye sugar net" unilateral fundus photography was used to screen for "DR-requiring referrals". CONCLUSION In both the natural population and the diabetic population, the deep learning model system has shown high sensitivity and specificity and can be used as an auxiliary means of DR screening.

endocrinology & metabolism
Performance of a deep learning system for detection of referable diabetic retinopathy in real clinical settings

Verónica Sánchez-Gutiérrez,Paula Hernández-Martínez,Francisco J. Muñoz-Negrete,Jonne Engelberts,Allison M. Luger,Mark J.J.P. van Grinsven

DOI: https://doi.org/10.48550/arXiv.2205.05554

2022-05-11

Image and Video Processing

Abstract:Background: To determine the ability of a commercially available deep learning system, RetCAD v.1.3.1 (Thirona, Nijmegen, The Netherlands) for the automatic detection of referable diabetic retinopathy (DR) on a dataset of colour fundus images acquired during routine clinical practice in a tertiary hospital screening program, analyzing the reduction of workload that can be released incorporating this artificial intelligence-based technology. Methods: Evaluation of the software was performed on a dataset of 7195 nonmydriatic fundus images from 6325 eyes of 3189 diabetic patients attending our screening program between February to December of 2019. The software generated a DR severity score for each colour fundus image which was combined into an eye-level score. This score was then compared with a reference standard as set by a human expert using receiver operating characteristic (ROC) curve analysis. Results: The artificial intelligence (AI) software achieved an area under the ROC curve (AUC) value of 0.988 [0.981:0.993] for the detection of referable DR. At the proposed operating point, the sensitivity of the RetCAD software for DR is 90.53% and specificity is 97.13%. A workload reduction of 96% could be achieved at the cost of only 6 false negatives. Conclusions: The AI software correctly identified the vast majority of referable DR cases, with a workload reduction of 96% of the cases that would need to be checked, while missing almost no true cases, so it may therefore be used as an instrument for triage.

[Morphologic study of the vessels of the pars plana].

Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs.

Evaluating a Deep Learning Diabetic Retinopathy Grading System Developed on Mydriatic Retinal Images When Applied to Non-Mydriatic Community Screening

Grading of diabetic retinopathy using a pre‐segmenting deep learning classification model: Validation of an automated algorithm

A deep learning system for detecting diabetic retinopathy across the disease spectrum

Using deep learning to detect diabetic retinopathy on handheld non-mydriatic retinal images acquired by field workers in community settings

Deep learning in estimating prevalence and systemic risk factors for diabetic retinopathy: a multi-ethnic study

Automatic Grading System for Diabetic Retinopathy Diagnosis Using Deep Learning Artificial Intelligence Software

Deep Learning Fundus Image Analysis for Diabetic Retinopathy and Macular Edema Grading

General deep learning model for detecting diabetic retinopathy

Deep learning algorithms to detect diabetic kidney disease from retinal photographs in multiethnic populations with diabetes

An Automated Grading System for Detection of Vision-Threatening Referable Diabetic Retinopathy on the Basis of Color Fundus Photographs

Risk Stratification for Diabetic Retinopathy Screening Order Using Deep Learning: A Multicenter Prospective Study

Variability in Grading Diabetic Retinopathy Using Retinal Photography and Its Comparison with an Automated Deep Learning Diabetic Retinopathy Screening Software

The Validation of Deep Learning-Based Grading Model for Diabetic Retinopathy

A stratified analysis of a deep learning algorithm in the diagnosis of diabetic retinopathy in a real‐world study

Predicting Risk of Developing Diabetic Retinopathy using Deep Learning

Cost-Utility Analysis of Deep Learning and Trained Human Graders for Diabetic Retinopathy Screening in a Nationwide Program

Deep Learning based Early Detection and Grading of Diabetic Retinopathy Using Retinal Fundus Images

Screening and evaluation of diabetic retinopathy via a deep learning network model: A prospective study

Performance of a deep learning system for detection of referable diabetic retinopathy in real clinical settings