Information Bottleneck with Local Consistency

Zhengzheng Lou,Yangdong Ye,Zhenfeng Zhu

DOI: https://doi.org/10.1007/978-3-642-32695-0_27

2012-09-03

Abstract:

What problem does this paper attempt to address?

Predicting Risk of Developing Diabetic Retinopathy using Deep Learning

Ashish Bora,Siva Balasubramanian,Boris Babenko,Sunny Virmani,Subhashini Venugopalan,Akinori Mitani,Guilherme de Oliveira Marinho,Jorge Cuadros,Paisan Ruamviboonsuk,Greg S Corrado,Lily Peng,Dale R Webster,Avinash V Varadarajan,Naama Hammel,Yun Liu,Pinal Bavishi

DOI: https://doi.org/10.1016/S2589-7500%2820%2930250-8

2020-08-11

Abstract:Diabetic retinopathy (DR) screening is instrumental in preventing blindness, but faces a scaling challenge as the number of diabetic patients rises. Risk stratification for the development of DR may help optimize screening intervals to reduce costs while improving vision-related outcomes. We created and validated two versions of a deep learning system (DLS) to predict the development of mild-or-worse ("Mild+") DR in diabetic patients undergoing DR screening. The two versions used either three-fields or a single field of color fundus photographs (CFPs) as input. The training set was derived from 575,431 eyes, of which 28,899 had known 2-year outcome, and the remaining were used to augment the training process via multi-task learning. Validation was performed on both an internal validation set (set A; 7,976 eyes; 3,678 with known outcome) and an external validation set (set B; 4,762 eyes; 2,345 with known outcome). For predicting 2-year development of DR, the 3-field DLS had an area under the receiver operating characteristic curve (AUC) of 0.79 (95%CI, 0.78-0.81) on validation set A. On validation set B (which contained only a single field), the 1-field DLS's AUC was 0.70 (95%CI, 0.67-0.74). The DLS was prognostic even after adjusting for available risk factors (p<0.001). When added to the risk factors, the 3-field DLS improved the AUC from 0.72 (95%CI, 0.68-0.76) to 0.81 (95%CI, 0.77-0.84) in validation set A, and the 1-field DLS improved the AUC from 0.62 (95%CI, 0.58-0.66) to 0.71 (95%CI, 0.68-0.75) in validation set B. The DLSs in this study identified prognostic information for DR development from CFPs. This information is independent of and more informative than the available risk factors.

Image and Video Processing,Computer Vision and Pattern Recognition
Prediction of retinopathy progression using deep learning on retinal images within the Scottish screening programme

Joseph Mellor,Wenhua Jiang,Alan Fleming,Stuart J McGurnaghan,Luke A K Blackbourn,Caroline Styles,Amos Storkey,Paul M McKeigue,Helen M Colhoun

DOI: https://doi.org/10.1136/bjo-2023-323400

2024-02-05

British Journal of Ophthalmology

Abstract:Background/aims National guidelines of many countries set screening intervals for diabetic retinopathy (DR) based on grading of the last screening retinal images. We explore the potential of deep learning (DL) on images to predict progression to referable DR beyond DR grading, and the potential impact on assigned screening intervals, within the Scottish screening programme. Methods We consider 21 346 and 247 233 people with type 1 diabetes mellitus (T1DM) and type 2 diabetes mellitus (T2DM), respectively, each contributing on average 4.8 and 4.4 screening intervals of which 1339 and 4675 intervals concluded with a referable screening episode. Information extracted from fundus images using DL was used to predict referable status at the end of interval and its predictive value in comparison to screening-assigned DR grade was assessed. Results The DL predictor increased the area under the receiver operating characteristic curve in comparison to a predictor using current DR grades from 0.809 to 0.87 for T1DM and from 0.825 to 0.87 for T2DM. Expected sojourn time—the time from becoming referable to being rescreened—was found to be 3.4 (T1DM) and 2.7 (T2DM) weeks less for a DL-derived policy compared with the current recall policy. Conclusions We showed that, compared with using the current retinopathy grade, DL of fundus images significantly improves the prediction of incident referable retinopathy before the next screening episode. This can impact screening recall interval policy positively, for example, by reducing the expected time with referable disease for a fixed workload—which we show as an exemplar. Additionally, it could be used to optimise workload for a fixed sojourn time.

ophthalmology
Using deep learning to detect diabetic retinopathy on handheld non-mydriatic retinal images acquired by field workers in community settings

Joan M. Nunez do Rio,Paul Nderitu,Rajiv Raman,Ramachandran Rajalakshmi,Ramasamy Kim,Padmaja K. Rani,Sobha Sivaprasad,Christos Bergeles,Pramod Bhende,Janani Surya,Lingam Gopal,Radha Ramakrishnan,Rupak Roy,Supita Das,George Manayath,T. P. Vignesh,Giridhar Anantharaman,Mahesh Gopalakrishnan,Sundaram Natarajan,Radhika Krishnan,Sheena Liz Mani,Manisha Agarwal,Umesh Behera,Harsha Bhattacharjee,Manabjyoti Barman,Alok Sen,Moneesh Saxena,Asim K. Sil,Subhratanu Chakabarty,Thomas Cherian,Reesha Jitesh,Rushikesh Naigaonkar,Abishek Desai,Sucheta Kulkarni,for the SMART India Study Group

DOI: https://doi.org/10.1038/s41598-023-28347-z

IF: 4.6

2023-01-26

Scientific Reports

Abstract:Diabetic retinopathy (DR) at risk of vision loss (referable DR) needs to be identified by retinal screening and referred to an ophthalmologist. Existing automated algorithms have mostly been developed from images acquired with high cost mydriatic retinal cameras and cannot be applied in the settings used in most low- and middle-income countries. In this prospective multicentre study, we developed a deep learning system (DLS) that detects referable DR from retinal images acquired using handheld non-mydriatic fundus camera by non-technical field workers in 20 sites across India. Macula-centred and optic-disc-centred images from 16,247 eyes (9778 participants) were used to train and cross-validate the DLS and risk factor based logistic regression models. The DLS achieved an AUROC of 0.99 (1000 times bootstrapped 95% CI 0.98–0.99) using two-field retinal images, with 93.86 (91.34–96.08) sensitivity and 96.00 (94.68–98.09) specificity at the Youden's index operational point. With single field inputs, the DLS reached AUROC of 0.98 (0.98–0.98) for the macula field and 0.96 (0.95–0.98) for the optic-disc field. Intergrader performance was 90.01 (88.95–91.01) sensitivity and 96.09 (95.72–96.42) specificity. The image based DLS outperformed all risk factor-based models. This DLS demonstrated a clinically acceptable performance for the identification of referable DR despite challenging image capture conditions.

multidisciplinary sciences
Predicting the future development of diabetic retinopathy using a deep learning algorithm for the analysis of non-invasive retinal imaging

Yovel Rom,Rachelle Aviv,Tsontcho Ianchulev,Zack Dvey-Aharon

DOI: https://doi.org/10.1136/bmjophth-2022-001140

2022-12-01

BMJ Open Ophthalmology

Abstract:Aims Diabetic retinopathy (DR) is the most common cause of vision loss in the working age. This research aimed to develop an artificial intelligence (AI) machine learning model which can predict the development of referable DR from fundus imagery of otherwise healthy eyes. Methods Our researchers trained a machine learning algorithm on the EyePACS data set, consisting of 156 363 fundus images. Referrable DR was defined as any level above mild on the International Clinical Diabetic Retinopathy scale. Results The algorithm achieved 0.81 area under receiver operating curve (AUC) when averaging scores from multiple images on the task of predicting development of referrable DR, and 0.76 AUC when using a single image. Conclusion Our results suggest that risk of DR may be predicted from fundus photography alone. Prediction of personalised risk of DR may become key in treatment and contribute to patient compliance across the board, particularly when supported by further prospective research.
Deep learning algorithm predicts diabetic retinopathy progression in individual patients

Filippo Arcadu,Fethallah Benmansour,Andreas Maunz,Jeff Willis,Zdenka Haskova,Marco Prunotto

DOI: https://doi.org/10.1038/s41746-019-0172-3

IF: 15.2

2019-09-20

npj Digital Medicine

Abstract:Abstract The global burden of diabetic retinopathy (DR) continues to worsen and DR remains a leading cause of vision loss worldwide. Here, we describe an algorithm to predict DR progression by means of deep learning (DL), using as input color fundus photographs (CFPs) acquired at a single visit from a patient with DR. The proposed DL models were designed to predict future DR progression, defined as 2-step worsening on the Early Treatment Diabetic Retinopathy Diabetic Retinopathy Severity Scale, and were trained against DR severity scores assessed after 6, 12, and 24 months from the baseline visit by masked, well-trained, human reading center graders. The performance of one of these models (prediction at month 12) resulted in an area under the curve equal to 0.79. Interestingly, our results highlight the importance of the predictive signal located in the peripheral retinal fields, not routinely collected for DR assessments, and the importance of microvascular abnormalities. Our findings show the feasibility of predicting future DR progression by leveraging CFPs of a patient acquired at a single visit. Upon further development on larger and more diverse datasets, such an algorithm could enable early diagnosis and referral to a retina specialist for more frequent monitoring and even consideration of early intervention. Moreover, it could also improve patient recruitment for clinical trials targeting DR.

health care sciences & services,medical informatics
A Deep Learning System for Predicting Time to Progression of Diabetic Retinopathy

Ling Dai,Bin Sheng,Tingli Chen,Qiang Wu,Ruhan Liu,Chun Cai,Liang Wu,Dawei Yang,Haslina Hamzah,Yuexing Liu,Xiangning Wang,Zhouyu Guan,Shujie Yu,Tingyao Li,Ziqi Tang,Anran Ran,Haoxuan Che,Hao Chen,Yingfeng Zheng,Jia Shu,Shan Huang,Chan Wu,Shiqun Lin,Dan Liu,Jiajia Li,Zheyuan Wang,Ziyao Meng,Jie Shen,Xuhong Hou,Chenxin Deng,Lei Ruan,Feng Lu,Miaoli Chee,Ten Cheer Quek,Ramyaa Srinivasan,Rajiv Raman,Xiaodong Sun,Ya Xing Wang,Jiarui Wu,Hai Jin,Rongping Dai,Dinggang Shen,Xiaokang Yang,Minyi Guo,Cuntai Zhang,Carol Y. Cheung,Gavin Siew Wei Tan,Yih-Chung Tham,Ching-Yu Cheng,Huating Li,Tien Yin Wong,Weiping Jia

DOI: https://doi.org/10.1038/s41591-023-02702-z

IF: 82.9

2024-01-01

Nature Medicine

Abstract:Diabetic retinopathy (DR) is the leading cause of preventable blindness worldwide. The risk of DR progression is highly variable among different individuals, making it difficult to predict risk and personalize screening intervals. We developed and validated a deep learning system (DeepDR Plus) to predict time to DR progression within 5 years solely from fundus images. First, we used 717,308 fundus images from 179,327 participants with diabetes to pretrain the system. Subsequently, we trained and validated the system with a multiethnic dataset comprising 118,868 images from 29,868 participants with diabetes. For predicting time to DR progression, the system achieved concordance indexes of 0.754-0.846 and integrated Brier scores of 0.153-0.241 for all times up to 5 years. Furthermore, we validated the system in real-world cohorts of participants with diabetes. The integration with clinical workflow could potentially extend the mean screening interval from 12 months to 31.97 months, and the percentage of participants recommended to be screened at 1-5 years was 30.62%, 20.00%, 19.63%, 11.85% and 17.89%, respectively, while delayed detection of progression to vision-threatening DR was 0.18%. Altogether, the DeepDR Plus system could predict individualized risk and time to DR progression over 5 years, potentially allowing personalized screening intervals.
Deep learning in estimating prevalence and systemic risk factors for diabetic retinopathy: a multi-ethnic study

Daniel S. W. Ting,Carol Y. Cheung,Quang Nguyen,Charumathi Sabanayagam,Gilbert Lim,Zhan Wei Lim,Gavin S. W. Tan,Yu Qiang Soh,Leopold Schmetterer,Ya Xing Wang,Jost B. Jonas,Rohit Varma,Mong Li Lee,Wynne Hsu,Ecosse Lamoureux,Ching-Yu Cheng,Tien Yin Wong

DOI: https://doi.org/10.1038/s41746-019-0097-x

IF: 15.2

2019-04-10

npj Digital Medicine

Abstract:In any community, the key to understanding the burden of a specific condition is to conduct an epidemiological study. The deep learning system (DLS) recently showed promising diagnostic performance for diabetic retinopathy (DR). This study aims to use DLS as the grading tool, instead of human assessors, to determine the prevalence and the systemic cardiovascular risk factors for DR on fundus photographs, in patients with diabetes. This is a multi-ethnic (5 races), multi-site (8 datasets from Singapore, USA, Hong Kong, China and Australia), cross-sectional study involving 18,912 patients (<i>n</i> = 93,293 images). We compared these results and the time taken for DR assessment by DLS versus 17 human assessors – 10 retinal specialists/ophthalmologists and 7 professional graders). The estimation of DR prevalence between DLS and human assessors is comparable for any DR, referable DR and vision–threatening DR (VTDR) (Human assessors: 15.9, 6.5% and 4.1%; DLS: 16.1%, 6.4%, 3.7%). Both assessment methods identified similar risk factors (with comparable AUCs), including younger age, longer diabetes duration, increased HbA1c and systolic blood pressure, for any DR, referable DR and VTDR (<i>p</i> > 0.05). The total time taken for DLS to evaluate DR from 93,293 fundus photographs was ~1 month compared to 2 years for human assessors. In conclusion, the prevalence and systemic risk factors for DR in multi-ethnic population could be determined accurately using a DLS, in significantly less time than human assessors. This study highlights the potential use of AI for future epidemiology or clinical trials for DR grading in the global communities.

health care sciences & services,medical informatics
Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs.

J. Mega,L. Peng,R. Kim,Marc Coram,Derek J. Wu,Kasumi Widner,R. Raman,D. Webster,Martin C. Stumpe,T. Madams,Philip Nelson,Arunachalam Narayanaswamy,Subhashini Venugopalan,Varun Gulshan,Jorge A Cuadros

DOI: https://doi.org/10.1001/jama.2016.17216

2016-12-13

Abstract:Importance Deep learning is a family of computational methods that allow an algorithm to program itself by learning from a large set of examples that demonstrate the desired behavior, removing the need to specify rules explicitly. Application of these methods to medical imaging requires further assessment and validation. Objective To apply deep learning to create an algorithm for automated detection of diabetic retinopathy and diabetic macular edema in retinal fundus photographs. Design and Setting A specific type of neural network optimized for image classification called a deep convolutional neural network was trained using a retrospective development data set of 128 175 retinal images, which were graded 3 to 7 times for diabetic retinopathy, diabetic macular edema, and image gradability by a panel of 54 US licensed ophthalmologists and ophthalmology senior residents between May and December 2015. The resultant algorithm was validated in January and February 2016 using 2 separate data sets, both graded by at least 7 US board-certified ophthalmologists with high intragrader consistency. Exposure Deep learning-trained algorithm. Main Outcomes and Measures The sensitivity and specificity of the algorithm for detecting referable diabetic retinopathy (RDR), defined as moderate and worse diabetic retinopathy, referable diabetic macular edema, or both, were generated based on the reference standard of the majority decision of the ophthalmologist panel. The algorithm was evaluated at 2 operating points selected from the development set, one selected for high specificity and another for high sensitivity. Results The EyePACS-1 data set consisted of 9963 images from 4997 patients (mean age, 54.4 years; 62.2% women; prevalence of RDR, 683/8878 fully gradable images [7.8%]); the Messidor-2 data set had 1748 images from 874 patients (mean age, 57.6 years; 42.6% women; prevalence of RDR, 254/1745 fully gradable images [14.6%]). For detecting RDR, the algorithm had an area under the receiver operating curve of 0.991 (95% CI, 0.988-0.993) for EyePACS-1 and 0.990 (95% CI, 0.986-0.995) for Messidor-2. Using the first operating cut point with high specificity, for EyePACS-1, the sensitivity was 90.3% (95% CI, 87.5%-92.7%) and the specificity was 98.1% (95% CI, 97.8%-98.5%). For Messidor-2, the sensitivity was 87.0% (95% CI, 81.1%-91.0%) and the specificity was 98.5% (95% CI, 97.7%-99.1%). Using a second operating point with high sensitivity in the development set, for EyePACS-1 the sensitivity was 97.5% and specificity was 93.4% and for Messidor-2 the sensitivity was 96.1% and specificity was 93.9%. Conclusions and Relevance In this evaluation of retinal fundus photographs from adults with diabetes, an algorithm based on deep machine learning had high sensitivity and specificity for detecting referable diabetic retinopathy. Further research is necessary to determine the feasibility of applying this algorithm in the clinical setting and to determine whether use of the algorithm could lead to improved care and outcomes compared with current ophthalmologic assessment.

Computer Science,Medicine
Automated Machine Learning for Predicting Diabetic Retinopathy Progression From Ultra-Widefield Retinal Images

Paolo S. Silva,Dean Zhang,Cris Martin P. Jacoba,Ward Fickweiler,Drew Lewis,Jeremy Leitmeyer,Katie Curran,Recivall P. Salongcay,Duy Doan,Mohamed Ashraf,Jerry D. Cavallerano,Jennifer K. Sun,Tunde Peto,Lloyd Paul Aiello

DOI: https://doi.org/10.1001/jamaophthalmol.2023.6318

IF: 8.253

2024-02-08

JAMA Ophthalmology

Abstract:Importance Machine learning (ML) algorithms have the potential to identify eyes with early diabetic retinopathy (DR) at increased risk for disease progression. Objective To create and validate automated ML models (autoML) for DR progression from ultra-widefield (UWF) retinal images. Design, Setting and Participants Deidentified UWF images with mild or moderate nonproliferative DR (NPDR) with 3 years of longitudinal follow-up retinal imaging or evidence of progression within 3 years were used to develop automated ML models for predicting DR progression in UWF images. All images were collected from a tertiary diabetes-specific medical center retinal image dataset. Data were collected from July to September 2022. Exposure Automated ML models were generated from baseline on-axis 200° UWF retinal images. Baseline retinal images were labeled for progression based on centralized reading center evaluation of baseline and follow-up images according to the clinical Early Treatment Diabetic Retinopathy Study severity scale. Images for model development were split 8-1-1 for training, optimization, and testing to detect 1 or more steps of DR progression. Validation was performed using a 328-image set from the same patient population not used in model development. Main Outcomes and Measures Area under the precision-recall curve (AUPRC), sensitivity, specificity, and accuracy. Results A total of 1179 deidentified UWF images with mild (380 [32.2%]) or moderate (799 [67.8%]) NPDR were included. DR progression was present in half of the training set (590 of 1179 [50.0%]). The model’s AUPRC was 0.717 for baseline mild NPDR and 0.863 for moderate NPDR. On the validation set for eyes with mild NPDR, sensitivity was 0.72 (95% CI, 0.57-0.83), specificity was 0.63 (95% CI, 0.57-0.69), prevalence was 0.15 (95% CI, 0.12-0.20), and accuracy was 64.3%; for eyes with moderate NPDR, sensitivity was 0.80 (95% CI, 0.70-0.87), specificity was 0.72 (95% CI, 0.66-0.76), prevalence was 0.22 (95% CI, 0.19-0.27), and accuracy was 73.8%. In the validation set, 6 of 9 eyes (75%) with mild NPDR and 35 of 41 eyes (85%) with moderate NPDR progressed 2 steps or more were identified. All 4 eyes with mild NPDR that progressed within 6 months and 1 year were identified, and 8 of 9 (89%) and 17 of 20 (85%) with moderate NPDR that progressed within 6 months and 1 year, respectively, were identified. Conclusions and Relevance This study demonstrates the accuracy and feasibility of automated ML models for identifying DR progression developed using UWF images, especially for prediction of 2-step or greater DR progression within 1 year. Potentially, the use of ML algorithms may refine the risk of disease progression and identify those at highest short-term risk, thus reducing costs and improving vision-related outcomes.

ophthalmology
Deep learning algorithms to detect diabetic kidney disease from retinal photographs in multiethnic populations with diabetes

Bjorn Kaijun Betzler,Evelyn Yi Lyn Chee,Feng He,Cynthia Ciwei Lim,Jinyi Ho,Haslina Hamzah,Ngiap Chuan Tan,Gerald Liew,Gareth J McKay,Ruth E Hogg,Ian S Young,Ching-Yu Cheng,Su Chi Lim,Aaron Y Lee,Tien Yin Wong,Mong Li Lee,Wynne Hsu,Gavin Siew Wei Tan,Charumathi Sabanayagam

DOI: https://doi.org/10.1093/jamia/ocad179

2023-09-02

Journal of the American Medical Informatics Association

Abstract:Abstract Objective To develop a deep learning algorithm (DLA) to detect diabetic kideny disease (DKD) from retinal photographs of patients with diabetes, and evaluate performance in multiethnic populations. Materials and methods We trained 3 models: (1) image-only; (2) risk factor (RF)-only multivariable logistic regression (LR) model adjusted for age, sex, ethnicity, diabetes duration, HbA1c, systolic blood pressure; (3) hybrid multivariable LR model combining RF data and standardized z-scores from image-only model. Data from Singapore Integrated Diabetic Retinopathy Program (SiDRP) were used to develop (6066 participants with diabetes, primary-care-based) and internally validate (5-fold cross-validation) the models. External testing on 2 independent datasets: (1) Singapore Epidemiology of Eye Diseases (SEED) study (1885 participants with diabetes, population-based); (2) Singapore Macroangiopathy and Microvascular Reactivity in Type 2 Diabetes (SMART2D) (439 participants with diabetes, cross-sectional) in Singapore. Supplementary external testing on 2 Caucasian cohorts: (3) Australian Eye and Heart Study (AHES) (460 participants with diabetes, cross-sectional) and (4) Northern Ireland Cohort for the Longitudinal Study of Ageing (NICOLA) (265 participants with diabetes, cross-sectional). Results In SiDRP validation, area under the curve (AUC) was 0.826(95% CI 0.818-0.833) for image-only, 0.847(0.840-0.854) for RF-only, and 0.866(0.859-0.872) for hybrid. Estimates with SEED were 0.764(0.743-0.785) for image-only, 0.802(0.783-0.822) for RF-only, and 0.828(0.810-0.846) for hybrid. In SMART2D, AUC was 0.726(0.686-0.765) for image-only, 0.701(0.660-0.741) in RF-only, 0.761(0.724-0.797) for hybrid. Discussion and conclusion There is potential for DLA using retinal images as a screening adjunct for DKD among individuals with diabetes. This can value-add to existing DLA systems which diagnose diabetic retinopathy from retinal images, facilitating primary screening for DKD.

information science & library science,computer science, information systems, interdisciplinary applications,health care sciences & services,medical informatics
An Automated Grading System for Detection of Vision-Threatening Referable Diabetic Retinopathy on the Basis of Color Fundus Photographs

Zhixi Li,Stuart Keel,Chi Liu,Yifan He,Wei Meng,Jane Scheetz,Pei Ying Lee,Jonathan Shaw,Daniel Ting,Tien Yin Wong,Hugh Taylor,Robert Chang,Mingguang He

DOI: https://doi.org/10.2337/dc18-0147

2018-10-01

Diabetes Care

Abstract:OBJECTIVE The goal of this study was to describe the development and validation of an artificial intelligence–based, deep learning algorithm (DLA) for the detection of referable diabetic retinopathy (DR). RESEARCH DESIGN AND METHODS A DLA using a convolutional neural network was developed for automated detection of vision-threatening referable DR (preproliferative DR or worse, diabetic macular edema, or both). The DLA was tested by using a set of 106,244 nonstereoscopic retinal images. A panel of ophthalmologists graded DR severity in retinal photographs included in the development and internal validation data sets (n = 71,043); a reference standard grading was assigned once three graders achieved consistent grading outcomes. For external validation, we tested our DLA using 35,201 images of 14,520 eyes (904 eyes with any DR; 401 eyes with vision-threatening referable DR) from population-based cohorts of Malays, Caucasian Australians, and Indigenous Australians. RESULTS Among the 71,043 retinal images in the training and validation data sets, 12,329 showed vision-threatening referable DR. In the internal validation data set, the area under the curve (AUC), sensitivity, and specificity of the DLA for vision-threatening referable DR were 0.989, 97.0%, and 91.4%, respectively. Testing against the independent, multiethnic data set achieved an AUC, sensitivity, and specificity of 0.955, 92.5%, and 98.5%, respectively. Among false-positive cases, 85.6% were due to a misclassification of mild or moderate DR. Undetected intraretinal microvascular abnormalities accounted for 77.3% of all false-negative cases. CONCLUSIONS This artificial intelligence–based DLA can be used with high accuracy in the detection of vision-threatening referable DR in retinal images. This technology offers potential to increase the efficiency and accessibility of DR screening programs.

endocrinology & metabolism
A deep learning system for detecting diabetic retinopathy across the disease spectrum

Ling Dai,Liang Wu,Huating Li,Chun Cai,Qiang Wu,Hongyu Kong,Ruhan Liu,Xiangning Wang,Xuhong Hou,Yuexing Liu,Xiaoxue Long,Yang Wen,Lina Lu,Yaxin Shen,Yan Chen,Dinggang Shen,Xiaokang Yang,Haidong Zou,Bin Sheng,Weiping Jia

DOI: https://doi.org/10.1038/s41467-021-23458-5

IF: 16.6

2021-05-28

Nature Communications

Abstract:Abstract Retinal screening contributes to early detection of diabetic retinopathy and timely treatment. To facilitate the screening process, we develop a deep learning system, named DeepDR, that can detect early-to-late stages of diabetic retinopathy. DeepDR is trained for real-time image quality assessment, lesion detection and grading using 466,247 fundus images from 121,342 patients with diabetes. Evaluation is performed on a local dataset with 200,136 fundus images from 52,004 patients and three external datasets with a total of 209,322 images. The area under the receiver operating characteristic curves for detecting microaneurysms, cotton-wool spots, hard exudates and hemorrhages are 0.901, 0.941, 0.954 and 0.967, respectively. The grading of diabetic retinopathy as mild, moderate, severe and proliferative achieves area under the curves of 0.943, 0.955, 0.960 and 0.972, respectively. In external validations, the area under the curves for grading range from 0.916 to 0.970, which further supports the system is efficient for diabetic retinopathy grading.

multidisciplinary sciences
Evaluating a Deep Learning Diabetic Retinopathy Grading System Developed on Mydriatic Retinal Images When Applied to Non-Mydriatic Community Screening

Joan M. Nunez do Rio,Paul Nderitu,Christos Bergeles,Sobha Sivaprasad,Gavin S. W. Tan,Rajiv Raman

DOI: https://doi.org/10.3390/jcm11030614

IF: 3.9

2022-01-26

Journal of Clinical Medicine

Abstract:Artificial Intelligence has showcased clear capabilities to automatically grade diabetic retinopathy (DR) on mydriatic retinal images captured by clinical experts on fixed table-top retinal cameras within hospital settings. However, in many low- and middle-income countries, screening for DR revolves around minimally trained field workers using handheld non-mydriatic cameras in community settings. This prospective study evaluated the diagnostic accuracy of a deep learning algorithm developed using mydriatic retinal images by the Singapore Eye Research Institute, commercially available as Zeiss VISUHEALTH-AI DR, on images captured by field workers on a Zeiss Visuscout® 100 non-mydriatic handheld camera from people with diabetes in a house-to-house cross-sectional study across 20 regions in India. A total of 20,489 patient eyes from 11,199 patients were used to evaluate algorithm performance in identifying referable DR, non-referable DR, and gradability. For each category, the algorithm achieved precision values of 29.60 (95% CI 27.40, 31.88), 92.56 (92.13, 92.97), and 58.58 (56.97, 60.19), recall values of 62.69 (59.17, 66.12), 85.65 (85.11, 86.18), and 65.06 (63.40, 66.69), and F-score values of 40.22 (38.25, 42.21), 88.97 (88.62, 89.31), and 61.65 (60.50, 62.80), respectively. Model performance reached 91.22 (90.79, 91.64) sensitivity and 65.06 (63.40, 66.69) specificity at detecting gradability and 72.08 (70.68, 73.46) sensitivity and 85.65 (85.11, 86.18) specificity for the detection of all referable eyes. Algorithm accuracy is dependent on the quality of acquired retinal images, and this is a major limiting step for its global implementation in community non-mydriatic DR screening using handheld cameras. This study highlights the need to develop and train deep learning-based screening tools in such conditions before implementation.

medicine, general & internal
Validation of a deep learning system for the detection of diabetic retinopathy in Indigenous Australians

Mark A Chia,Fred Hersch,Rory Sayres,Pinal Bavishi,Richa Tiwari,Pearse A Keane,Angus W Turner

DOI: https://doi.org/10.1136/bjo-2022-322237

2023-02-06

British Journal of Ophthalmology

Abstract:Background/aims Deep learning systems (DLSs) for diabetic retinopathy (DR) detection show promising results but can underperform in racial and ethnic minority groups, therefore external validation within these populations is critical for health equity. This study evaluates the performance of a DLS for DR detection among Indigenous Australians, an understudied ethnic group who suffer disproportionately from DR-related blindness. Methods We performed a retrospective external validation study comparing the performance of a DLS against a retinal specialist for the detection of more-than-mild DR (mtmDR), vision-threatening DR (vtDR) and all-cause referable DR. The validation set consisted of 1682 consecutive, single-field, macula-centred retinal photographs from 864 patients with diabetes (mean age 54.9 years, 52.4% women) at an Indigenous primary care service in Perth, Australia. Three-person adjudication by a panel of specialists served as the reference standard. Results For mtmDR detection, sensitivity of the DLS was superior to the retina specialist (98.0% (95% CI, 96.5 to 99.4) vs 87.1% (95% CI, 83.6 to 90.6), McNemar’s test p<0.001) with a small reduction in specificity (95.1% (95% CI, 93.6 to 96.4) vs 97.0% (95% CI, 95.9 to 98.0), p=0.006). For vtDR, the DLS’s sensitivity was again superior to the human grader (96.2% (95% CI, 93.4 to 98.6) vs 84.4% (95% CI, 79.7 to 89.2), p<0.001) with a slight drop in specificity (95.8% (95% CI, 94.6 to 96.9) vs 97.8% (95% CI, 96.9 to 98.6), p=0.002). For all-cause referable DR, there was a substantial increase in sensitivity (93.7% (95% CI, 91.8 to 95.5) vs 74.4% (95% CI, 71.1 to 77.5), p<0.001) and a smaller reduction in specificity (91.7% (95% CI, 90.0 to 93.3) vs 96.3% (95% CI, 95.2 to 97.4), p<0.001). Conclusion The DLS showed improved sensitivity and similar specificity compared with a retina specialist for DR detection. This demonstrates its potential to support DR screening among Indigenous Australians, an underserved population with a high burden of diabetic eye disease.

ophthalmology
Screening and evaluation of diabetic retinopathy via a deep learning network model: A prospective study

Li Yao,Chan-Yuan Cao,Guo-Xiao Yu,Xu-Peng Shu,Xiao-Nan Fan,Yi-Fan Zhang

DOI: https://doi.org/10.4239/wjd.v15.i12.2302

2024-11-24

World Journal of Diabetes

Abstract:BACKGROUND Diabetic retinopathy (DR) is one of the most common serious complications in diabetic patients, and early screening and diagnosis are essential to prevent visual impairment. With the rapid development of deep learning technology, network models based on attention mechanisms have shown significant advantages in medical image analysis, which can improve the accuracy and efficiency of screening. AIM To evaluate the efficacy of an attention mechanism-based deep learning network model in screening for DR in natural and diabetic populations, as well as in screening with unilateral and bilateral fundus photography. METHODS From January 2023 to June 2024, a stratified multistage cluster sampling method was adopted to select a representative sample of permanent residents aged 18-70 years from our hospital. A total of 948 fundus images from 474 participants were included in the "deep learning model" system for scoring. The fundus images were graded via the early treatment of DR [Early Treatment Diabetic Retinopathy Study (ETDRS)] scoring system as the gold standard for the diagnosis of DR. With "DR to be referred (ETDRS > 31)" as the reference variable, a receiver operating characteristic curve was drawn to evaluate the area under the curve (AUC), sensitivity and specificity of the "deep learning model" to determine the screening efficiency of the system. RESULTS For each subject, in the natural population, the AUC of using the "deep learning model system" to screen "DR-requiring referral" was 0.941, and the sensitivity and specificity were 98.15% and 90.08%, respectively. The sensitivity and specificity of two-directional fundus photography were 100% and 86.91%, respectively. In the diabetic population, the AUC, sensitivity and specificity were 0.901, 98.08% and 82.10%, respectively, when "wise eye sugar net" unilateral fundus photography was used to screen for "DR-requiring referrals". CONCLUSION In both the natural population and the diabetic population, the deep learning model system has shown high sensitivity and specificity and can be used as an auxiliary means of DR screening.

endocrinology & metabolism
Detecting diabetic retinopathy through machine learning on electronic health record data from an urban, safety net healthcare system

Omolola I Ogunyemi,Meghal Gandhi,Martin Lee,Senait Teklehaimanot,Lauren Patty Daskivich,David Hindman,Kevin Lopez,Ricky K Taira

DOI: https://doi.org/10.1093/jamiaopen/ooab066

2021-07-01

JAMIA Open

Abstract:Abstract Objective Clinical guidelines recommend annual eye examinations to detect diabetic retinopathy (DR) in patients with diabetes. However, timely DR detection remains a problem in medically underserved and under-resourced settings in the United States. Machine learning that identifies patients with latent/undiagnosed DR could help to address this problem. Materials and Methods Using electronic health record data from 40 631 unique diabetic patients seen at Los Angeles County Department of Health Services healthcare facilities between January 1, 2015 and December 31, 2017, we compared ten machine learning environments, including five classifier models, for assessing the presence or absence of DR. We also used data from a distinct set of 9300 diabetic patients seen between January 1, 2018 and December 31, 2018 as an external validation set. Results Following feature subset selection, the classifier with the best AUC on the external validation set was a deep neural network using majority class undersampling, with an AUC of 0.8, the sensitivity of 72.17%, and specificity of 74.2%. Discussion A deep neural network produced the best AUCs and sensitivity results on the test set and external validation set. Models are intended to be used to screen guideline noncompliant diabetic patients in an urban safety-net setting. Conclusion Machine learning on diabetic patients’ routinely collected clinical data could help clinicians in safety-net settings to identify and target unscreened diabetic patients who potentially have undiagnosed DR.
Detecting hidden signs of diabetes in external eye photographs

Boris Babenko,Akinori Mitani,Ilana Traynis,Naho Kitade,Preeti Singh,April Maa,Jorge Cuadros,Greg S. Corrado,Lily Peng,Dale R. Webster,Avinash Varadarajan,Naama Hammel,Yun Liu

DOI: https://doi.org/10.48550/arXiv.2011.11732

2020-11-23

Image and Video Processing

Abstract:Diabetes-related retinal conditions can be detected by examining the posterior of the eye. By contrast, examining the anterior of the eye can reveal conditions affecting the front of the eye, such as changes to the eyelids, cornea, or crystalline lens. In this work, we studied whether external photographs of the front of the eye can reveal insights into both diabetic retinal diseases and blood glucose control. We developed a deep learning system (DLS) using external eye photographs of 145,832 patients with diabetes from 301 diabetic retinopathy (DR) screening sites in one US state, and evaluated the DLS on three validation sets containing images from 198 sites in 18 other US states. In validation set A (n=27,415 patients, all undilated), the DLS detected poor blood glucose control (HbA1c > 9%) with an area under receiver operating characteristic curve (AUC) of 70.2; moderate-or-worse DR with an AUC of 75.3; diabetic macular edema with an AUC of 78.0; and vision-threatening DR with an AUC of 79.4. For all 4 prediction tasks, the DLS's AUC was higher (p<0.001) than using available self-reported baseline characteristics (age, sex, race/ethnicity, years with diabetes). In terms of positive predictive value, the predicted top 5% of patients had a 67% chance of having HbA1c > 9%, and a 20% chance of having vision threatening diabetic retinopathy. The results generalized to dilated pupils (validation set B, 5,058 patients) and to a different screening service (validation set C, 10,402 patients). Our results indicate that external eye photographs contain information useful for healthcare providers managing patients with diabetes, and may help prioritize patients for in-person screening. Further work is needed to validate these findings on different devices and patient populations (those without diabetes) to evaluate its utility for remote diagnosis and management.
Analyzing fundus images to detect diabetic retinopathy (DR) using deep learning system in the Yangtze River delta region of China

Li Lu,Peifang Ren,Qianyi Lu,Enliang Zhou,Wangshu Yu,Jiani Huang,Xiaoying He,Wei Han

DOI: https://doi.org/10.21037/atm-20-3275

IF: 3.616

2021-02-01

Annals of Translational Medicine

Abstract:BACKGROUND: This study aimed to establish and evaluate an artificial intelligence-based deep learning system (DLS) for automatic detection of diabetic retinopathy. This could be important in developing an advanced tele-screening system for diabetic retinopathy.METHODS: A DLS with a convolutional neural network was developed to recognize fundus images of referable diabetic retinopathy. A total data set of 41,866 color fundus images were obtained from 17 cities in the Yangtze River Delta Urban Agglomeration (YRDUA). Five experienced retinal specialists and 15 ophthalmologists were recruited to verify images. For training, 80% of the data set was used, and the other 20% served as the validation data set. To effectively understand the learning process, the DLS automatically superimposed a heatmap on the original image. The regions utilized by the DLS were highlighted for diagnosis.RESULTS: Using the local validation data set, the DLS achieved an area under the curve of 0.9824. Based on the manual screening criteria, an operating point was set at about 0.9 sensitivity to evaluate the DLS. Specificity was recorded at 0.9609 and sensitivity was 0.9003. The DLSs showed excellent reliability, repeatability, and high efficiency. After analyzing the misclassification, it was found that 88.6% of the false-positives were mild non-proliferative diabetic retinopathy (NPDR) whereas, 81.6% of the false-negatives were intraretinal microvascular abnormalities.CONCLUSIONS: The DLS efficiently detected fundus images from complex sources in the real world. Incorporating DLS technology in tele-screening will advance the current screening programs to offer a cost-effective and time-efficient solution for detecting diabetic retinopathy.

oncology,medicine, research & experimental
Performance of a deep learning system for detection of referable diabetic retinopathy in real clinical settings

Verónica Sánchez-Gutiérrez,Paula Hernández-Martínez,Francisco J. Muñoz-Negrete,Jonne Engelberts,Allison M. Luger,Mark J.J.P. van Grinsven

DOI: https://doi.org/10.48550/arXiv.2205.05554

2022-05-11

Image and Video Processing

Abstract:Background: To determine the ability of a commercially available deep learning system, RetCAD v.1.3.1 (Thirona, Nijmegen, The Netherlands) for the automatic detection of referable diabetic retinopathy (DR) on a dataset of colour fundus images acquired during routine clinical practice in a tertiary hospital screening program, analyzing the reduction of workload that can be released incorporating this artificial intelligence-based technology. Methods: Evaluation of the software was performed on a dataset of 7195 nonmydriatic fundus images from 6325 eyes of 3189 diabetic patients attending our screening program between February to December of 2019. The software generated a DR severity score for each colour fundus image which was combined into an eye-level score. This score was then compared with a reference standard as set by a human expert using receiver operating characteristic (ROC) curve analysis. Results: The artificial intelligence (AI) software achieved an area under the ROC curve (AUC) value of 0.988 [0.981:0.993] for the detection of referable DR. At the proposed operating point, the sensitivity of the RetCAD software for DR is 90.53% and specificity is 97.13%. A workload reduction of 96% could be achieved at the cost of only 6 false negatives. Conclusions: The AI software correctly identified the vast majority of referable DR cases, with a workload reduction of 96% of the cases that would need to be checked, while missing almost no true cases, so it may therefore be used as an instrument for triage.
Predicting optical coherence tomography-derived diabetic macular edema grades from fundus photographs using deep learning

Avinash Varadarajan,Pinal Bavishi,Paisan Raumviboonsuk,Peranut Chotcomwongse,Subhashini Venugopalan,Arunachalam Narayanaswamy,Jorge Cuadros,Kuniyoshi Kanai,George Bresnick,Mongkol Tadarati,Sukhum Silpa-archa,Jirawut Limwattanayingyong,Variya Nganthavee,Joe Ledsam,Pearse A Keane,Greg S Corrado,Lily Peng,Dale R Webster

DOI: https://doi.org/10.1038/s41467-019-13922-8

2019-08-01

Abstract:Diabetic eye disease is one of the fastest growing causes of preventable blindness. With the advent of anti-VEGF (vascular endothelial growth factor) therapies, it has become increasingly important to detect center-involved diabetic macular edema (ci-DME). However, center-involved diabetic macular edema is diagnosed using optical coherence tomography (OCT), which is not generally available at screening sites because of cost and workflow constraints. Instead, screening programs rely on the detection of hard exudates in color fundus photographs as a proxy for DME, often resulting in high false positive or false negative calls. To improve the accuracy of DME screening, we trained a deep learning model to use color fundus photographs to predict ci-DME. Our model had an ROC-AUC of 0.89 (95% CI: 0.87-0.91), which corresponds to a sensitivity of 85% at a specificity of 80%. In comparison, three retinal specialists had similar sensitivities (82-85%), but only half the specificity (45-50%, p<0.001 for each comparison with model). The positive predictive value (PPV) of the model was 61% (95% CI: 56-66%), approximately double the 36-38% by the retinal specialists. In addition to predicting ci-DME, our model was able to detect the presence of intraretinal fluid with an AUC of 0.81 (95% CI: 0.81-0.86) and subretinal fluid with an AUC of 0.88 (95% CI: 0.85-0.91). The ability of deep learning algorithms to make clinically relevant predictions that generally require sophisticated 3D-imaging equipment from simple 2D images has broad relevance to many other applications in medical imaging.

Computer Vision and Pattern Recognition,Machine Learning

Information Bottleneck with Local Consistency

Predicting Risk of Developing Diabetic Retinopathy using Deep Learning

Prediction of retinopathy progression using deep learning on retinal images within the Scottish screening programme

Using deep learning to detect diabetic retinopathy on handheld non-mydriatic retinal images acquired by field workers in community settings

Predicting the future development of diabetic retinopathy using a deep learning algorithm for the analysis of non-invasive retinal imaging

Deep learning algorithm predicts diabetic retinopathy progression in individual patients

A Deep Learning System for Predicting Time to Progression of Diabetic Retinopathy

Deep learning in estimating prevalence and systemic risk factors for diabetic retinopathy: a multi-ethnic study

Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs.

Automated Machine Learning for Predicting Diabetic Retinopathy Progression From Ultra-Widefield Retinal Images

Deep learning algorithms to detect diabetic kidney disease from retinal photographs in multiethnic populations with diabetes

An Automated Grading System for Detection of Vision-Threatening Referable Diabetic Retinopathy on the Basis of Color Fundus Photographs

A deep learning system for detecting diabetic retinopathy across the disease spectrum

Evaluating a Deep Learning Diabetic Retinopathy Grading System Developed on Mydriatic Retinal Images When Applied to Non-Mydriatic Community Screening

Validation of a deep learning system for the detection of diabetic retinopathy in Indigenous Australians

Screening and evaluation of diabetic retinopathy via a deep learning network model: A prospective study

Detecting diabetic retinopathy through machine learning on electronic health record data from an urban, safety net healthcare system

Detecting hidden signs of diabetes in external eye photographs

Analyzing fundus images to detect diabetic retinopathy (DR) using deep learning system in the Yangtze River delta region of China

Performance of a deep learning system for detection of referable diabetic retinopathy in real clinical settings

Predicting optical coherence tomography-derived diabetic macular edema grades from fundus photographs using deep learning