Food hypersensitivity among asthmatic children – single center experience

S. Al-Ani,S. Al-Hammadi

DOI: https://doi.org/10.1186/2045-7022-3-S3-P37

2013-07-25

Clinical and Translational Allergy

Abstract:

What problem does this paper attempt to address?

A Deep-learning Approach for Prognosis of Age-Related Macular Degeneration Disease using SD-OCT Imaging Biomarkers

Imon Banerjee,Luis de Sisternes,Joelle Hallak,Theodore Leng,Aaron Osborne,Mary Durbin,Daniel Rubin

DOI: https://doi.org/10.48550/arXiv.1902.10700

2019-02-27

Quantitative Methods

Abstract:We propose a hybrid sequential deep learning model to predict the risk of AMD progression in non-exudative AMD eyes at multiple timepoints, starting from short-term progression (3-months) up to long-term progression (21-months). Proposed model combines radiomics and deep learning to handle challenges related to imperfect ratio of OCT scan dimension and training cohort size. We considered a retrospective clinical trial dataset that includes 671 fellow eyes with 13,954 dry AMD observations for training and validating the machine learning models on a 10-fold cross validation setting. The proposed RNN model achieved high accuracy (0.96 AUCROC) for the prediction of both short term and long-term AMD progression, and outperformed the traditional random forest model trained. High accuracy achieved by the RNN establishes the ability to identify AMD patients at risk of progressing to advanced AMD at an early stage which could have a high clinical impact as it allows for optimal clinical follow-up, with more frequent screening and potential earlier treatment for those patients at high risk.
Predicting risk of late age-related macular degeneration using deep learning

Yifan Peng,Tiarnan D. Keenan,Qingyu Chen,Elvira Agrón,Alexis Allot,Wai T. Wong,Emily Y. Chew,Zhiyong Lu

DOI: https://doi.org/10.48550/arXiv.2007.09550

2020-07-19

Abstract:By 2040, age-related macular degeneration (AMD) will affect approximately 288 million people worldwide. Identifying individuals at high risk of progression to late AMD, the sight-threatening stage, is critical for clinical actions, including medical interventions and timely monitoring. Although deep learning has shown promise in diagnosing/screening AMD using color fundus photographs, it remains difficult to predict individuals' risks of late AMD accurately. For both tasks, these initial deep learning attempts have remained largely unvalidated in independent cohorts. Here, we demonstrate how deep learning and survival analysis can predict the probability of progression to late AMD using 3,298 participants (over 80,000 images) from the Age-Related Eye Disease Studies AREDS and AREDS2, the largest longitudinal clinical trials in AMD. When validated against an independent test dataset of 601 participants, our model achieved high prognostic accuracy (five-year C-statistic 86.4 (95% confidence interval 86.2-86.6)) that substantially exceeded that of retinal specialists using two existing clinical standards (81.3 (81.1-81.5) and 82.0 (81.8-82.3), respectively). Interestingly, our approach offers additional strengths over the existing clinical standards in AMD prognosis (e.g., risk ascertainment above 50%) and is likely to be highly generalizable, given the breadth of training data from 82 US retinal specialty clinics. Indeed, during external validation through training on AREDS and testing on AREDS2 as an independent cohort, our model retained substantially higher prognostic accuracy than existing clinical standards. These results highlight the potential of deep learning systems to enhance clinical decision-making in AMD patients.

Image and Video Processing,Computer Vision and Pattern Recognition
Deep learning for automatic prediction of early activation of treatment naïve non-exudative MNVs in AMD

Emanuele Crincoli,Fiammetta Catania,Riccardo Sacconi,Nicolò Ribarich,Silvia Ferrara,Mariacristina Parravano,Eliana Costanzo,Giuseppe Querques

DOI: https://doi.org/10.1097/iae.0000000000004106

2024-03-14

Retina

Abstract:Background: Around 30% of non-exudative macular neovascularizations(NE-MNVs) exudate within 2 years from diagnosis in patients with age-related macular degeneration(AMD).The aim of the study is to develop a deep learning classifier based on optical coherence tomography(OCT) and OCT angiography(OCTA) to identify NE-MNVs at risk of exudation. Methods: AMD patients showing OCTA and fluorescein angiography (FA) documented NE-MNV with a 2-years minimum imaging follow-up were retrospectively selected. Patients showing OCT B-scan-documented MNV exudation within the first 2 years formed the EX-GROUP while the others formed QU-GROUP.ResNet-101, Inception-ResNet-v2 and DenseNet-201 were independently trained on OCTA and OCT B-scan images. Combinations of the 6 models were evaluated with major and soft voting techniques. Results: Eighty-nine (89) eyes of 89 patients with a follow-up of 5.7 ± 1.5 years were recruited(35 EX GROUP and 54 QU GROUP). Inception-ResNet-v2 was the best performing among the 3 single convolutional neural networks(CNNs).The major voting model resulting from the association of the 3 different CNNs resulted in improvement of performance both for OCTA and OCT B-scan (both significantly higher than human graders’ performance). Soft voting model resulting from the combination of OCTA and OCT B-scan based major voting models showed a testing accuracy of 94.4%. Peripheral arcades and large vessels on OCTA enface imaging were more prevalent in QU GROUP. Conclusions: Artificial intelligence shows high performances in identifications of NE-MNVs at risk for exudation within the first 2 years of follow up, allowing better customization of follow up timing and avoiding treatment delay. Better results are obtained with the combination of OCTA and OCT B-scan image analysis.

ophthalmology
Forecasting Disease Progression with Parallel Hyperplanes in Longitudinal Retinal OCT

Arunava Chakravarty,Taha Emre,Dmitrii Lachinov,Antoine Rivail,Hendrik Scholl,Lars Fritsche,Sobha Sivaprasad,Daniel Rueckert,Andrew Lotery,Ursula Schmidt-Erfurth,Hrvoje Bogunović

2024-10-03

Abstract:Predicting future disease progression risk from medical images is challenging due to patient heterogeneity, and subtle or unknown imaging biomarkers. Moreover, deep learning (DL) methods for survival analysis are susceptible to image domain shifts across scanners. We tackle these issues in the task of predicting late dry Age-related Macular Degeneration (dAMD) onset from retinal OCT scans. We propose a novel DL method for survival prediction to jointly predict from the current scan a risk score, inversely related to time-to-conversion, and the probability of conversion within a time interval $t$. It uses a family of parallel hyperplanes generated by parameterizing the bias term as a function of $t$. In addition, we develop unsupervised losses based on intra-subject image pairs to ensure that risk scores increase over time and that future conversion predictions are consistent with AMD stage prediction using actual scans of future visits. Such losses enable data-efficient fine-tuning of the trained model on new unlabeled datasets acquired with a different scanner. Extensive evaluation on two large datasets acquired with different scanners resulted in a mean AUROCs of 0.82 for Dataset-1 and 0.83 for Dataset-2, across prediction intervals of 6,12 and 24 months.

Computer Vision and Pattern Recognition,Artificial Intelligence,Machine Learning
Recurrent and Concurrent Prediction of Longitudinal Progression of Stargardt Atrophy and Geographic Atrophy

Zubin Mishra,Ziyuan Wang,Emily Xu,Sophia Xu,Iyad Majid,SriniVas R. Sadda,Zhihong Jewel Hu

DOI: https://doi.org/10.1101/2024.02.11.24302670

2024-02-13

Abstract:Stargardt disease and age-related macular degeneration are the leading causes of blindness in the juvenile and geriatric populations, respectively. The formation of atrophic regions of the macula is a hallmark of the end-stages of both diseases. The progression of these diseases is tracked using various imaging modalities, two of the most common being fundus autofluorescence (FAF) imaging and spectral-domain optical coherence tomography (SD-OCT). This study seeks to investigate the use of longitudinal FAF and SD-OCT imaging (month 0, month 6, month 12, and month 18) data for the predictive modelling of future atrophy in Stargardt and geographic atrophy. To achieve such an objective, we develop a set of novel deep convolutional neural networks enhanced with recurrent network units for longitudinal prediction and concurrent learning of ensemble network units (termed ReConNet) which take advantage of improved retinal layer features beyond the mean intensity features. Using FAF images, the neural network presented in this paper achieved mean (± standard deviation, SD) and median Dice coefficients of 0.895 (± 0.086) and 0.922 for Stargardt atrophy, and 0.864 (± 0.113) and 0.893 for geographic atrophy. Using SD-OCT images for Stargardt atrophy, the neural network achieved mean and median Dice coefficients of 0.882 (± 0.101) and 0.906, respectively. When predicting only the interval growth of the atrophic lesions with FAF images, mean (± SD) and median Dice coefficients of 0.557 (± 0.094) and 0.559 were achieved for Stargardt atrophy, and 0.612 (± 0.089) and 0.601 for geographic atrophy. The prediction performance in OCT images is comparably good to that using FAF which opens a new, more efficient, and practical door in the assessment of atrophy progression for clinical trials and retina clinics, beyond widely used FAF. These results are highly encouraging for a high-performance interval growth prediction when more frequent or longer-term longitudinal data are available in our clinics. This is a pressing task for our next step in ongoing research.

Ophthalmology
Predicting Progression of Age-related Macular Degeneration from Fundus Images using Deep Learning

Boris Babenko,Siva Balasubramanian,Katy E. Blumer,Greg S. Corrado,Lily Peng,Dale R. Webster,Naama Hammel,Avinash V. Varadarajan

DOI: https://doi.org/10.48550/arXiv.1904.05478

2019-04-11

Abstract:Background: Patients with neovascular age-related macular degeneration (AMD) can avoid vision loss via certain therapy. However, methods to predict the progression to neovascular age-related macular degeneration (nvAMD) are lacking. Purpose: To develop and validate a deep learning (DL) algorithm to predict 1-year progression of eyes with no, early, or intermediate AMD to nvAMD, using color fundus photographs (CFP). Design: Development and validation of a DL algorithm. Methods: We trained a DL algorithm to predict 1-year progression to nvAMD, and used 10-fold cross-validation to evaluate this approach on two groups of eyes in the Age-Related Eye Disease Study (AREDS): none/early/intermediate AMD, and intermediate AMD (iAMD) only. We compared the DL algorithm to the manually graded 4-category and 9-step scales in the AREDS dataset. Main outcome measures: Performance of the DL algorithm was evaluated using the sensitivity at 80% specificity for progression to nvAMD. Results: The DL algorithm's sensitivity for predicting progression to nvAMD from none/early/iAMD (78+/-6%) was higher than manual grades from the 9-step scale (67+/-8%) or the 4-category scale (48+/-3%). For predicting progression specifically from iAMD, the DL algorithm's sensitivity (57+/-6%) was also higher compared to the 9-step grades (36+/-8%) and the 4-category grades (20+/-0%). Conclusions: Our DL algorithm performed better in predicting progression to nvAMD than manual grades. Future investigations are required to test the application of this DL algorithm in a real-world clinical setting.

Computer Vision and Pattern Recognition
Development and Validation of a Novel Prognostic Model for Predicting AMD Progression Using Longitudinal Fundus Images

Joshua Bridge,Simon P. Harding,Yalin Zheng

DOI: https://doi.org/10.48550/arXiv.2007.05120

2020-07-10

Abstract:Prognostic models aim to predict the future course of a disease or condition and are a vital component of personalized medicine. Statistical models make use of longitudinal data to capture the temporal aspect of disease progression; however, these models require prior feature extraction. Deep learning avoids explicit feature extraction, meaning we can develop models for images where features are either unknown or impossible to quantify accurately. Previous prognostic models using deep learning with imaging data require annotation during training or only utilize a single time point. We propose a novel deep learning method to predict the progression of diseases using longitudinal imaging data with uneven time intervals, which requires no prior feature extraction. Given previous images from a patient, our method aims to predict whether the patient will progress onto the next stage of the disease. The proposed method uses InceptionV3 to produce feature vectors for each image. In order to account for uneven intervals, a novel interval scaling is proposed. Finally, a Recurrent Neural Network is used to prognosticate the disease. We demonstrate our method on a longitudinal dataset of color fundus images from 4903 eyes with age-related macular degeneration (AMD), taken from the Age-Related Eye Disease Study, to predict progression to late AMD. Our method attains a testing sensitivity of 0.878, a specificity of 0.887, and an area under the receiver operating characteristic of 0.950. We compare our method to previous methods, displaying superior performance in our model. Class activation maps display how the network reaches the final decision.

Machine Learning,Image and Video Processing
Prediction of neovascular age-related macular degeneration recurrence using optical coherence tomography images with a deep neural network

Juho Jung,Jinyoung Han,Jeong Mo Han,Junseo Ko,Jeewoo Yoon,Joon Seo Hwang,Ji In Park,Gyudeok Hwang,Jae Ho Jung,Daniel Duck-Jin Hwang

DOI: https://doi.org/10.1038/s41598-024-56309-6

IF: 4.6

2024-03-13

Scientific Reports

Abstract:Neovascular age-related macular degeneration (nAMD) can result in blindness if left untreated, and patients often require repeated anti-vascular endothelial growth factor injections. Although, the treat-and-extend method is becoming popular to reduce vision loss attributed to recurrence, it may pose a risk of overtreatment. This study aimed to develop a deep learning model based on DenseNet201 to predict nAMD recurrence within 3 months after confirming dry-up 1 month following three loading injections in treatment-naïve patients. A dataset of 1076 spectral domain optical coherence tomography (OCT) images from 269 patients diagnosed with nAMD was used. The performance of the model was compared with that of 6 ophthalmologists, using 100 randomly selected samples. The DenseNet201-based model achieved 53.0% accuracy in predicting nAMD recurrence using a single pre-injection image and 60.2% accuracy after viewing all the images immediately after the 1st, 2nd, and 3rd injections. The model outperformed experienced ophthalmologists, with an average accuracy of 52.17% using a single pre-injection image and 53.3% after examining four images before and after three loading injections. In conclusion, the artificial intelligence model demonstrated a promising ability to predict nAMD recurrence using OCT images and outperformed experienced ophthalmologists. These findings suggest that deep learning models can assist in nAMD recurrence prediction, thus improving patient outcomes and optimizing treatment strategies.

multidisciplinary sciences
Automatic quantification of retinal photoreceptor integrity to predict persistent disease activity in neovascular age-related macular degeneration using deep learning

Xian Song,Qian Xu,Haiming Li,Qian Fan,Yefeng Zheng,Qiang Zhang,Chunyan Chu,Zhicheng Zhang,Chenglang Yuan,Munan Ning,Cheng Bian,Kai Ma,Yi Qu

DOI: https://doi.org/10.3389/fnins.2022.952735

IF: 4.3

2022-08-19

Frontiers in Neuroscience

Abstract:Purpose: Using deep learning (DL)-based technique, we identify risk factors and create a prediction model for refractory neovascular age-related macular degeneration (nAMD) characterized by persistent disease activity (PDA) in spectral domain optical coherence tomography (SD-OCT) images. Materials and methods: A total of 671 typical B-scans were collected from 186 eyes of 186 patients with nAMD. Spectral domain optical coherence tomography images were analyzed using a classification convolutional neural network (CNN) and a fully convolutional network (FCN) algorithm to extract six features involved in nAMD, including ellipsoid zone (EZ), external limiting membrane (ELM), intraretinal fluid (IRF), subretinal fluid (SRF), pigment epithelium detachment (PED), and subretinal hyperreflective material (SHRM). Random forest models were probed to predict 1-year disease activity (stable, PDA, and cured) based on the quantitative features computed from automated segmentation and evaluated with cross-validation. Results: The algorithm to segment six SD-OCT features achieved the mean accuracy of 0.930 (95% CI: 0.916–0.943), dice coefficients of 0.873 (95% CI: 0.847–0.899), a sensitivity of 0.873 (95% CI: 0.844–0.910), and a specificity of 0.922 (95% CI: 0.905–0.940). The six-metric model including EZ and ELM achieved the optimal performance to predict 1-year disease activity, with an area under the receiver operating characteristic (ROC) curve (AUC) of 0.980, the accuracy of 0.930, the sensitivity of 0.920, and the specificity of 0.962. The integrity of EZ and ELM significantly improved the performance of the six-metric model than that of the four-metric model. Conclusion: The prediction model reveals the potential to predict PDA in nAMD eyes. The integrity of EZ and ELM constituted the strongest predictive factor for PDA in nAMD eyes in real-world clinical practice. The results of this study are a significant step toward image-guided prediction of long-term disease activity in the management of nAMD and highlight the importance of the automatic identification of photoreceptor layers.

neurosciences
Prediction and Detection of Glaucomatous Visual Field Progression Using Deep Learning on Macular OCT

Jonathan Huang,Galal Galal,Vladislav Mukhin,Mozziyar Etemadi,Angelo P. Tanna

DOI: https://doi.org/10.1097/ijg.0000000000002359

2024-01-12

Journal of Glaucoma

Abstract:Objective: To use macular OCT imaging to predict future and detect concurrent visual field progression, respectively, using deep learning. Design: Retrospective cohort study. Subjects: A pre-training dataset was comprised of 7,702,201 B-scan images from 151,389 macular OCT studies. The progression detection task included 3,902 macular OCT imaging studies from 1,534 eyes of 828 glaucoma patients and the progression prediction task included 1,346 macular OCT studies from 1,205 eyes of 784. Methods: A novel deep learning method was developed to detect glaucoma progression and predict future progression using macular OCT, based on self-supervised pre-training of a vision transformer (ViT) model on a large, unlabeled dataset of OCT images. Glaucoma progression was defined as mean deviation (MD) rate of change of ≤ -0.5 dB/year over 5 consecutive Humphrey visual field tests, and rapid progression was defined as MD change ≤ -1 dB/year. Main Outcome Measures: Diagnostic performance of the ViT model for prediction of future visual field progression and detection of concurrent visual field progression using area under the receiver operating characteristic curve (AUC), sensitivity, and specificity. Results: The model distinguished stable eyes from progressing eyes, achieving an AUC of 0.90 (95% CI, 0.88-0.91). Rapid progression was detected with an AUC of 0.92 (95% CI, 0.91-0.93). The model also demonstrated high predictive ability for forecasting future glaucoma progression, with an AUC of 0.85 (95% CI 0.83, 0.87). Rapid progression was predicted with an AUC of 0.84 (95% CI 0.81, 0.86). Conclusions: A deep learning model detected clinically significant functional glaucoma progression using macular OCT imaging studies and was also able to predict future progression. Early identification of patients undergoing glaucoma progression or at high risk for future progression may aid in clinical decision-making.

ophthalmology
Prediction of Post-Treatment Visual Acuity in Age-Related Macular Degeneration Patients With an Interpretable Machine Learning Method

Najung Kim,Minsub Lee,Hyewon Chung,Hyung Chan Kim,Hyungwoo Lee

DOI: https://doi.org/10.1167/tvst.13.9.3

2024-09-03

Abstract:Purpose: We evaluated the features predicting visual acuity (VA) after one year in neovascular age-related macular degeneration (nAMD) patients. Methods: A total of 527 eyes of 506 patients were included. Machine learning (ML) models were trained to predict VA deterioration beyond a logarithm of the minimum angle of resolution of 1.0 after 1 year based on the sequential addition of multimodal data. BaseM models used clinical data (age, sex, treatment regimen, and VA), SegM models included fluid volumes from optical coherence tomography (OCT) images, and RawM models used probabilities of visual deterioration (hereafter probability) from deep learning classifiers trained on baseline OCT (OCT0) and OCT after three loading doses (OCT3), fluorescein angiography, and indocyanine green angiography. We applied SHapley Additive exPlanations (SHAP) for machine learning model interpretation. Results: The RawM model based on the probability of OCT0 outperformed the SegM model (area under the receiver operating characteristic curve of 0.95 vs. 0.91). Adding probabilities from OCT3, fluorescein angiography, and indocyanine green angiography to RawM showed minimal performance improvement, highlighting the practicality of using raw OCT0 data for predicting visual outcomes. Applied SHapley Additive exPlanations analysis identified VA after 3 months and OCT3 probability values as the most influential features over quantified fluid segments. Conclusions: Integrating multimodal data to create a visual predictive model yielded accurate, interpretable predictions. This approach allowed the identification of crucial factors for predicting VA in patients with nAMD. Translational relevance: Interpreting a predictive model for 1-year VA in patients with nAMD from multimodal data allowed us to identify crucial factors for predicting VA.
LONGL-Net: temporal correlation structure guided deep learning model to predict longitudinal age-related macular degeneration severity

Alireza Ganjdanesh,Jipeng Zhang,Emily Y Chew,Ying Ding,Heng Huang,Wei Chen

DOI: https://doi.org/10.1093/pnasnexus/pgab003

2022-03-01

PNAS Nexus

Abstract:Abstract Age-related macular degeneration (AMD) is the principal cause of blindness in developed countries, and its prevalence will increase to 288 million people in 2040. Therefore, automated grading and prediction methods can be highly beneficial for recognizing susceptible subjects to late-AMD and enabling clinicians to start preventive actions for them. Clinically, AMD severity is quantified by Color Fundus Photographs (CFP) of the retina, and many machine-learning-based methods are proposed for grading AMD severity. However, few models were developed to predict the longitudinal progression status, i.e. predicting future late-AMD risk based on the current CFP, which is more clinically interesting. In this paper, we propose a new deep-learning-based classification model (LONGL-Net) that can simultaneously grade the current CFP and predict the longitudinal outcome, i.e. whether the subject will be in late-AMD in the future time-point. We design a new temporal-correlation-structure-guided Generative Adversarial Network model that learns the interrelations of temporal changes in CFPs in consecutive time-points and provides interpretability for the classifier's decisions by forecasting AMD symptoms in the future CFPs. We used about 30,000 CFP images from 4,628 participants in the Age-Related Eye Disease Study. Our classifier showed average 0.905 (95% CI: 0.886–0.922) AUC and 0.762 (95% CI: 0.733–0.792) accuracy on the 3-class classification problem of simultaneously grading current time-point's AMD condition and predicting late AMD progression of subjects in the future time-point. We further validated our model on the UK Biobank dataset, where our model showed average 0.905 accuracy and 0.797 sensitivity in grading 300 CFP images.
Simultaneous column-based deep learning progression analysis of atrophy associated with AMD in longitudinal OCT studies

Adi Szeskin,Roei Yehuda,Or Shmueli,Jaime Levy,Leo Joskowicz

2023-07-31

Abstract:Purpose: Disease progression of retinal atrophy associated with AMD requires the accurate quantification of the retinal atrophy changes on longitudinal OCT studies. It is based on finding, comparing, and delineating subtle atrophy changes on consecutive pairs (prior and current) of unregistered OCT scans. Methods: We present a fully automatic end-to-end pipeline for the simultaneous detection and quantification of time-related atrophy changes associated with dry AMD in pairs of OCT scans of a patient. It uses a novel simultaneous multi-channel column-based deep learning model trained on registered pairs of OCT scans that concurrently detects and segments retinal atrophy segments in consecutive OCT scans by classifying light scattering patterns in matched pairs of vertical pixel-wide columns (A-scans) in registered prior and current OCT slices (B-scans). Results: Experimental results on 4,040 OCT slices with 5.2M columns from 40 scans pairs of 18 patients (66% training/validation, 33% testing) with 24.13+-14.0 months apart in which Complete RPE and Outer Retinal Atrophy (cRORA) was identified in 1,998 OCT slices (735 atrophy lesions from 3,732 segments, 0.45M columns) yield a mean atrophy segments detection precision, recall of 0.90+-0.09, 0.95+-0.06 and 0.74+-0.18, 0.94+-0.12 for atrophy lesions with AUC=0.897, all above observer variability. Simultaneous classification outperforms standalone classification precision and recall by 30+-62% and 27+-0% for atrophy segments and lesions. Conclusions: simultaneous column-based detection and quantification of retinal atrophy changes associated with AMD is accurate and outperforms standalone classification methods. Translational relevance: an automatic and efficient way to detect and quantify retinal atrophy changes associated with AMD.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
Hybrid deep learning models for the screening of Diabetic Macular Edema in optical coherence tomography volumes

Antonio Rodríguez-Miguel,Carolina Arruabarrena,Germán Allendes,Maximiliano Olivera,Javier Zarranz-Ventura,Miguel A Teus

DOI: https://doi.org/10.1038/s41598-024-68489-2

2024-07-31

Abstract:Several studies published so far used highly selective image datasets from unclear sources to train computer vision models and that may lead to overestimated results, while those studies conducted in real-life remain scarce. To avoid image selection bias, we stacked convolutional and recurrent neural networks (CNN-RNN) to analyze complete optical coherence tomography (OCT) cubes in a row and predict diabetic macular edema (DME), in a real-world diabetic retinopathy screening program. A retrospective cohort study was carried out. Throughout 4-years, 5314 OCT cubes from 4408 subjects who attended to the diabetic retinopathy (DR) screening program were included. We arranged twenty-two (22) pre-trained CNNs in parallel with a bidirectional RNN layer stacked at the bottom, allowing the model to make a prediction for the whole OCT cube. The staff of retina experts built a ground truth of DME later used to train a set of these CNN-RNN models with different configurations. For each trained CNN-RNN model, we performed threshold tuning to find the optimal cut-off point for binary classification of DME. Finally, the best models were selected according to sensitivity, specificity, and area under the receiver operating characteristics curve (AUROC) with their 95% confidence intervals (95%CI). An ensemble of the best models was also explored. 5188 cubes were non-DME and 126 were DME. Three models achieved an AUROC of 0.94. Among these, sensitivity, and specificity (95%CI) ranged from 84.1-90.5 and 89.7-93.3, respectively, at threshold 1, from 89.7-92.1 and 80-83.1 at threshold 2, and from 80.2-81 and 93.8-97, at threshold 3. The ensemble model improved these results, and lower specificity was observed among subjects with sight-threatening DR. Analysis by age, gender, or grade of DME did not vary the performance of the models. CNN-RNN models showed high diagnostic accuracy for detecting DME in a real-world setting. This engine allowed us to detect extra-foveal DMEs commonly overlooked in other studies, and showed potential for application as the first filter of non-referable patients in an outpatient center within a population-based DR screening program, otherwise ended up in specialized care.
Validation of a deep learning model for automatic detection and quantification of five OCT critical retinal features associated with neovascular age-related macular degeneration

Federico Ricardi,Jonathan Oakley,Daniel Russakoff,Giacomo Boscia,Paolo Caselgrandi,Francesco Gelormini,Andrea Ghilardi,Giulia Pintore,Tommaso Tibaldi,Paola Marolo,Francesco Bandello,Michele Reibaldi,Enrico Borrelli

DOI: https://doi.org/10.1136/bjo-2023-324647

2024-03-14

British Journal of Ophthalmology

Abstract:Purpose To develop and validate a deep learning model for the segmentation of five retinal biomarkers associated with neovascular age-related macular degeneration (nAMD). Methods 300 optical coherence tomography volumes from subject eyes with nAMD were collected. Images were manually segmented for the presence of five crucial nAMD features: intraretinal fluid, subretinal fluid, subretinal hyperreflective material, drusen/drusenoid pigment epithelium detachment (PED) and neovascular PED. A deep learning architecture based on a U-Net was trained to perform automatic segmentation of these retinal biomarkers and evaluated on the sequestered data. The main outcome measures were receiver operating characteristic curves for detection, summarised using the area under the curves (AUCs) both on a per slice and per volume basis, correlation score, enface topography overlap (reported as two-dimensional (2D) correlation score) and Dice coefficients. Results The model obtained a mean (±SD) AUC of 0.93 (±0.04) per slice and 0.88 (±0.07) per volume for fluid detection. The correlation score (R 2 ) between automatic and manual segmentation obtained by the model resulted in a mean (±SD) of 0.89 (±0.05). The mean (±SD) 2D correlation score was 0.69 (±0.04). The mean (±SD) Dice score resulted in 0.61 (±0.10). Conclusions We present a fully automated segmentation model for five features related to nAMD that performs at the level of experienced graders. The application of this model will open opportunities for the study of morphological changes and treatment efficacy in real-world settings. Furthermore, it can facilitate structured reporting in the clinic and reduce subjectivity in clinicians’ assessments.

ophthalmology
Cross-instrument optical coherence tomography-angiography (OCTA)-based prediction of age-related macular degeneration (AMD) disease activity using artificial intelligence

Anna Heinke,Haochen Zhang,Krzysztof Broniarek,Katarzyna Michalska-Małecka,Wyatt Elsner,Carlo Miguel B. Galang,Daniel N. Deussen,Alexandra Warter,Fritz Kalaw,Ines Nagel,Akshay Agnihotri,Nehal N. Mehta,Julian Elias Klaas,Valerie Schmelter,Igor Kozak,Sally L. Baxter,Dirk-Uwe Bartsch,Lingyun Cheng,Cheolhong An,Truong Nguyen,William R. Freeman

DOI: https://doi.org/10.1038/s41598-024-78327-0

IF: 4.6

2024-11-09

Scientific Reports

Abstract:This study investigates the efficacy of predicting age-related macular degeneration (AMD) activity through deep neural networks (DNN) using a cross-instrument training dataset composed of Optical coherence tomography-angiography (OCTA) images from two different manufacturers. A retrospective cross-sectional study analyzed 2D vascular en-face OCTA images from Heidelberg Spectralis (1478 samples: 1102 training, 276 validation, 100 testing) and Optovue Solix (1003 samples: 754 training, 189 validation, 60 testing). OCTA scans were labeled based on clinical diagnoses and adjacent B-scan OCT fluid information, categorizing activity into normal, dry AMD, active wet AMD, and wet AMD in remission. Experiments explored cross-instrument disease classification using separate and combined datasets for training the DNN. Testing involved 100 Heidelberg and 60 Optovue samples. Training on Heidelberg data alone yielded 73% accuracy on Heidelberg images and 60% on Optovue images. Training on Optovue data alone resulted in 34% accuracy on Heidelberg and 85% on Optovue images. Combined training data from both instruments achieved 78% accuracy on Heidelberg and 76% on Optovue test sets. Results indicate that cross-instrument classifier training demonstrates high classification prediction accuracy, making cross-instrument training viable for future clinical applications. This implies that vascular morphology in OCTA can predict disease progression.

multidisciplinary sciences
Preliminary analysis of predicting the first recurrence in patients with neovascular age-related macular degeneration using deep learning

Boa Jang,Sang-Yoon Lee,Chaea Kim,Un Chul Park,Young-Gon Kim,Eun Kyoung Lee

DOI: https://doi.org/10.1186/s12886-023-03229-0

2023-12-07

Abstract:Background: To predict, using deep learning, the first recurrence in patients with neovascular age-related macular degeneration (nAMD) after three monthly loading injections of intravitreal anti-vascular endothelial growth factor (anti-VEGF). Methods: Optical coherence tomography (OCT) images were obtained at baseline and after the loading phase. The first recurrence was defined as the initial appearance of a new retinal hemorrhage or intra/subretinal fluid accumulation after the initial resolution of exudative changes after three loading injections. Standard U-Net architecture was used to identify the three retinal fluid compartments, which include pigment epithelial detachment, subretinal fluid, and intraretinal fluid. To predict the first recurrence of nAMD, classification learning was conducted to determine whether the first recurrence occurred within three months after the loading phase. The recurrence classification architecture was built using ResNet50. The model with retinal regions of interest of the entire region and fluid region on OCT at baseline and after the loading phase is presented. Results: A total of 1,444 eyes of 1,302 patients were included. The mean duration until the first recurrence after the loading phase was 8.20 ± 15.56 months. The recurrence classification system revealed that the model with the fluid region of OCT after the loading phase provided the highest classification performance, with an area under the receiver operating characteristic curve (AUC) of 0.725 ± 0.012. Heatmap analysis revealed that three pathological fluids, subsided choroidal neovascularization lesions, and hyperreflective foci were important areas for the first recurrence. Conclusions: The deep learning algorithm allowed for the prediction of the first recurrence for three months after the loading phase with adequate feasibility. An automated prediction system may assist in establishing patient-specific treatment plans and the provision of individualized medical care for patients with nAMD.
Prediction of Visual Field Progression with Baseline and Longitudinal Structural Measurements using Deep Learning

Vahid Mohammadzadeh,Sean Wu,Sajad Besharati,Tyler Davis,Arvind Vepa,Esteban Morales,Kiumars Edalati,Mahshad Rafiee,Arthur Martinyan,David Zhang,Fabien Scalzo,Joseph Caprioli,Kouros Nouri-Mahdavi

DOI: https://doi.org/10.1016/j.ajo.2024.02.007

IF: 5.488

2024-02-15

American Journal of Ophthalmology

Abstract:Purpose Identifying glaucoma patients at high risk of progression based on widely available structural data is an unmet task in clinical practice. We test the hypothesis that baseline or serial structural measures can predict visual field (VF) progression with deep learning (DL). Methods Setting Tertiary academic center. Design Development of a DL algorithm to predict VF progression. Study Population 3,079 eyes (1,765 patients) with various types of glaucoma and ≥5 VFs, and ≥3 years of follow-up. Observation Procedures Serial VF mean deviation (MD) rates of change were estimated with linear-regression. VF progression was defined as negative MD slope with p<0.05. A Siamese Neural Network with ResNet-152 backbone pre-trained on ImageNet was designed to predict VF progression using serial optic-disc photographs (ODP), and baseline retinal nerve fiber layer (RNFL) thickness. We tested the model on a separate dataset (427 eyes) with RNFL data from different OCT. Main Outcome Measure Area under ROC curve (AUC). Results Baseline average (SD) MD was –3.4 (4.9)dB. VF progression was detected in 900 eyes (29%). AUC (95% CI) for model incorporating baseline ODP and RNFL thickness was 0.813 (0.757-0.869). After adding the second and third ODPs, AUC increased to 0.860 and 0.894, respectively (p<0.027). This model also had highest AUC (0.911) for predicting fast progression (MD rate <–1.0 dB/year). Model's performance was similar when applied to second dataset using RNFL data from another OCT device (AUC=0.893; 0.837-0.948). Conclusions DL model predicted VF progression with clinically relevant accuracy using baseline RNFL thickness and serial ODPs and can be implemented as a clinical tool after further validation.

ophthalmology
Deep learning algorithm predicts diabetic retinopathy progression in individual patients

Filippo Arcadu,Fethallah Benmansour,Andreas Maunz,Jeff Willis,Zdenka Haskova,Marco Prunotto

DOI: https://doi.org/10.1038/s41746-019-0172-3

IF: 15.2

2019-09-20

npj Digital Medicine

Abstract:Abstract The global burden of diabetic retinopathy (DR) continues to worsen and DR remains a leading cause of vision loss worldwide. Here, we describe an algorithm to predict DR progression by means of deep learning (DL), using as input color fundus photographs (CFPs) acquired at a single visit from a patient with DR. The proposed DL models were designed to predict future DR progression, defined as 2-step worsening on the Early Treatment Diabetic Retinopathy Diabetic Retinopathy Severity Scale, and were trained against DR severity scores assessed after 6, 12, and 24 months from the baseline visit by masked, well-trained, human reading center graders. The performance of one of these models (prediction at month 12) resulted in an area under the curve equal to 0.79. Interestingly, our results highlight the importance of the predictive signal located in the peripheral retinal fields, not routinely collected for DR assessments, and the importance of microvascular abnormalities. Our findings show the feasibility of predicting future DR progression by leveraging CFPs of a patient acquired at a single visit. Upon further development on larger and more diverse datasets, such an algorithm could enable early diagnosis and referral to a retina specialist for more frequent monitoring and even consideration of early intervention. Moreover, it could also improve patient recruitment for clinical trials targeting DR.

health care sciences & services,medical informatics
Information Bottleneck with Local Consistency

Zhengzheng Lou,Yangdong Ye,Zhenfeng Zhu

DOI: https://doi.org/10.1007/978-3-642-32695-0_27

2012-09-03

Abstract:

Food hypersensitivity among asthmatic children – single center experience

A Deep-learning Approach for Prognosis of Age-Related Macular Degeneration Disease using SD-OCT Imaging Biomarkers

Predicting risk of late age-related macular degeneration using deep learning

Deep learning for automatic prediction of early activation of treatment naïve non-exudative MNVs in AMD

Forecasting Disease Progression with Parallel Hyperplanes in Longitudinal Retinal OCT

Recurrent and Concurrent Prediction of Longitudinal Progression of Stargardt Atrophy and Geographic Atrophy

Predicting Progression of Age-related Macular Degeneration from Fundus Images using Deep Learning

Development and Validation of a Novel Prognostic Model for Predicting AMD Progression Using Longitudinal Fundus Images

Prediction of neovascular age-related macular degeneration recurrence using optical coherence tomography images with a deep neural network

Automatic quantification of retinal photoreceptor integrity to predict persistent disease activity in neovascular age-related macular degeneration using deep learning

Prediction and Detection of Glaucomatous Visual Field Progression Using Deep Learning on Macular OCT

Prediction of Post-Treatment Visual Acuity in Age-Related Macular Degeneration Patients With an Interpretable Machine Learning Method

LONGL-Net: temporal correlation structure guided deep learning model to predict longitudinal age-related macular degeneration severity

Simultaneous column-based deep learning progression analysis of atrophy associated with AMD in longitudinal OCT studies

Hybrid deep learning models for the screening of Diabetic Macular Edema in optical coherence tomography volumes

Validation of a deep learning model for automatic detection and quantification of five OCT critical retinal features associated with neovascular age-related macular degeneration

Cross-instrument optical coherence tomography-angiography (OCTA)-based prediction of age-related macular degeneration (AMD) disease activity using artificial intelligence

Preliminary analysis of predicting the first recurrence in patients with neovascular age-related macular degeneration using deep learning

Prediction of Visual Field Progression with Baseline and Longitudinal Structural Measurements using Deep Learning

Deep learning algorithm predicts diabetic retinopathy progression in individual patients

Information Bottleneck with Local Consistency