Abstract:PurposeWith the aging population and the global diabetes epidemic, the prevalence of age-related macular degeneration (AMD) and diabetic macular edema (DME) diseases which are the leading causes of blindness is further increasing. Intravitreal injections with anti-vascular endothelial growth factor (anti-VEGF) medications are the standard of care for their indications. Optical coherence tomography (OCT), as a noninvasive imaging modality, plays a major part in guiding the administration of anti-VEGF therapy by providing detailed cross-sectional scans of the retina pathology. Fully automating OCT image detection can significantly decrease the tedious clinician labor and obtain a faithful pre-diagnosis from the analysis of the structural elements of the retina. Thereby, we explore the use of deep transfer learning method based on the visual geometry group 16 (VGG-16) network for classifying AMD and DME in OCT images accurately and automatically.MethodA total of 207,130 retinal OCT images between 2013 and 2017 were selected from retrospective cohorts of 5319 adult patients from the Shiley Eye Institute of the University of California San Diego, the California Retinal Research Foundation, Medical Center Ophthalmology Associates, the Shanghai First People's Hospital, and the Beijing Tongren Eye Center, with 109,312 images (37,456 with choroidal neovascularization, 11,599 with diabetic macular edema, 8867 with drusen, and 51,390 normal) for the experiment. After images preprocessing, 1000 images (250 images from each category) from 633 patients were selected as validation dataset while the rest images from another 4686 patients were used as training dataset. We used deep transfer learning method to fine-tune the VGG-16 network pre-trained on the ImageNet dataset, and evaluated its performance on the validation dataset. Then, prediction accuracy, sensitivity, specificity, and receiver-operating characteristic (ROC) were calculated.ResultsExperimental results proved that the proposed approach had manifested superior performance in retinal OCT images detection, which achieved a prediction accuracy of 98.6%, with a sensitivity of 97.8%, a specificity of 99.4%, and introduced an area under the ROC curve of 100%.ConclusionDeep transfer learning method based on the VGG-16 network shows significant effectiveness on classification of retinal OCT images with a relatively small dataset, which can provide assistant support for medical decision-making. Moreover, the performance of the proposed approach is comparable to that of human experts with significant clinical experience. Thereby, it will find promising applications in an automatic diagnosis and classification of common retinal diseases.

Deep Learning Assisted Fluid Volume Calculation for Assessing Anti-Vascular Endothelial Growth Factor Effect in Diabetic Macular Edema

Retinal Microstructure Based on Optical Coherence Tomography Predicts Visual Prognosis in Diabetic Macular Edema with Extended Intraretinal Cysts and Subretinal Fluid.

Utilization of deep learning to quantify fluid volume of neovascular age-related macular degeneration patients based on swept-source OCT imaging: The ONTARIO study

Prediction of Response to Anti‐vascular Endothelial Growth Factor Treatment in Diabetic Macular Oedema Using an Optical Coherence Tomography‐based Machine Learning Method

Three-dimensional Diabetic Macular Edema Thickness Maps Based on Fluid Segmentation and Fovea Detection Using Deep Learning.

Machine Learning and Optical Coherence Tomography-Derived Radiomics Analysis to Predict Persistent Diabetic Macular Edema in Patients Undergoing Anti-Vegf Intravitreal Therapy

Deep learning algorithms for detection of diabetic macular edema in OCT images: A systematic review and meta-analysis

Performance of retinal fluid monitoring in OCT imaging by automated deep learning versus human expert grading in neovascular AMD

Automated Quantitative Assessment of Retinal Fluid Volumes as Important Biomarkers in Neovascular Age-Related Macular Degeneration

Hyperreflective Foci and Subretinal Fluid Are Potential Imaging Biomarkers to Evaluate Anti-VEGF Effect in Diabetic Macular Edema

Automated segmentation of retinal fluid volumes from structural and angiographic optical coherence tomography using deep learning

Automatic detection of non-perfusion areas in diabetic macular edema from fundus fluorescein angiography for decision making using deep learning

Deep learning-based detection of diabetic macular edema using optical coherence tomography and fundus images: A meta-analysis

Fully Automated Detection of Retinal Disorders by Image-Based Deep Learning

Hybrid deep learning models for the screening of Diabetic Macular Edema in optical coherence tomography volumes

Automatic prediction of treatment outcomes in patients with diabetic macular edema using ensemble machine learning

Quantification of Diabetic Retinopathy Lesions in DME Patients with Intravitreal Conbercept Treatment Using Deep Learning.

DETECTION OF MORPHOLOGIC PATTERNS OF DIABETIC MACULAR EDEMA USING A DEEP LEARNING APPROACH BASED ON OPTICAL COHERENCE TOMOGRAPHY IMAGES.

Prediction of Visual Acuity after anti-VEGF Therapy in Diabetic Macular Edema by Machine Learning

Approved AI-based fluid monitoring to identify morphological and functional treatment outcomes in neovascular age-related macular degeneration in real-world routine

Predicting optical coherence tomography-derived diabetic macular edema grades from fundus photographs using deep learning