Abstract:BACKGROUND AND OBJECTIVE: Age-related macular degeneration (AMD) is the most common cause of blindness in developed countries, especially in people over 60 years of age. The workload of specialists and the healthcare system in this field has increased in recent years mainly due to three reasons: 1) increased use of retinal optical coherence tomography (OCT) imaging technique, 2) prevalence of population aging worldwide, and 3) chronic nature of AMD. Recent advancements in the field of deep learning have provided a unique opportunity for the development of fully automated diagnosis frameworks. Considering the presence of AMD-related retinal pathologies in varying sizes in OCT images, our objective was to propose a multi-scale convolutional neural network (CNN) that can capture inter-scale variations and improve performance using a feature fusion strategy across convolutional blocks.METHODS: Our proposed method introduces a multi-scale CNN based on the feature pyramid network (FPN) structure. This method is used for the reliable diagnosis of normal and two common clinical characteristics of dry and wet AMD, namely drusen and choroidal neovascularization (CNV). The proposed method is evaluated on the national dataset gathered at Hospital (NEH) for this study, consisting of 12649 retinal OCT images from 441 patients, and the UCSD public dataset, consisting of 108312 OCT images from 4686 patients.RESULTS: Experimental results show the superior performance of our proposed multi-scale structure over several well-known OCT classification frameworks. This feature combination strategy has proved to be effective on all tested backbone models, with improvements ranging from 0.4% to 3.3%. In addition, gradual learning has proved to be effective in improving performance in two consecutive stages. In the first stage, the performance was boosted from 87.2%±2.5% to 92.0%±1.6% using pre-trained ImageNet weights. In the second stage, another performance boost from 92.0%±1.6% to 93.4%±1.4% was observed as a result of fine-tuning the previous model on the UCSD dataset. Lastly, generating heatmaps provided additional proof for the effectiveness of our multi-scale structure, enabling the detection of retinal pathologies appearing in different sizes.CONCLUSION: The promising quantitative results of the proposed architecture, along with qualitative evaluations through generating heatmaps, prove the suitability of the proposed method to be used as a screening tool in healthcare centers assisting ophthalmologists in making better diagnostic decisions.

Automatic Classification of Retinal Three-Dimensional Optical Coherence Tomography Images Using Principal Component Analysis Network with Composite Kernels

Simultaneous Alignment and Surface Regression Using Hybrid 2D-3D Networks for 3D Coherent Layer Segmentation of Retinal OCT Images with Full and Annotations

Automatic Diagnosis of Macular Diseases from OCT Volume Based on Its Two-Dimensional Feature Map and Convolutional Neural Network with Attention Mechanism.

Automatic Classification of Retinal Optical Coherence Tomography Images with Layer Guided Convolutional Neural Network

Automatic Detection of Retinal Regions Using Fully Convolutional Networks for Diagnosis of Abnormal Maculae in Optical Coherence Tomography Images

Deep Learning-Based Automated Detection of Retinal Diseases Using Optical Coherence Tomography Images.

A Classification Network for Ocular Diseases Based on Structure Feature and Visual Attention

Surrogate-Assisted Retinal OCT Image Classification Based on Convolutional Neural Networks

OCTNet: A Modified Multi-Scale Attention Feature Fusion Network with InceptionV3 for Retinal OCT Image Classification

Automatic Segmentation of Retinal Edema in Optical Coherence Tomography Based on Deep Neural Networks

Kernel Principal Component Analysis Network Method for Face Recognition

Automatic Classification of Volumetric Optical Coherence Tomography Images via Recurrent Neural Network

A novel approach for automatic classification of macular degeneration OCT images

RetiNet: Automatic AMD identification in OCT volumetric data

On OCT Image Classification Via Deep Learning

Multi-scale convolutional neural network for automated AMD classification using retinal OCT images

Automatic Choroid Layer Segmentation in OCT Images Via Context Efficient Adaptive Network.

Automatic Segmentation of Retinal Layer in OCT Images with Choroidal Neovascularization.

Attennet: Deep Attention Based Retinal Disease Classification In Oct Images

Deep Neural Network Regression for Automated Retinal Layer Segmentation in Optical Coherence Tomography Images

FN-OCT: Disease Detection Algorithm for Retinal Optical Coherence Tomography Based on a Fusion Network