Self-supervised based clustering for retinal optical coherence tomography images

Yilong Luo,Tian Lin,Aidi Lin,Xiaoting Mai,Haoyu Chen

DOI: https://doi.org/10.1038/s41433-024-03444-z

IF: 4.4563

2024-10-29

Eye

Abstract:In response to the inadequacy of manual analysis in meeting the rising demand for retinal optical coherence tomography (OCT) images, a self-supervised learning-based clustering model was implemented.

ophthalmology

What problem does this paper attempt to address?

Learning With Fewer Images via Image Clustering: Application to Intravascular OCT Image Segmentation

Chaitanya Kolluru,Juhwan Lee,Yazan Gharaibeh,Hiram G. Bezerra,David L. Wilson

DOI: https://doi.org/10.1109/access.2021.3058890

IF: 3.9

2021-01-01

IEEE Access

Abstract:Deep learning based methods are routinely used to segment various structures of interest in varied medical imaging modalities. Acquiring annotations for a large number of images requires a skilled analyst, and the process is both time consuming and challenging. Our approach to reduce effort is to reduce the number of images needing detailed annotation. For intravascular optical coherence tomography (IVOCT) image pullbacks, we tested 10% to 100% of training images derived from two schemes: equally-spaced image subsampling and deep-learning- based image clustering. The first strategy involves selecting images at equally spaced intervals from the volume, accounting for the high spatial correlation between neighboring images. In clustering, we used an autoencoder to create a deep feature space representation, performed k-medoids clustering, and then used the cluster medians for training. For coronary calcifications, a baseline U-net model was trained on all images from volumes of interest (VOIs) and compared with fewer images from the sub-sampling strategies. For a given sampling ratio, the clustering based method performed better or similar as compared to the equally spaced sampling approach (e.g., with 10% of images, mean F1 score for calcific class increased from 0.52 to 0.63, with equal spacing and with clustering, respectively). Additionally, for a fixed number of training images, sampling images from more VOIs performed better than otherwise. In conclusion, we recommend the clustering based approach to annotate a small fraction of images, creating a baseline model, which potentially can be improved further by annotating images selected using methods described in active learning research.

computer science, information systems,telecommunications,engineering, electrical & electronic
Weakly Supervised Deep Learning-Based Optical Coherence Tomography Angiography.

Zhe Jiang,Zhiyu Huang,Bin Qiu,Xiangxi Meng,Yunfei You,Xi Liu,Mufeng Geng,Gangjun Liu,Chuanqing Zhou,Kun Yang,Andreas Maier,Qiushi Ren,Yanye Lu

DOI: https://doi.org/10.1109/tmi.2020.3035154

IF: 10.6

2020-01-01

IEEE Transactions on Medical Imaging

Abstract:Optical coherence tomography angiography (OCTA) is a promising imaging modality for microvasculature studies. Deep learning networks have been widely applied in the field of OCTA reconstruction, benefiting from its powerful mapping capability among images. However, these existing deep learning-based methods depend on high-quality labels, which are hard to acquire considering imaging hardware limitations and practical data acquisition conditions. In this article, we proposed an unprecedented weakly supervised deep learning-based pipeline for OCTA reconstruction task, in the absence of high-quality training labels. The proposed pipeline was investigated on an in vivo animal dataset and a human eye dataset by a cross-validation strategy. Compared with supervised learning approaches, the proposed approach demonstrated similar or even better performance in the OCTA reconstruction task. These investigations indicate that the proposed weakly supervised learning strategy is well capable of performing OCTA reconstruction, and has a certain potential towards clinical applications.
Automatic Detection of Retinopathy with Optical Coherence Tomography Images Via a Semi-Supervised Deep Learning Method.

Yuemei Luo,Qing Xu,Ruibing Jin,Min Wu,Linbo Liu

DOI: https://doi.org/10.1364/boe.418364

IF: 3.4

2021-01-01

Biomedical Optics Express

Abstract:Automatic detection of retinopathy via computer vision techniques is of great importance for clinical applications. However, traditional deep learning based methods in computer vision require a large amount of labeled data, which are expensive and may not be available in clinical applications. To mitigate this issue, in this paper, we propose a semi-supervised deep learning method built upon pre-trained VGG-16 and virtual adversarial training (VAT) for the detection of retinopathy with optical coherence tomography (OCT) images. It only requires very few labeled and a number of unlabeled OCT images for model training. In experiments, we have evaluated the proposed method on two popular datasets. With only 80 labeled OCT images, the proposed method can achieve classification accuracies of 0.942 and 0.936, sensitivities of 0.942 and 0.936, specificities of 0.971 and 0.979, and AUCs (Area under the ROC Curves) of 0.997 and 0.993 on the two datasets, respectively. When comparing with human experts, it achieves expert level with 80 labeled OCT images and outperforms four out of six experts with 200 labeled OCT images. Furthermore, we also adopt the Gradient Class Activation Map (Grad-CAM) method to visualize the key regions that the proposed method focuses on when making predictions. It shows that the proposed method can accurately recognize the key patterns of the input OCT images when predicting retinopathy.
Rotation-Oriented Collaborative Self-Supervised Learning for Retinal Disease Diagnosis

Xiaomeng Li,Xiaowei Hu,Xiaojuan Qi,Lequan Yu,Wei Zhao,Pheng-Ann Heng,Lei Xing

DOI: https://doi.org/10.1109/tmi.2021.3075244

IF: 10.6

2021-09-01

IEEE Transactions on Medical Imaging

Abstract:The automatic diagnosis of various conventional ophthalmic diseases from fundus images is important in clinical practice. However, developing such automatic solutions is challenging due to the requirement of a large amount of training data and the expensive annotations for medical images. This paper presents a novel self-supervised learning framework for retinal disease diagnosis to reduce the annotation efforts by learning the visual features from the unlabeled images. To achieve this, we present a rotation-oriented collaborative method that explores rotation-related and rotation-invariant features, which capture discriminative structures from fundus images and also explore the invariant property used for retinal disease classification. We evaluate the proposed method on two public benchmark datasets for retinal disease classification. The experimental results demonstrate that our method outperforms other self-supervised feature learning methods (around 4.2% area under the curve (AUC)). With a large amount of unlabeled data available, our method can surpass the supervised baseline for pathologic myopia (PM) and is very close to the supervised baseline for age-related macular degeneration (AMD), showing the potential benefit of our method in clinical practice.

engineering, biomedical,imaging science & photographic technology, electrical & electronic,computer science, interdisciplinary applications,radiology, nuclear medicine & medical imaging
Enhanced Deep Learning Model for Classification of Retinal Optical Coherence Tomography Images

Esraa Hassan,Samir Elmougy,Mai R. Ibraheem,M. Shamim Hossain,Khalid AlMutib,Ahmed Ghoneim,Salman A. AlQahtani,Fatma M. Talaat

DOI: https://doi.org/10.3390/s23125393

IF: 3.9

2023-06-07

Sensors

Abstract:Retinal optical coherence tomography (OCT) imaging is a valuable tool for assessing the condition of the back part of the eye. The condition has a great effect on the specificity of diagnosis, the monitoring of many physiological and pathological procedures, and the response and evaluation of therapeutic effectiveness in various fields of clinical practices, including primary eye diseases and systemic diseases such as diabetes. Therefore, precise diagnosis, classification, and automated image analysis models are crucial. In this paper, we propose an enhanced optical coherence tomography (EOCT) model to classify retinal OCT based on modified ResNet (50) and random forest algorithms, which are used in the proposed study's training strategy to enhance performance. The Adam optimizer is applied during the training process to increase the efficiency of the ResNet (50) model compared with the common pre-trained models, such as spatial separable convolutions and visual geometry group (VGG) (16). The experimentation results show that the sensitivity, specificity, precision, negative predictive value, false discovery rate, false negative rate accuracy, and Matthew's correlation coefficient are 0.9836, 0.9615, 0.9740, 0.9756, 0.0385, 0.0260, 0.0164, 0.9747, 0.9788, and 0.9474, respectively.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Segmentation of Retinal Low-Cost Optical Coherence Tomography Images using Deep Learning

Timo Kepp,Helge Sudkamp,Claus von der Burchard,Hendrik Schenke,Peter Koch,Gereon Hüttmann,Johann Roider,Mattias P. Heinrich,Heinz Handels

DOI: https://doi.org/10.48550/arXiv.2001.08480

2020-01-23

Abstract:The treatment of age-related macular degeneration (AMD) requires continuous eye exams using optical coherence tomography (OCT). The need for treatment is determined by the presence or change of disease-specific OCT-based biomarkers. Therefore, the monitoring frequency has a significant influence on the success of AMD therapy. However, the monitoring frequency of current treatment schemes is not individually adapted to the patient and therefore often insufficient. While a higher monitoring frequency would have a positive effect on the success of treatment, in practice it can only be achieved with a home monitoring solution. One of the key requirements of a home monitoring OCT system is a computer-aided diagnosis to automatically detect and quantify pathological changes using specific OCT-based biomarkers. In this paper, for the first time, retinal scans of a novel self-examination low-cost full-field OCT (SELF-OCT) are segmented using a deep learning-based approach. A convolutional neural network (CNN) is utilized to segment the total retina as well as pigment epithelial detachments (PED). It is shown that the CNN-based approach can segment the retina with high accuracy, whereas the segmentation of the PED proves to be challenging. In addition, a convolutional denoising autoencoder (CDAE) refines the CNN prediction, which has previously learned retinal shape information. It is shown that the CDAE refinement can correct segmentation errors caused by artifacts in the OCT image.

Image and Video Processing,Computer Vision and Pattern Recognition
Predicting effectiveness of anti-VEGF injection through self-supervised learning in OCT images.

Dehua Feng,Xi Chen,Xiaoyu Wang,Xuanqin Mou,Ling Bai,Shu Zhang,Zhiguo Zhou

DOI: https://doi.org/10.3934/mbe.2023114

2023-01-01

Abstract:Anti-vascular endothelial growth factor (Anti-VEGF) therapy has become a standard way for choroidal neovascularization (CNV) and cystoid macular edema (CME) treatment. However, anti-VEGF injection is a long-term therapy with expensive cost and may be not effective for some patients. Therefore, predicting the effectiveness of anti-VEGF injection before the therapy is necessary. In this study, a new optical coherence tomography (OCT) images based self-supervised learning (OCT-SSL) model for predicting the effectiveness of anti-VEGF injection is developed. In OCT-SSL, we pre-train a deep encoder-decoder network through self-supervised learning to learn the general features using a public OCT image dataset. Then, model fine-tuning is performed on our own OCT dataset to learn the discriminative features to predict the effectiveness of anti-VEGF. Finally, classifier trained by the features from fine-tuned encoder as a feature extractor is built to predict the response. Experimental results on our private OCT dataset demonstrated that the proposed OCT-SSL can achieve an average accuracy, area under the curve (AUC), sensitivity and specificity of 0.93, 0.98, 0.94 and 0.91, respectively. Meanwhile, it is found that not only the lesion region but also the normal region in OCT image is related to the effectiveness of anti-VEGF.
Computer-aided diagnosis system for retinal disorder classification using optical coherence tomography images

Neven Saleh,Manal Abdel Wahed,Ahmed M Salaheldin

DOI: https://doi.org/10.1515/bmt-2021-0330

2022-05-18

Abstract:The incidence of vision impairment is rapidly increasing. Diagnosis and classifying retinal abnormalities in ophthalmological applications is a significant challenge. Using Optical Coherence Tomography (OCT), the study aims to develop a computer aided diagnosis system for detecting and classifying retinal disorders. Choroidal neovascularization, diabetic macular edema, drusen, and normal cases are the investigated groups. Both deep learning and machine learning are combined to build the system. The SqueezeNet neural network was modified to extract features. The Support Vector Machine (SVM), K-Nearest Neighbor (K-NN), Decision Tree (DT), and Ensemble Model (EM) algorithms were used for disorder classification. The Bayesian optimization technique was also used to determine the best hyperparameters for each model. The model' performance was evaluated through nine criteria using 12,000 OCT images. The results have demonstrated accuracies of 97.39, 97.47, 96.98, and 95.25% for the SVM, K-NN, DT, and EM, respectively. When results are compared to relevant studies in terms of accuracy and tested samples, they show superior performance. As a result, a novel computer-aided diagnosis system for detecting and classifying retinal diseases has been developed, reducing human error while also saving time.
Self-Supervised Learning Featuring Small-Scale Image Dataset for Treatable Retinal Diseases Classification

Luffina C. Huang,Darren J. Chiu,Manish Mehta

2024-04-16

Abstract:Automated medical diagnosis through image-based neural networks has increased in popularity and matured over years. Nevertheless, it is confined by the scarcity of medical images and the expensive labor annotation costs. Self-Supervised Learning (SSL) is an good alternative to Transfer Learning (TL) and is suitable for imbalanced image datasets. In this study, we assess four pretrained SSL models and two TL models in treatable retinal diseases classification using small-scale Optical Coherence Tomography (OCT) images ranging from 125 to 4000 with balanced or imbalanced distribution for training. The proposed SSL model achieves the state-of-art accuracy of 98.84% using only 4,000 training images. Our results suggest the SSL models provide superior performance under both the balanced and imbalanced training scenarios. The SSL model with MoCo-v2 scheme has consistent good performance under the imbalanced scenario and, especially, surpasses the other models when the training set is less than 500 images.

Computer Vision and Pattern Recognition,Machine Learning
Choroidal Optical Coherence Tomography Angiography: Noninvasive Choroidal Vessel Analysis via Deep Learning

Lei Zhu,Junmeng Li,Yicheng Hu,Ruilin Zhu,Shuang Zeng,Pei Rong,Yadi Zhang,Xiaopeng Gu,Yuwei Wang,Zhiyue Zhang,Liu Yang,Qiushi Ren,Yanye Lu

DOI: https://doi.org/10.34133/hds.0170

2024-09-10

Abstract:Background: The choroid is the most vascularized structure in the human eye, associated with numerous retinal and choroidal diseases. However, the vessel distribution of choroidal sublayers has yet to be effectively explored due to the lack of suitable tools for visualization and analysis. Methods: In this paper, we present a novel choroidal angiography strategy to more effectively evaluate vessels within choroidal sublayers in the clinic. Our approach utilizes a segmentation model to extract choroidal vessels from OCT B-scans layer by layer. Furthermore, we ensure that the model, trained on B-scans with high choroidal quality, can proficiently handle the low-quality B-scans commonly collected in clinical practice for reconstruction vessel distributions. By treating this process as a cross-domain segmentation task, we propose an ensemble discriminative mean teacher structure to address the specificities inherent in this cross-domain segmentation process. The proposed structure can select representative samples with minimal label noise for self-training and enhance the adaptation strength of adversarial training. Results: Experiments demonstrate the effectiveness of the proposed structure, achieving a dice score of 77.28 for choroidal vessel segmentation. This validates our strategy to provide satisfactory choroidal angiography noninvasively, supportting the analysis of choroidal vessel distribution for paitients with choroidal diseases. We observed that patients with central serous chorioretinopathy have evidently (P < 0.05) lower vascular indexes at all choroidal sublayers than healthy individuals, especially in the region beyond central fovea of macula (larger than 6 mm). Conclusions: We release the code and training set of the proposed method as the first noninvasive mechnism to assist clinical application for the analysis of choroidal vessels.
Choroidal Optical Coherence Tomography Angiography: Non-invasive Choroidal Vessel Analysis Via Deep Learning

Lei Zhu,Junmeng Li,Yicheng Hu,Ruilin Zhu,Shuang Zeng,Pei Rong,Yadi Zhang,Xiaopeng Gu,Yuwei Wang,Zhiyue Zhang,Liu Yang,Qiushi Ren,Yanye Lu

DOI: https://doi.org/10.34133/hds.0170

2024-01-01

Health Data Science

Abstract:Background: The choroid is the most vascularized structure in the human eye, associated with numerous retinal and choroidal diseases. However, the vessel distribution of choroidal sublayers has yet to be effectively explored due to the lack of suitable tools for visualization and analysis. Methods: In this paper, we present a novel choroidal angiography strategy to more effectively evaluate vessels within choroidal sublayers in the clinic. Our approach utilizes a segmentation model to extract choroidal vessels from OCT B-scans layer by layer. Furthermore, we ensure that the model, trained on B-scans with high choroidal quality, can proficiently handle the low-quality B-scans commonly collected in clinical practice for reconstruction vessel distributions. By treating this process as a cross-domain segmentation task, we propose an ensemble discriminative mean teacher structure to address the specificities inherent in this cross-domain segmentation process. The proposed structure can select representative samples with minimal label noise for self-training and enhance the adaptation strength of adversarial training. Results: Experiments demonstrate the effectiveness of the proposed structure, achieving a dice score of 77.28 for choroidal vessel segmentation. This validates our strategy to provide satisfactory choroidal angiography noninvasively, supportting the analysis of choroidal vessel distribution for paitients with choroidal diseases. We observed that patients with central serous chorioretinopathy have evidently (P < 0.05) lower vascular indexes at all choroidal sublayers than healthy individuals, especially in the region beyond central fovea of macula (larger than 6 mm). Conclusions: We release the code and training set of the proposed method as the first noninvasive mechnism to assist clinical application for the analysis of choroidal vessels.
Unifying Structure Analysis and Surrogate-driven Function Regression for Glaucoma OCT Image Screening

Xi Wang,Hao Chen,Luyang Luo,An-ran Ran,Poemen P. Chan,Clement C. Tham,Carol Y. Cheung,Pheng-Ann Heng

DOI: https://doi.org/10.48550/arXiv.1907.12927

2019-07-26

Abstract:Optical Coherence Tomography (OCT) imaging plays an important role in glaucoma diagnosis in clinical practice. Early detection and timely treatment can prevent glaucoma patients from permanent vision loss. However, only a dearth of automated methods has been developed based on OCT images for glaucoma study. In this paper, we present a novel framework to effectively classify glaucoma OCT images from normal ones. A semi-supervised learning strategy with smoothness assumption is applied for surrogate assignment of missing function regression labels. Besides, the proposed multi-task learning network is capable of exploring the structure and function relationship from the OCT image and visual field measurement simultaneously, which contributes to classification performance boosting. Essentially, we are the first to unify the structure analysis and function regression for glaucoma screening. It is also worth noting that we build the largest glaucoma OCT image dataset involving 4877 volumes to develop and evaluate the proposed method. Extensive experiments demonstrate that our framework outperforms the baseline methods and two glaucoma experts by a large margin, achieving 93.2%, 93.2% and 97.8% on accuracy, F1 score and AUC, respectively.

Computer Vision and Pattern Recognition
Dynamic Graph Clustering Learning for Unsupervised Diabetic Retinopathy Classification

Chenglin Yu,Hailong Pei

DOI: https://doi.org/10.3390/diagnostics13203251

IF: 3.6

2023-10-19

Diagnostics

Abstract:Diabetic retinopathy (DR) is a common complication of diabetes, which can lead to vision loss. Early diagnosis is crucial to prevent the progression of DR. In recent years, deep learning approaches have shown promising results in the development of an intelligent and efficient system for DR classification. However, one major drawback is the need for expert-annotated datasets, which are both time-consuming and costly. To address these challenges, this paper proposes a novel dynamic graph clustering learning (DGCL) method for unsupervised classification of DR, which innovatively deploys the Euclidean and topological features from fundus images for dynamic clustering. Firstly, a multi-structural feature fusion (MFF) module extracts features from the structure of the fundus image and captures topological relationships among multiple samples, generating a fused representation. Secondly, another consistency smoothing clustering (CSC) module combines network updates and deep clustering to ensure stability and smooth performance improvement during model convergence, optimizing the clustering process by iteratively updating the network and refining the clustering results. Lastly, dynamic memory storage is utilized to track and store important information from previous iterations, enhancing the training stability and convergence. During validation, the experimental results with public datasets demonstrated the superiority of our proposed DGCL network.

medicine, general & internal
Retinal Fluid Segmentation and Detection in Optical Coherence Tomography Images using Fully Convolutional Neural Network

Donghuan Lu,Morgan Heisler,Sieun Lee,Gavin Ding,Marinko V. Sarunic,Mirza Faisal Beg

DOI: https://doi.org/10.48550/arXiv.1710.04778

2017-10-13

Abstract:As a non-invasive imaging modality, optical coherence tomography (OCT) can provide micrometer-resolution 3D images of retinal structures. Therefore it is commonly used in the diagnosis of retinal diseases associated with edema in and under the retinal layers. In this paper, a new framework is proposed for the task of fluid segmentation and detection in retinal OCT images. Based on the raw images and layers segmented by a graph-cut algorithm, a fully convolutional neural network was trained to recognize and label the fluid pixels. Random forest classification was performed on the segmented fluid regions to detect and reject the falsely labeled fluid regions. The leave-one-out cross validation experiments on the RETOUCH database show that our method performs well in both segmentation (mean Dice: 0.7317) and detection (mean AUC: 0.985) tasks.

Computer Vision and Pattern Recognition
A Review of Machine Learning Algorithms for Retinal Cyst Segmentation on Optical Coherence Tomography

Xing Wei,Ruifang Sui

DOI: https://doi.org/10.3390/s23063144

2023-01-01

Abstract:Optical coherence tomography (OCT) is an emerging imaging technique for diagnosing ophthalmic diseases and the visual analysis of retinal structure changes, such as exudates, cysts, and fluid. In recent years, researchers have increasingly focused on applying machine learning algorithms, including classical machine learning and deep learning methods, to automate retinal cysts/fluid segmentation. These automated techniques can provide ophthalmologists with valuable tools for improved interpretation and quantification of retinal features, leading to more accurate diagnosis and informed treatment decisions for retinal diseases. This review summarized the state-of-the-art algorithms for the three essential steps of cyst/fluid segmentation: image denoising, layer segmentation, and cyst/fluid segmentation, while emphasizing the significance of machine learning techniques. Additionally, we provided a summary of the publicly available OCT datasets for cyst/fluid segmentation. Furthermore, the challenges, opportunities, and future directions of artificial intelligence (AI) in OCT cyst segmentation are discussed. This review is intended to summarize the key parameters for the development of a cyst/fluid segmentation system and the design of novel segmentation algorithms and has the potential to serve as a valuable resource for imaging researchers in the development of assessment systems related to ocular diseases exhibiting cyst/fluid in OCT imaging.
OCT-SelfNet: A Self-Supervised Framework with Multi-Modal Datasets for Generalized and Robust Retinal Disease Detection

Fatema-E Jannat,Sina Gholami,Minhaj Nur Alam,Hamed Tabkhi

2024-01-23

Abstract:Despite the revolutionary impact of AI and the development of locally trained algorithms, achieving widespread generalized learning from multi-modal data in medical AI remains a significant challenge. This gap hinders the practical deployment of scalable medical AI solutions. Addressing this challenge, our research contributes a self-supervised robust machine learning framework, OCT-SelfNet, for detecting eye diseases using optical coherence tomography (OCT) images. In this work, various data sets from various institutions are combined enabling a more comprehensive range of representation. Our method addresses the issue using a two-phase training approach that combines self-supervised pretraining and supervised fine-tuning with a mask autoencoder based on the SwinV2 backbone by providing a solution for real-world clinical deployment. Extensive experiments on three datasets with different encoder backbones, low data settings, unseen data settings, and the effect of augmentation show that our method outperforms the baseline model, Resnet-50 by consistently attaining AUC-ROC performance surpassing 77% across all tests, whereas the baseline model exceeds 54%. Moreover, in terms of the AUC-PR metric, our proposed method exceeded 42%, showcasing a substantial increase of at least 10% in performance compared to the baseline, which exceeded only 33%. This contributes to our understanding of our approach's potential and emphasizes its usefulness in clinical settings.

Computer Vision and Pattern Recognition,Artificial Intelligence,Machine Learning
Self-supervised contrastive learning improves machine learning discrimination of full thickness macular holes from epiretinal membranes in retinal OCT scans

Timothy William Wheeler,Kaitlyn Hunter,Patricia Anne Garcia,Henry Li,Andrew Clark Thomson,Allan Hunter,Courosh Mehanian

DOI: https://doi.org/10.1371/journal.pdig.0000411

2024-08-26

Abstract:There is a growing interest in using computer-assisted models for the detection of macular conditions using optical coherence tomography (OCT) data. As the quantity of clinical scan data of specific conditions is limited, these models are typically developed by fine-tuning a generalized network to classify specific macular conditions of interest. Full thickness macular holes (FTMH) present a condition requiring urgent surgical repair to prevent vision loss. Other works on automated FTMH classification have tended to use supervised ImageNet pre-trained networks with good results but leave room for improvement. In this paper, we develop a model for FTMH classification using OCT B-scans around the central foveal region to pre-train a naïve network using contrastive self-supervised learning. We found that self-supervised pre-trained networks outperform ImageNet pre-trained networks despite a small training set size (284 eyes total, 51 FTMH+ eyes, 3 B-scans from each eye). On three replicate data splits, 3D spatial contrast pre-training yields a model with an average F1-score of 1.0 on holdout data (50 eyes total, 10 FTMH+), compared to an average F1-score of 0.831 for FTMH detection by ImageNet pre-trained models. These results demonstrate that even limited data may be applied toward self-supervised pre-training to substantially improve performance for FTMH classification, indicating applicability toward other OCT-based problems.
Diagnosing Diabetic Retinopathy in OCTA Images Based on Multilevel Information Fusion Using a Deep Learning Framework

Qiaoyu Li,Xiao-Rong Zhu,Guangmin Sun,Lin Zhang,Meilong Zhu,Tian Tian,Chenyu Guo,Sarah Mazhar,Jin-Kui Yang,Yu Li

DOI: https://doi.org/10.1155/2022/4316507

2022-08-04

Abstract:Objective: As an extension of optical coherence tomography (OCT), optical coherence tomographic angiography (OCTA) provides information on the blood flow status at the microlevel and is sensitive to changes in the fundus vessels. However, due to the distinct imaging mechanism of OCTA, existing models, which are primarily used for analyzing fundus images, do not work well on OCTA images. Effectively extracting and analyzing the information in OCTA images remains challenging. To this end, a deep learning framework that fuses multilevel information in OCTA images is proposed in this study. The effectiveness of the proposed model was demonstrated in the task of diabetic retinopathy (DR) classification. Method: First, a U-Net-based segmentation model was proposed to label the boundaries of large retinal vessels and the foveal avascular zone (FAZ) in OCTA images. Then, we designed an isolated concatenated block (ICB) structure to extract and fuse information from the original OCTA images and segmentation results at different fusion levels. Results: The experiments were conducted on 301 OCTA images. Of these images, 244 were labeled by ophthalmologists as normal images, and 57 were labeled as DR images. An accuracy of 93.1% and a mean intersection over union (mIOU) of 77.1% were achieved using the proposed large vessel and FAZ segmentation model. In the ablation experiment with 6-fold validation, the proposed deep learning framework that combines the proposed isolated and concatenated convolution process significantly improved the DR diagnosis accuracy. Moreover, inputting the merged images of the original OCTA images and segmentation results further improved the model performance. Finally, a DR diagnosis accuracy of 88.1% (95%CI ± 3.6%) and an area under the curve (AUC) of 0.92 were achieved using our proposed classification model, which significantly outperforms the state-of-the-art classification models. As a comparison, an accuracy of 83.7 (95%CI ± 1.5%) and AUC of 0.76 were obtained using EfficientNet. Significance. The visualization results show that the FAZ and the vascular region close to the FAZ provide more information for the model than the farther surrounding area. Furthermore, this study demonstrates that a clinically sophisticated designed deep learning model is not only able to effectively assist in the diagnosis but also help to locate new indicators for certain illnesses.
Automatic Detection of Retinal Regions Using Fully Convolutional Networks for Diagnosis of Abnormal Maculae in Optical Coherence Tomography Images

Zhongyang Sun,Yankui Sun

DOI: https://doi.org/10.1117/1.jbo.24.5.056003

IF: 3.758

2019-01-01

Journal of Biomedical Optics

Abstract:In conventional retinal region detection methods for optical coherence tomography (OCT) images, many parameters need to be set manually, which is often detrimental to their generalizability. We present a scheme to detect retinal regions based on fully convolutional networks (FCN) for automatic diagnosis of abnormal maculae in OCT images. The FCN model is trained on 900 labeled age-related macular degeneration (AMD), diabetic macular edema (DME) and normal (NOR) OCT images. Its segmentation accuracy is validated and its effectiveness in recognizing abnormal maculae in OCT images is tested and compared with traditional methods, by using the spatial pyramid matching based on sparse coding (ScSPM) classifier and Inception V3 classifier on two datasets: Duke dataset and our clinic dataset. In our clinic dataset, we randomly selected half of the B-scans of each class (300 AMD, 300 DME, and 300 NOR) for training classifier and the rest (300 AMD, 300 DME, and 300 NOR) for testing with 10 repetitions. Average accuracy, sensitivity, and specificity of 98.69%, 98.03%, and 99.01% are obtained by using ScSPM classifier, and those of 99.69%, 99.53%, and 99.77% are obtained by using Inception V3 classifier. These two classification algorithms achieve 100% classification accuracy when directly applied to Duke dataset, where all the 45 OCT volumes are used as test set. Finally, FCN model with or without flattening and cropping and its influence on classification performance are discussed.
Fundus-Enhanced Disease-Aware Distillation Model for Retinal Disease Classification from OCT Images

Lehan Wang,Weihang Dai,Mei Jin,Chubin Ou,Xiaomeng Li

2023-08-01

Abstract:Optical Coherence Tomography (OCT) is a novel and effective screening tool for ophthalmic examination. Since collecting OCT images is relatively more expensive than fundus photographs, existing methods use multi-modal learning to complement limited OCT data with additional context from fundus images. However, the multi-modal framework requires eye-paired datasets of both modalities, which is impractical for clinical use. To address this problem, we propose a novel fundus-enhanced disease-aware distillation model (FDDM), for retinal disease classification from OCT images. Our framework enhances the OCT model during training by utilizing unpaired fundus images and does not require the use of fundus images during testing, which greatly improves the practicality and efficiency of our method for clinical use. Specifically, we propose a novel class prototype matching to distill disease-related information from the fundus model to the OCT model and a novel class similarity alignment to enforce consistency between disease distribution of both modalities. Experimental results show that our proposed approach outperforms single-modal, multi-modal, and state-of-the-art distillation methods for retinal disease classification. Code is available at <a class="link-external link-https" href="https://github.com/xmed-lab/FDDM" rel="external noopener nofollow">this https URL</a>.

Image and Video Processing,Computer Vision and Pattern Recognition

Self-supervised based clustering for retinal optical coherence tomography images

Learning With Fewer Images via Image Clustering: Application to Intravascular OCT Image Segmentation

Weakly Supervised Deep Learning-Based Optical Coherence Tomography Angiography.

Automatic Detection of Retinopathy with Optical Coherence Tomography Images Via a Semi-Supervised Deep Learning Method.

Rotation-Oriented Collaborative Self-Supervised Learning for Retinal Disease Diagnosis

Enhanced Deep Learning Model for Classification of Retinal Optical Coherence Tomography Images

Segmentation of Retinal Low-Cost Optical Coherence Tomography Images using Deep Learning

Predicting effectiveness of anti-VEGF injection through self-supervised learning in OCT images.

Computer-aided diagnosis system for retinal disorder classification using optical coherence tomography images

Self-Supervised Learning Featuring Small-Scale Image Dataset for Treatable Retinal Diseases Classification

Choroidal Optical Coherence Tomography Angiography: Noninvasive Choroidal Vessel Analysis via Deep Learning

Choroidal Optical Coherence Tomography Angiography: Non-invasive Choroidal Vessel Analysis Via Deep Learning

Unifying Structure Analysis and Surrogate-driven Function Regression for Glaucoma OCT Image Screening

Dynamic Graph Clustering Learning for Unsupervised Diabetic Retinopathy Classification

Retinal Fluid Segmentation and Detection in Optical Coherence Tomography Images using Fully Convolutional Neural Network

A Review of Machine Learning Algorithms for Retinal Cyst Segmentation on Optical Coherence Tomography

OCT-SelfNet: A Self-Supervised Framework with Multi-Modal Datasets for Generalized and Robust Retinal Disease Detection

Self-supervised contrastive learning improves machine learning discrimination of full thickness macular holes from epiretinal membranes in retinal OCT scans

Diagnosing Diabetic Retinopathy in OCTA Images Based on Multilevel Information Fusion Using a Deep Learning Framework

Automatic Detection of Retinal Regions Using Fully Convolutional Networks for Diagnosis of Abnormal Maculae in Optical Coherence Tomography Images

Fundus-Enhanced Disease-Aware Distillation Model for Retinal Disease Classification from OCT Images