Automatic Localization of the Scleral Spur Using Deep Learning and Ultrasound Biomicroscopy.

Wensai Wang,Lingxiao Wang,Tao Wang,Xiaochun Wang,Sheng Zhou,Jun Yang,Song Lin

DOI: https://doi.org/10.1167/tvst.10.9.28

2021-01-01

Translational Vision Science & Technology

Abstract:Deep learning algorithms for automating scleral spur localization would facilitate the quantitative assessment of the opening of the angle and the risk in angle closure.

What problem does this paper attempt to address?

A Three-Dimensional Measurement Method for Binocular Endoscopes Based on Deep Learning

Yu Hao,Zhou Changjiang,Zhang Wei,Wang Liqiang,Yang Qing,Yuan Bo

DOI: https://doi.org/10.1631/fitee.2000679

2022-01-01

Abstract:In the practice of clinical endoscopy, the precise estimation of the lesion size is quite significant for diagnosis. In this paper, we propose a three-dimensional (3D) measurement method for binocular endoscopes based on deep learning, which can overcome the poor robustness of the traditional binocular matching algorithm in texture-less areas. A simulated binocular image dataset is created from the target 3D data obtained by a 3D scanner and the binocular camera is simulated by 3D rendering software to train a disparity estimation model for 3D measurement. The experimental results demonstrate that, compared with the traditional binocular matching algorithm, the proposed method improves the accuracy and disparity map generation speed by 48.9% and 90.5%, respectively. This can provide more accurate and reliable lesion size and improve the efficiency of endoscopic diagnosis.
Deep Neural Network for Scleral Spur Detection in Anterior Segment OCT Images: The Chinese American Eye Study

Benjamin Y. Xu,Michael Chiang,Anmol A. Pardeshi,Sasan Moghimi,Rohit Varma

DOI: https://doi.org/10.1167/tvst.9.2.18

2020-03-30

Abstract:Purpose: To develop a deep neural network that detects the scleral spur in anterior segment optical coherence tomography (AS-OCT) images.Methods: Participants in the Chinese American Eye Study, a population-based study in Los Angeles, California, underwent complete ocular examinations, including AS-OCT imaging with the Tomey CASIA SS-1000. One human expert grader provided reference labels of scleral spur locations in all images. A convolutional neural network (CNN)-based on the ResNet-18 architecture was developed to detect the scleral spur in each image. Performance of the CNN model was assessed by calculating prediction errors, defined as the difference between the Cartesian coordinates of reference and CNN-predicted scleral spur locations. Prediction errors were compared with intragrader variability in detecting scleral spur locations by the reference grader.Results: The CNN was developed using a training dataset of 17,704 images and tested using an independent dataset of 921 images. The mean absolute prediction errors of the CNN model were 49.27 ± 42.07 µm for X-coordinates and 47.73 ± 39.70 µm for Y-coordinates. The mean absolute intragrader variability was 52.31 ± 47.75 µm for X-coordinates and 45.88 ± 45.06 µm for Y-coordinates. Distributions of prediction errors for the CNN and intragrader variability for the reference grader were similar for X-coordinates (<i>P</i> = 0.609) and Y-coordinates (<i>P</i> = 0.378). The mean absolute prediction error of the CNN was 73.08 ± 52.06 µm and the mean absolute intragrader variability was 73.92 ± 60.72 µm.Conclusions: A deep neural network can detect the scleral spur on AS-OCT images with performance similar to that of a human expert grader.Translational Relevance: Deep learning methods that automate scleral spur detection can facilitate qualitative and quantitative assessments of AS-OCT images.

ophthalmology
Automatic Anterior Chamber Angle Classification Using Deep Learning System and Anterior Segment Optical Coherence Tomography Images

Wanyue Li,Qian Chen,Chunhui Jiang,Guohua Shi,Guohua Deng,Xinghuai Sun

DOI: https://doi.org/10.1167/tvst.10.6.19

2021-01-01

Translational Vision Science & Technology

Abstract:Purpose: The purpose of this study was to develop a software package for the automatic classification of anterior chamber angle using anterior segment optical coherence tomography (AS-OCT). Methods: AS-OCT images were collected from subjects with open, narrow, and closure anterior chamber angles, which were graded based on ultrasound biomicroscopy (UBM) results. The Inception version 3 network and the transfer learning technique were applied in the design of an algorithm for anterior chamber angle classification. The classification performance was evaluated by fivefold cross-validation and on an independent test dataset. Results: The proposed algorithm reached a sensitivity of 0.999 and specificity of 1.000 in the judgment of closed and nonclosed angles. The overall classification of the proposed method in open angle, narrow angle, and angle-closure classifications reached a sensitivity of 0.989 and specificity of 0.995. Additionally, the sensitivity and specificity reached 1.000 and 1.000 for angle-closure, 0.983 and 0.993 for narrow angle, and 0.985 and 0.991 for open angle. Conclusions: The experimental results showed that the proposed method can achieve a high accuracy of anterior chamber angle classification using AS-OCT images, and could be of value in future practice. Translational Relevance: The proposed deep learning-based method that automate the classification of anterior chamber angle can facilitate clinical assessment of glaucoma.
Needle Detection and Localisation for Robot‐assisted Subretinal Injection Using Deep Learning

Mingchuan Zhou,Xiangyu Guo,Matthias Grimm,Elias Lochner,Zhongliang Jiang,Abouzar Eslami,Juan Ye,Nassir Navab,Alois Knoll,Mohammad Ali Nasseri

DOI: https://doi.org/10.1049/cit2.12242

IF: 7.985

2023-01-01

CAAI Transactions on Intelligence Technology

Abstract:Subretinal injection is a complicated task for retinal surgeons to operate manually. In this paper we demonstrate a robust framework for needle detection and localisation in robot-assisted subretinal injection using microscope-integrated Optical Coherence Tomography with deep learning. Five convolutional neural networks with different architectures were evaluated. The main differences between the architectures are the amount of information they receive at the input layer. When evaluated on ex-vivo pig eyes, the top performing network successfully detected all needles in the dataset and localised them with an Intersection over Union value of 0.55. The algorithm was evaluated by comparing the depth of the top and bottom edge of the predicted bounding box to the ground truth. This analysis showed that the top edge can be used to predict the depth of the needle with a maximum error of 8.5 mu m.
Automatic quantifying and monitoring follow-ups for implantable collamer lens implantation using AS-OCT images

Yiming Sun,Jinhao Li,Peifang Xu,Pengjie Chen,Yaqi Wang,Shaodan Hu,Gangyong Jia,Shuai Wang,Juan Ye

DOI: https://doi.org/10.3389/fphy.2022.969683

IF: 3.718

2022-08-30

Frontiers in Physics

Abstract:Purpose: To develop a deep learning method to automatically monitor the implantable collamer lens (ICL) position and quantify subtle alterations in the anterior chamber using anterior segment optical coherence tomography (AS-OCT) images for high myopia patients with ICL implantation. Methods: In this study, 798 AS-OCT images of 203 patients undergoing ICL implantation at our eye center from April 2017 to June 2021 were involved. A deep learning system was developed to first isolate the corneoscleral, ICL, and lens, and then quantify clinical important parameters in AS-OCT images (central corneal thickness, anterior chamber depth, and lens vault). Results: The deep learning system was able to accurately isolate the corneoscleral, ICL, and lens with the Dice coefficient ranging from 0.911 to 0.960, and all the F1 scores >0.900 . The relative error between automated measurements and the ground truth for 95% (188 images out of 198) of LVs was within 10%. Intraclass correlation coefficients (ICCs) of the machine-ground truth measurements ranged from 0.928 to 0.995. The deep learning method also showed better repeatability than human graders. Conclusion: The deep learning method provides reliable detection and quantification of AS-OCT scans for postoperative ICL implantation, which can simplify and optimize the management of clinical outcomes of ICL implantations. Also, this is a step towards an objective measurement of the postoperative vault, making the data more comparable and repeatable to each other.

physics, multidisciplinary
A Deep Learning Model for Automatically Quantifying the Anterior Segment in Ultrasound Biomicroscopy Images of Implantable Collamer Lens Candidates

Jian Zhu,Yulin Yan,Weiyan Jiang,Shaowei Zhang,Xiaoguang Niu,Shanshan Wan,Yuyu Cong,Xiao Hu,Biqin Zheng,Yanning Yang

DOI: https://doi.org/10.1016/j.ultrasmedbio.2024.05.004

Abstract:Objective: This study aimed to develop and evaluate a deep learning-based model that could automatically measure anterior segment (AS) parameters on preoperative ultrasound biomicroscopy (UBM) images of implantable Collamer lens (ICL) surgery candidates. Methods: A total of 1164 panoramic UBM images were preoperatively obtained from 321 patients who received ICL surgery in the Eye Center of Renmin Hospital of Wuhan University (Wuhan, China) to develop an imaging database. First, the UNet++ network was utilized to segment AS tissues automatically, such as corneal lens and iris. In addition, image processing techniques and geometric localization algorithms were developed to automatically identify the anatomical landmarks (ALs) of pupil diameter (PD), anterior chamber depth (ACD), angle-to-angle distance (ATA), and sulcus-to-sulcus distance (STS). Based on the results of the latter two processes, PD, ACD, ATA, and STS can be measured. Meanwhile, an external dataset of 294 images from Huangshi Aier Eye Hospital was employed to further assess the model's performance in other center. Lastly, a subset of 100 random images from the external test set was chosen to compare the performance of the model with senior experts. Results: Whether in the internal test dataset or external test dataset, using manual labeling as the reference standard, the models achieved a mean Dice coefficient exceeding 0.880. Additionally, the intra-class correlation coefficients (ICCs) of ALs' coordinates were all greater than 0.947, and the percentage of Euclidean distance distribution of ALs within 250 μm was over 95.24%.While the ICCs for PD, ACD, ATA, and STS were greater than 0.957, furthermore, the average relative error (ARE) of PD, ACD, ATA, and STS were below 2.41%. In terms of human versus machine performance, the ICCs between the measurements performed by the model and those by senior experts were all greater than 0.931. Conclusion: A deep learning-based model could measure AS parameters using UBM images of ICL candidates, and exhibited a performance similar to that of a senior ophthalmologist.
A Novel Automatic Morphologic Analysis of Eyelids Based on Deep Learning Methods

Jing Cao,Lixia Lou,Kun You,Zhiyuan Gao,Kai Jin,Ji Shao,Juan Ye

DOI: https://doi.org/10.1080/02713683.2021.1908569

2021-01-01

Current Eye Research

Abstract:Purpose: To propose a deep-learning-based approach to automatically and objectively evaluate morphologic eyelid features using two-dimensional(2D) digital photographs and to assess the agreement between automatic and manual measurements. Materials and Methods: The 2D photographs of 1378 normal Asian participants (2756 eyes) were included for training, validating and testing the cornea and eyelid segmentation network. Margin reflex distance 1 (MRD1) and margin reflex distance 2 (MRD2) of 406 eyes from 203 participants were manually evaluated by 3 ophthalmologists and the photographs of 406 eyes were measured automatically for 8 morphologic eyelid features. The Spearman's correlation coefficient, intra-class correlation coefficient (ICC) and Bland-Altman analyses were used to determine the agreement between manual and automatic MRDs. Results: The dice coefficient was 0.922 and 0.974 for eyelid and cornea segmentation, respectively. A strong correlation was shown between manually and automatically measured MRD1 (r = 0.993, ICC = 0.996) and MRD2 (r = 0.950, ICC = 0.974). Bland-Altman analyses also showed excellent reliability with bias being 0.04 mmbetween automated and manual MRD1 measurements and 0.06 mm for MRD2. Automatically measured 8 features (MRD1, MRD2, palpebral fissure, medial area, lateral area, cornea area, upper and lower eyelid lengths) were found to be increased with age and peaked around the age range of 21 to 30 years. Conclusions: The proposed novel integrative analysis scheme was comparable with human performance. The approach with excellent reliability and reproductivity showed great potential for automated diagnosis and remote monitoring of eyelid-related diseases.
Deep Learning Algorithms to Isolate and Quantify the Structures of the Anterior Segment in Optical Coherence Tomography Images

Tan Hung Pham,Sripad Krishna Devalla,Aloysius Ang,Soh Zhi Da,Alexandre H. Thiery,Craig Boote,Ching-Yu Cheng,Victor Koh,Michael J. A. Girard

DOI: https://doi.org/10.48550/arXiv.1909.00331

2019-09-01

Abstract:Accurate isolation and quantification of intraocular dimensions in the anterior segment (AS) of the eye using optical coherence tomography (OCT) images is important in the diagnosis and treatment of many eye diseases, especially angle closure glaucoma. In this study, we developed a deep convolutional neural network (DCNN) for the localization of the scleral spur, and the segmentation of anterior segment structures (iris, corneo-sclera shell, anterior chamber). With limited training data, the DCNN was able to detect the scleral spur on unseen ASOCT images as accurately as an experienced ophthalmologist; and simultaneously isolated the anterior segment structures with a Dice coefficient of 95.7%. We then automatically extracted eight clinically relevant ASOCT parameters and proposed an automated quality check process that asserts the reliability of these parameters. When combined with an OCT machine capable of imaging multiple radial sections, the algorithms can provide a more complete objective assessment. This is an essential step toward providing a robust automated framework for reliable quantification of ASOCT scans, for applications in the diagnosis and management of angle closure glaucoma.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
Integrating a Fundus Camera with High-Frequency Ultrasound for Precise Ocular Lesion Assessment

Alfa Rossi,Yushun Zeng,Mojtaba Rahimi,Taeyoon Son,Michael J Heiferman,Chen Gong,Xin Sun,Mohammad Soleimani,Ali R Djalilian,Mark S Humayun,Qifa Zhou,Xincheng Yao

DOI: https://doi.org/10.3390/bios14030127

2024-02-29

Abstract:Ultrasound A-scan is an important tool for quantitative assessment of ocular lesions. However, its usability is limited by the difficulty of accurately localizing the ultrasound probe to a lesion of interest. In this study, a transparent LiNbO3 single crystal ultrasound transducer was fabricated, and integrated with a widefield fundus camera to guide the ultrasound local position. The electrical impedance, phase spectrum, pulse-echo performance, and optical transmission spectrum of the ultrasound transducer were validated. The novel fundus camera-guided ultrasound probe was tested for in vivo measurement of rat eyes. Anterior and posterior segments of the rat eye could be unambiguously differentiated with the fundus photography-guided ultrasound measurement. A model eye was also used to verify the imaging performance of the prototype device in the human eye. The prototype shows the potential of being used in the clinic to accurately measure the thickness and echogenicity of ocular lesions in vivo.
Towards Deep Learning Guided Autonomous Eye Surgery Using Microscope and iOCT Images

Ji Woong Kim,Shuwen Wei,Peiyao Zhang,Peter Gehlbach,Jin U. Kang,Iulian Iordachita,Marin Kobilarov

2023-07-27

Abstract:Recent advancements in retinal surgery have paved the way for a modern operating room equipped with a surgical robot, a microscope, and intraoperative optical coherence tomography (iOCT)- a depth sensor widely used in retinal surgery. Integrating these tools raises the fundamental question of how to effectively combine them to enable surgical autonomy. In this work, we tackle this question by developing a unified framework that facilitates real-time autonomous surgical workflows leveraging these devices. The system features: (1) a novel imaging system that integrates the microscope and iOCT in real-time by dynamically tracking the surgical instrument via a small iOCT scanning region, providing real-time depth feedback; (2) implementation of convolutional neural networks (CNN) that automatically detect and segment task-relevant information for surgical autonomy; (3) intuitive selection of goal waypoints within both the microscope and iOCT views through simple mouse-click interactions; and (4) integration of model predictive control (MPC) for trajectory generation, ensuring patient safety by implementing safety-related kinematic constraints. The system's utility is demonstrated by automating subretinal injection (SI), a challenging procedure with high accuracy and depth perception requirements. We validate our system by conducting 30 successful SI trials on pig eyes, achieving mean needle insertion accuracy of 26 micrometers to various subretinal goals and mean duration of 55 seconds. Preliminary comparisons to a human operator performing SI in robot-assisted mode highlight the enhanced safety of our system. Project website is here: <a class="link-external link-https" href="https://sites.google.com/view/eyesurgerymicroscopeoct/home" rel="external noopener nofollow">this https URL</a>

Robotics
Automatic measurement of anterior chamber angle parameters in AS-OCT images using deep learning

Guangqian Yang,Kaiwen Li,Jinhan Yao,Shuimiao Chang,Chong He,Fang Lu,Xiaogang Wang,Zhao Wang

DOI: https://doi.org/10.1364/boe.481419

IF: 3.4

2023-03-02

Biomedical Optics Express

Abstract:The early assessment of angle closure is of great significance for the timely diagnosis and treatment of primary angle-closure glaucoma (PACG). Anterior segment optical coherence tomography (AS-OCT) provides a fast and non-contact way to evaluate the angle close using the iris root (IR) and scleral spur (SS) information. The objective of this study was to develop a deep learning method to automatically detect IR and SS in AS-OCT for measuring anterior chamber (AC) angle parameters including angle opening distance (AOD), trabecular iris space area (TISA), trabecular iris angle (TIA), and anterior chamber angle (ACA). 3305 AS-OCT images from 362 eyes and 203 patients were collected and analyzed. Based on the recently proposed transformer-based architecture that learns to capture long-range dependencies by leveraging the self-attention mechanism, a hybrid convolutional neural network (CNN) and transformer model to encode both local and global features was developed to automatically detect IR and SS in AS-OCT images. Experiments demonstrated that our algorithm achieved a significantly better performance than state-of-the-art methods for AS-OCT and medical image analysis with a precision of 0.941, a sensitivity of 0.914, an F1 score of 0.927, and a mean absolute error (MAE) of 37.1±25.3 μm for IR, and a precision of 0.805, a sensitivity of 0.847, an F1 score of 0.826, and an MAE of 41.4±29.4 μm for SS, and a high agreement with expert human analysts for AC angle parameter measurement. We further demonstrated the application of the proposed method to evaluate the effect of cataract surgery with IOL implantation in a PACG patient and to assess the outcome of ICL implantation in a patient with high myopia with a potential risk of developing PACG. The proposed method can accurately detect IR and SS in AS-OCT images and effectively facilitate the AC angle parameter measurement for pre- and post-operative management of PACG.

radiology, nuclear medicine & medical imaging,biochemical research methods,optics
Intelligent cataract surgery supervision and evaluation via deep learning

Ting Wang,Jun Xia,Ruiyang Li,Ruixin Wang,Nick Stanojcic,Ji-Peng Olivia Li,Erping Long,Jinghui Wang,Xiayin Zhang,Jianbin Li,Xiaohang Wu,Zhenzhen Liu,Jingjing Chen,Hui Chen,Danyao Nie,Huanqi Ni,Ruoxi Chen,Wenben Chen,Shiyi Yin,Duru Lin,Pisong Yan,Zeyang Xia,Shengzhi Lin,Kai Huang,Haotian Lin

DOI: https://doi.org/10.1016/j.ijsu.2022.106740

2022-01-01

Abstract:Purpose: To assess the performance of a deep learning (DL) algorithm for evaluating and supervising cataract extraction using phacoemulsification with intraocular lens (IOL) implantation based on cataract surgery (CS) videos.Materials and methods: DeepSurgery was trained using 186 standard CS videos to recognize 12 CS steps and was validated in two datasets that contained 50 and 21 CS videos, respectively. A supervision test including 50 CS videos was used to assess the DeepSurgery guidance and alert function. In addition, a real-time test containing 54 CSs was used to compare the DeepSurgery grading performance to an expert panel and residents.Results: DeepSurgery achieved stable performance for all 12 recognition steps, including the duration between two pairs of adjacent steps in internal validation with an ACC of 95.06% and external validations with ACCs of 88.77% and 88.34%. DeepSurgery also recognized the chronology of surgical steps and alerted surgeons to order of incorrect steps. Six main steps are automatically and simultaneously quantified during the evaluation process (centesimal system). In a real-time comparative test, the DeepSurgery step recognition performance was robust (ACC of 90.30%). In addition, DeepSurgery and an expert panel achieved comparable performance when assessing the surgical steps (kappa ranged from 0.58 to 0.77).Conclusions: DeepSurgery represents a potential approach to provide a real-time supervision and an objective surgical evaluation system for routine CS and to improve surgical outcomes.
Angle-Closure Detection in Anterior Segment OCT based on Multi-Level Deep Network

Huazhu Fu,Yanwu Xu,Stephen Lin,Damon Wing Kee Wong,Mani Baskaran,Meenakshi Mahesh,Tin Aung,Jiang Liu

DOI: https://doi.org/10.1109/TCYB.2019.2897162

2019-02-10

Abstract:Irreversible visual impairment is often caused by primary angle-closure glaucoma, which could be detected via Anterior Segment Optical Coherence Tomography (AS-OCT). In this paper, an automated system based on deep learning is presented for angle-closure detection in AS-OCT images. Our system learns a discriminative representation from training data that captures subtle visual cues not modeled by handcrafted features. A Multi-Level Deep Network (MLDN) is proposed to formulate this learning, which utilizes three particular AS-OCT regions based on clinical priors: the global anterior segment structure, local iris region, and anterior chamber angle (ACA) patch. In our method, a sliding window based detector is designed to localize the ACA region, which addresses ACA detection as a regression task. Then, three parallel sub-networks are applied to extract AS-OCT representations for the global image and at clinically-relevant local regions. Finally, the extracted deep features of these sub-networks are concatenated into one fully connected layer to predict the angle-closure detection result. In the experiments, our system is shown to surpass previous detection methods and other deep learning systems on two clinical AS-OCT datasets.

Computer Vision and Pattern Recognition
Automated detection of steps in videos of strabismus surgery using deep learning

Ce Zheng,Wen Li,Siying Wang,Haiyun Ye,Kai Xu,Wangyi Fang,Yanli Dong,Zilei Wang,Tong Qiao

DOI: https://doi.org/10.1186/s12886-024-03504-8

IF: 2.086

2024-06-12

BMC Ophthalmology

Abstract:Learning to perform strabismus surgery is an essential aspect of ophthalmologists' surgical training. Automated classification strategy for surgical steps can improve the effectiveness of training curricula and the efficient evaluation of residents' performance. To this end, we aimed to develop and validate a deep learning (DL) model for automated detecting strabismus surgery steps in the videos.

ophthalmology
Automatic Classification of Anterior Chamber Angle Based on Ultrasound Biomicroscopy Images

Jian Yu,Wanyue Li,Qian Chen,Guohua Deng,Chunhui Jiang,Guangxing Liu,Guohua Shi,Xinghuai Sun

DOI: https://doi.org/10.1159/000510924

2021-01-01

Ophthalmic Research

Abstract:Introduction: Evaluating the anterior chamber angle (ACA) is important for the early diagnosis and treatment of primary angle-closure glaucoma. The assessment of ultrasound biomicroscopy (UBM) images usually requires well-trained ophthalmologists and screening for patients with narrow ACA is usually time- and labor-intensive. Therefore, the automatic assessment of UBM could be cost-effective and valuable in daily practice. Objective: The objective of this study is to develop an automatic method for localizing and classifying ACA based on UBM images. Methods: UBM images were collected and a coarse-to-fine method was used to localize the apex of the angle recess. By analyzing the grayscale features around the angle recess, closed angles were identified, and the rest were then classified as open or narrow angles, based on the degree of ACA. Using manual classification as the reference standard, the overall accuracy (OAcc), sensitivity (Sen), specificity (Spe), and balanced accuracy of the automatic classification method were evaluated. Results: A total of 540 UBM images from 290 participants were analyzed. Using these UBM images and the proposed method, the ACA was classified as open, narrow, or closed. During processing, the method localized the angle recess with 95% accuracy. The OAcc of the ACA classification was 77.8%, and the Spe and Sen of our method were 85.8 and 81.7% for angle closure; 88.9 and 75.6% for open angles; 91.9 and 76.1% for narrow angles, respectively. Conclusions: Our method of automatic angle localization and classification based on UBM images is feasible and reliable. The automatic classification of ACA provides a basis and reference for future studies. (C) 2020 S. Karger AG, Basel
Automated segmentation of macular edema for the diagnosis of ocular disease using deep learning method

Zhenhua Wang,Yuanfu Zhong,Mudi Yao,Yan Ma,Wenping Zhang,Chaopeng Li,Zhifu Tao,Qin Jiang,Biao Yan

DOI: https://doi.org/10.1038/s41598-021-92458-8

IF: 4.6

2021-06-28

Scientific Reports

Abstract:Abstract Macular edema is considered as a major cause of visual loss and blindness in patients with ocular fundus diseases. Optical coherence tomography (OCT) is a non-invasive imaging technique, which has been widely applied for diagnosing macular edema due to its non-invasive and high resolution properties. However, the practical applications remain challenges due to the distorted retinal morphology and blurred boundaries near macular edema. Herein, we developed a novel deep learning model for the segmentation of macular edema in OCT images based on DeepLab framework (OCT-DeepLab). In this model, we used atrous spatial pyramid pooling (ASPP) to detect macular edema at multiple features and used the fully connected conditional random field (CRF) to refine the boundary of macular edema. OCT-DeepLab model was compared against the traditional hand-crafted methods (C-V and SBG) and the end-to-end methods (FCN, PSPnet, and U-net) to estimate the segmentation performance. OCT-DeepLab showed great advantage over the hand-crafted methods (C-V and SBG) and end-to-end methods (FCN, PSPnet, and U-net) as shown by higher precision, sensitivity, specificity, and F1-score. The segmentation performance of OCT-DeepLab was comparable to that of manual label, with an average area under the curve (AUC) of 0.963, which was superior to other end-to-end methods (FCN, PSPnet, and U-net). Collectively, OCT-DeepLab model is suitable for the segmentation of macular edema and assist ophthalmologists in the management of ocular disease.

multidisciplinary sciences
Automated Identification of Clinically Relevant Regions in Glaucoma OCT Reports Using Expert Eye Tracking Data and Deep Learning

Ye Tian,Anurag Sharma,Shubh Mehta,Shubham Kaushal,Jeffrey M Liebmann,George A Cioffi,Kaveri A Thakoor

DOI: https://doi.org/10.1167/tvst.13.10.24

2024-10-01

Abstract:Purpose: To propose a deep learning-based approach for predicting the most-fixated regions on optical coherence tomography (OCT) reports using eye tracking data of ophthalmologists, assisting them in finding medically salient image regions. Methods: We collected eye tracking data of ophthalmology residents, fellows, and faculty as they viewed OCT reports to detect glaucoma. We used a U-Net model as the deep learning backbone and quantized eye tracking coordinates by dividing the input report into an 11 × 11 grid. The model was trained to predict the grids on which fixations would land in unseen OCT reports. We investigated the contribution of different variables, including the viewer's level of expertise, model architecture, and number of eye gaze patterns included in training. Results: Our approach predicted most-fixated regions in OCT reports with precision of 0.723, recall of 0.562, and f1-score of 0.609. We found that using a grid-based eye tracking structure enabled efficient training and using a U-Net backbone led to the best performance. Conclusions: Our approach has the potential to assist ophthalmologists in diagnosing glaucoma by predicting the most medically salient regions on OCT reports. Our study suggests the value of eye tracking in guiding deep learning algorithms toward informative regions when experts may not be accessible. Translational relevance: By suggesting important OCT report regions for a glaucoma diagnosis, our model could aid in medical education and serve as a precursor for self-supervised deep learning approaches to expedite early detection of irreversible vision loss owing to glaucoma.
Detection of Shallow Anterior Chamber Depth from Two-Dimensional Anterior Segment Photographs Using Deep Learning

Zhuyun Qian,Xiaoling Xie,Jianlong Yang,Hongfei Ye,Zhilei Wang,Jili Chen,Hui Liu,Jianheng Liang,Lihong Jiang,Ce Zheng,Xu Chen

DOI: https://doi.org/10.1186/s12886-021-02104-0

IF: 2.086

2021-01-01

BMC Ophthalmology

Abstract:Background: The purpose of this study was to implement and evaluate a deep learning (DL) approach for automatically detecting shallow anterior chamber depth (ACD) from two-dimensional (2D) overview anterior segment photographs. Methods: We trained a DL model using a dataset of anterior segment photographs collected from Shanghai Aier Eye Hospital from June 2018 to December 2019. A Pentacam HR system was used to capture a 2D overview eye image and measure the ACD. Shallow ACD was defined as ACD less than 2.4 mm. The DL model was evaluated by a five-fold cross-validation test in a hold-out testing dataset. We also evaluated the DL model by testing it against two glaucoma specialists. The performance of the DL model was calculated by metrics, including accuracy, sensitivity, specificity, and area under the receiver operating characteristic curve (AUC). Results: A total of 3753 photographs (1720 shallow AC and 2033 deep AC images) were assigned to the training dataset, and 1302 photographs (509 shallow AC and 793 deep AC images) were held out for two internal testing datasets. In detecting shallow ACD in the internal hold-out testing dataset, the DL model achieved an AUC of 0.86 (95% CI, 0.83-0.90) with 80% sensitivity and 79% specificity. In the same testing dataset, the DL model also achieved better performance than the two glaucoma specialists (accuracy of 80% vs. accuracy of 74 and 69%). Conclusions: We proposed a high-performing DL model to automatically detect shallow ACD from overview anterior segment photographs. Our DL model has potential applications in detecting and monitoring shallow ACD in the real world.
Automated classification of angle-closure mechanisms based on anterior segment optical coherence tomography images via deep learning

Ye Zhang,Xiaoyue Zhang,Qing Zhang,Bin Lv,Man Hu,Chuanfeng Lv,Yuan Ni,Guotong Xie,Shuning Li,Nazlee Zebardast,Yusrah Shweikh,Ningli Wang

DOI: https://doi.org/10.1016/j.heliyon.2024.e35236

IF: 3.776

2024-07-26

Heliyon

Abstract:Purpose: To develop and validate deep learning algorithms that can identify and classify angle-closure (AC) mechanisms using anterior segment optical coherence tomography (AS-OCT) images. Methods: This cross-sectional study included participants of the Handan Eye Study aged ≥35 years with AC detected via gonioscopy or on the AS-OCT images. These images were classified by human experts into the following to indicate the predominant AC mechanism (ground truth): pupillary block, plateau iris configuration, or thick peripheral iris roll. A deep learning architecture, known as comprehensive mechanism decision net (CMD-Net), was developed to simulate the identification of image-level AC mechanisms by human experts. Cross-validation was performed to optimize and evaluate the model. Human-machine comparisons were conducted using a held-out and separate test sets to establish generalizability. Results: In total, 11,035 AS-OCT images of 1455 participants (2833 eyes) were included. Among these, 8828 and 2.207 images were included in the cross-validation and held-out test sets, respectively. A separate test was formed comprising 228 images of 35 consecutive patients with AC detected via gonioscopy at our eye center. In the classification of AC mechanisms, CMD-Net achieved a mean area under the receiver operating characteristic curve (AUC) of 0.980, 0.977, and 0.988 in the cross-validation, held-out, and separate test sets, respectively. The best-performing ophthalmologist achieved an AUC of 0.903 and 0.891 in the held-out and separate test sets, respectively. And CMD-Net outperformed glaucoma specialists, achieving an accuracy of 89.9 % and 93.0 % compared to 87.0 % and 86.8 % for the best-performing ophthalmologist in the held-out and separate test sets, respectively. Conclusions: Our study suggests that CMD-Net has the potential to classify AC mechanisms using AS-OCT images, though further validation is needed.
Smartphone-Acquired Anterior Segment Images for Deep Learning Prediction of Anterior Chamber Depth: A Proof-of-Concept Study

Chaoxu Qian,Yixing Jiang,Zhi Da Soh,Ganesan Sakthi Selvam,Shuyuan Xiao,Yih-Chung Tham,Xinxing Xu,Yong Liu,Jun Li,Hua Zhong,Ching-Yu Cheng

DOI: https://doi.org/10.3389/fmed.2022.912214

IF: 3.9

2022-06-23

Frontiers in Medicine

Abstract:Purpose To develop a deep learning (DL) algorithm for predicting anterior chamber depth (ACD) from smartphone-acquired anterior segment photographs. Methods For algorithm development, we included 4,157 eyes from 2,084 Chinese primary school students (aged 11–15 years) from Mojiang Myopia Progression Study (MMPS). All participants had with ACD measurement measured with Lenstar (LS 900) and anterior segment photographs acquired from a smartphone (iPhone Xs), which was mounted on slit lamp and under diffuses lighting. The anterior segment photographs were randomly selected by person into training (80%, no. of eyes = 3,326) and testing (20%, no. of eyes = 831) dataset. We excluded participants with intraocular surgery history or pronounced corneal haze. A convolutional neural network was developed to predict ACD based on these anterior segment photographs. To determine the accuracy of our algorithm, we measured the mean absolute error (MAE) and coefficient of determination ( R 2 ) were evaluated. Bland Altman plot was used to illustrate the agreement between DL-predicted and measured ACD values. Results In the test set of 831 eyes, the mean measured ACD was 3.06 ± 0.25 mm, and the mean DL-predicted ACD was 3.10 ± 0.20 mm. The MAE was 0.16 ± 0.13 mm, and R 2 was 0.40 between the predicted and measured ACD. The overall mean difference was −0.04 ± 0.20 mm, with 95% limits of agreement ranging between −0.43 and 0.34 mm. The generated saliency maps showed that the algorithm mainly utilized central corneal region (i.e., the site where ACD is clinically measured typically) in making its prediction, providing further plausibility to the algorithm's prediction. Conclusions We developed a DL algorithm to estimate ACD based on smartphone-acquired anterior segment photographs. Upon further validation, our algorithm may be further refined for use as a ACD screening tool in rural localities where means of assessing ocular biometry is not readily available. This is particularly important in China where the risk of primary angle closure disease is high and often undetected.

medicine, general & internal

Automatic Localization of the Scleral Spur Using Deep Learning and Ultrasound Biomicroscopy.

A Three-Dimensional Measurement Method for Binocular Endoscopes Based on Deep Learning

Deep Neural Network for Scleral Spur Detection in Anterior Segment OCT Images: The Chinese American Eye Study

Automatic Anterior Chamber Angle Classification Using Deep Learning System and Anterior Segment Optical Coherence Tomography Images

Needle Detection and Localisation for Robot‐assisted Subretinal Injection Using Deep Learning

Automatic quantifying and monitoring follow-ups for implantable collamer lens implantation using AS-OCT images

A Deep Learning Model for Automatically Quantifying the Anterior Segment in Ultrasound Biomicroscopy Images of Implantable Collamer Lens Candidates

A Novel Automatic Morphologic Analysis of Eyelids Based on Deep Learning Methods

Deep Learning Algorithms to Isolate and Quantify the Structures of the Anterior Segment in Optical Coherence Tomography Images

Integrating a Fundus Camera with High-Frequency Ultrasound for Precise Ocular Lesion Assessment

Towards Deep Learning Guided Autonomous Eye Surgery Using Microscope and iOCT Images

Automatic measurement of anterior chamber angle parameters in AS-OCT images using deep learning

Intelligent cataract surgery supervision and evaluation via deep learning

Angle-Closure Detection in Anterior Segment OCT based on Multi-Level Deep Network

Automated detection of steps in videos of strabismus surgery using deep learning

Automatic Classification of Anterior Chamber Angle Based on Ultrasound Biomicroscopy Images

Automated segmentation of macular edema for the diagnosis of ocular disease using deep learning method

Automated Identification of Clinically Relevant Regions in Glaucoma OCT Reports Using Expert Eye Tracking Data and Deep Learning

Detection of Shallow Anterior Chamber Depth from Two-Dimensional Anterior Segment Photographs Using Deep Learning

Automated classification of angle-closure mechanisms based on anterior segment optical coherence tomography images via deep learning

Smartphone-Acquired Anterior Segment Images for Deep Learning Prediction of Anterior Chamber Depth: A Proof-of-Concept Study