Abstract:Purpose: Segmentation and evaluation of in vivo confocal microscopy (IVCM) images requires manual intervention, which is time consuming, laborious, and non-reproducible. The aim of this research was to develop and validate deep learning-based methods that could automatically segment and evaluate corneal nerve fibers (CNFs) and dendritic cells (DCs) in IVCM images, thereby reducing processing time to analyze larger volumes of clinical images.Methods: CNF and DC segmentation models were developed based on U-Net and Mask R-CNN architectures, respectively; 10-fold cross-validation was used to evaluate both models. The CNF model was trained and tested using 1097 and 122 images, and the DC model was trained and tested using 679 and 75 images, respectively, at each fold. The CNF morphology, number of nerves, number of branching points, nerve length, and tortuosity were analyzed; for DCs, number, size, and immature-mature cells were analyzed. Python-based software was written for model training, testing, and automatic morphometric parameters evaluation.Results: The CNF model achieved on average 86.1% sensitivity and 90.1% specificity, and the DC model achieved on average 89.37% precision, 94.43% recall, and 91.83% F1 score. The interclass correlation coefficient (ICC) between manual annotation and automatic segmentation were 0.85, 0.87, 0.95, and 0.88 for CNF number, length, branching points, and tortuosity, respectively, and the ICC for DC number and size were 0.95 and 0.92, respectively.Conclusions: Our proposed methods demonstrated reliable consistency between manual annotation and automatic segmentation of CNF and DC with rapid speed. The results showed that these approaches have the potential to be implemented into clinical practice in IVCM images.Translational Relevance: The deep learning-based automatic segmentation and quantification algorithm significantly increases the efficiency of evaluating IVCM images, thereby supporting and potentially improving the diagnosis and treatment of ocular surface disease associated with corneal nerves and dendritic cells.

An Improved U-Net for Nerve Fibre Segmentation in Confocal Corneal Microscopy Images

Multi-scale and local feature guidance network for corneal nerve fiber segmentation

Multi-Discriminator Adversarial Convolutional Network for Nerve Fiber Segmentation in Confocal Corneal Microscopy Images.

Automated Segmentation of Corneal Nerves in Confocal Microscopy Via Contrastive Learning Based Synthesis and Quality Enhancement.

Automatic Corneal Nerve Fiber Segmentation and Geometric Biomarker Quantification

Corneal Nerve Fiber Segmentation and Centerline Extraction

A Deep Learning Model for Automated Sub-Basal Corneal Nerve Segmentation and Evaluation Using in Vivo Confocal Microscopy

Segmentation and Evaluation of Corneal Nerves and Dendritic Cells From In Vivo Confocal Microscopy Images Using Deep Learning

Semi-supervised Learning for Nerve Segmentation in Corneal Confocal Microscope Photography

Artificial Intelligence Analysis of Nerve Fibers Based on Corneal Confocal Microscopy

Automatic analysis of diabetic peripheral neuropathy using multi-scale quantitative morphology of nerve fibres in corneal confocal microscopy imaging

U-NTCA: nnUNet and nested transformer with channel attention for corneal cell segmentation

Joint Optic Disc and Cup Segmentation Based on Multi-Module U-shaped Network

A Robust Segmentation Method Based on Improved U-Net

NerveStitcher: Corneal Confocal Microscope Images Stitching with Neural Networks

Automatic Segmentation of Retinal Edema in Optical Coherence Tomography Based on Deep Neural Networks

Full Convolutional Neural Network with Multi-Scale Residual Model for Optic Cup and Disc Segmentation.

Patch-Based Deep Convolutional Neural Network for Corneal Ulcer Area Segmentation.

Fully convolutional architecture vs sliding-window CNN for corneal endothelium cell segmentation

Centerline extraction by neighborhood-statistics thinning for quantitative analysis of corneal nerve fibers

EE-Net: an Edge-Enhanced Deep Learning Network for Jointly Identifying Corneal Micro-Layers from Optical Coherence Tomography