Abstract:Purpose: Segmentation and evaluation of in vivo confocal microscopy (IVCM) images requires manual intervention, which is time consuming, laborious, and non-reproducible. The aim of this research was to develop and validate deep learning-based methods that could automatically segment and evaluate corneal nerve fibers (CNFs) and dendritic cells (DCs) in IVCM images, thereby reducing processing time to analyze larger volumes of clinical images.Methods: CNF and DC segmentation models were developed based on U-Net and Mask R-CNN architectures, respectively; 10-fold cross-validation was used to evaluate both models. The CNF model was trained and tested using 1097 and 122 images, and the DC model was trained and tested using 679 and 75 images, respectively, at each fold. The CNF morphology, number of nerves, number of branching points, nerve length, and tortuosity were analyzed; for DCs, number, size, and immature-mature cells were analyzed. Python-based software was written for model training, testing, and automatic morphometric parameters evaluation.Results: The CNF model achieved on average 86.1% sensitivity and 90.1% specificity, and the DC model achieved on average 89.37% precision, 94.43% recall, and 91.83% F1 score. The interclass correlation coefficient (ICC) between manual annotation and automatic segmentation were 0.85, 0.87, 0.95, and 0.88 for CNF number, length, branching points, and tortuosity, respectively, and the ICC for DC number and size were 0.95 and 0.92, respectively.Conclusions: Our proposed methods demonstrated reliable consistency between manual annotation and automatic segmentation of CNF and DC with rapid speed. The results showed that these approaches have the potential to be implemented into clinical practice in IVCM images.Translational Relevance: The deep learning-based automatic segmentation and quantification algorithm significantly increases the efficiency of evaluating IVCM images, thereby supporting and potentially improving the diagnosis and treatment of ocular surface disease associated with corneal nerves and dendritic cells.

Multi-Discriminator Adversarial Convolutional Network for Nerve Fiber Segmentation in Confocal Corneal Microscopy Images.

Multi-scale and local feature guidance network for corneal nerve fiber segmentation

An Improved U-Net for Nerve Fibre Segmentation in Confocal Corneal Microscopy Images

Automatic Corneal Nerve Fiber Segmentation and Geometric Biomarker Quantification

Automated Segmentation of Corneal Nerves in Confocal Microscopy Via Contrastive Learning Based Synthesis and Quality Enhancement.

Multi-Scale and Multi-Branch Convolutional Neural Network for Retinal Image Segmentation

Semi-supervised Learning for Nerve Segmentation in Corneal Confocal Microscope Photography

A Deep Learning Model for Automated Sub-Basal Corneal Nerve Segmentation and Evaluation Using in Vivo Confocal Microscopy

Corneal Nerve Fiber Segmentation and Centerline Extraction

Automatic analysis of diabetic peripheral neuropathy using multi-scale quantitative morphology of nerve fibres in corneal confocal microscopy imaging

Segmentation and Evaluation of Corneal Nerves and Dendritic Cells From In Vivo Confocal Microscopy Images Using Deep Learning

NerveStitcher: Corneal Confocal Microscope Images Stitching with Neural Networks

Joint Loss-Based Multi-decoder Network for OCT Fluid Segmentation

Centerline extraction by neighborhood-statistics thinning for quantitative analysis of corneal nerve fibers

Segmentation and multiparametric evaluation of corneal whorl-like nerves for in vivo confocal microscopy images in dry eye disease

SACNet: A Spatially Adaptive Convolution Network for 2D Multi-organ Medical Segmentation

MF-Net: Multi-Scale Information Fusion Network for CNV Segmentation in Retinal OCT Images

CNTSeg: A multimodal deep-learning-based network for cranial nerves tract segmentation

Joint Optic Disc and Cup Segmentation Based on Multi-Module U-shaped Network

An Efficient Hierarchical Optic Disc and Cup Segmentation Network Combined with Multi-task Learning and Adversarial Learning

Cascade spatial and channel-wise multifusion network with criss cross augmentation for corneal segmentation and reconstruction