Abstract:Purpose: Segmentation and evaluation of in vivo confocal microscopy (IVCM) images requires manual intervention, which is time consuming, laborious, and non-reproducible. The aim of this research was to develop and validate deep learning-based methods that could automatically segment and evaluate corneal nerve fibers (CNFs) and dendritic cells (DCs) in IVCM images, thereby reducing processing time to analyze larger volumes of clinical images.Methods: CNF and DC segmentation models were developed based on U-Net and Mask R-CNN architectures, respectively; 10-fold cross-validation was used to evaluate both models. The CNF model was trained and tested using 1097 and 122 images, and the DC model was trained and tested using 679 and 75 images, respectively, at each fold. The CNF morphology, number of nerves, number of branching points, nerve length, and tortuosity were analyzed; for DCs, number, size, and immature-mature cells were analyzed. Python-based software was written for model training, testing, and automatic morphometric parameters evaluation.Results: The CNF model achieved on average 86.1% sensitivity and 90.1% specificity, and the DC model achieved on average 89.37% precision, 94.43% recall, and 91.83% F1 score. The interclass correlation coefficient (ICC) between manual annotation and automatic segmentation were 0.85, 0.87, 0.95, and 0.88 for CNF number, length, branching points, and tortuosity, respectively, and the ICC for DC number and size were 0.95 and 0.92, respectively.Conclusions: Our proposed methods demonstrated reliable consistency between manual annotation and automatic segmentation of CNF and DC with rapid speed. The results showed that these approaches have the potential to be implemented into clinical practice in IVCM images.Translational Relevance: The deep learning-based automatic segmentation and quantification algorithm significantly increases the efficiency of evaluating IVCM images, thereby supporting and potentially improving the diagnosis and treatment of ocular surface disease associated with corneal nerves and dendritic cells.

Image analysis of brain cortex cells in vitro using deep learning method

NeuroQuantify - An image analysis software for detection and quantification of neuron cells and neurite lengths using deep learning

NeuroQuantify -- An Image Analysis Software for Detection and Quantification of Neurons and Neurites using Deep Learning

Evaluating deep learning techniques for optimal neurons counting and characterization in complex neuronal cultures

Deep learning-based image analysis for in situ microscopic imaging of cell culture process

Segmentation and Evaluation of Corneal Nerves and Dendritic Cells From In Vivo Confocal Microscopy Images Using Deep Learning

Deep Mining of Subtle Differences in Cell Morphology Via Deep Learning

NCIS: Deep Color Gradient Maps Regression and Three-Class Pixel Classification for Enhanced Neuronal Cell Instance Segmentation in Nissl-Stained Histological Images

Automated Analysis of Neuronal Morphology in 2D Fluorescence Micrographs through an Unsupervised Semantic Segmentation of Neurons

Reliable identification and quantification of neural cells in microscopic images of neurospheres

DNeuroMAT: A Deep-Learning-Based Neuron Morphology Analysis Toolbox

Computational analysis of laminar structure of the human cortex based on local neuron features

Evaluation of Deep Learning Topcoders Method for Neuron Individualization in Histological Macaque Brain Section

A Deep Learning Model for Automated Sub-Basal Corneal Nerve Segmentation and Evaluation Using in Vivo Confocal Microscopy

Exploring Brain-wide Development of Inhibition through Deep Learning

Automatic Quantitative Analysis of Brain Organoids via Deep Learning

Real-Time Analysis of Neuronal Cell Cultures for CNS Drug Discovery

Deep-learning-based flexible pipeline for segmenting and tracking cells in 3D image time series for whole brain imaging

Using Deep Learning to Predict Neural Stem Cell Differentiation in Regenerative Medicine

Deep learning in mesoscale brain image analysis: A review

Deep Learning Automates the Quantitative Analysis of Individual Cells in Live-Cell Imaging Experiments