Abstract:BACKGROUND: Multiphoton microscopy (MPM) offers a feasible approach for the biopsy in clinical medicine, but it has not been used in clinical applications due to the lack of efficient image processing methods, especially the automatic segmentation technology. Segmentation technology is still one of the most challenging assignments of the MPM imaging technique.METHODS: The MPM imaging segmentation model based on deep learning is one of the most effective methods to address this problem. In this paper, the practicability of using a convolutional neural network (CNN) model to segment the MPM image of skin cells in vivo was explored. A set of MPM in vivo skin cells images with a resolution of 128×128 was successfully segmented under the Python environment with TensorFlow. A novel deep-learning segmentation model named Dense-UNet was proposed. The Dense-UNet, which is based on U-net structure, employed the dense concatenation to deepen the depth of the network architecture and achieve feature reuse. This model included four expansion modules (each module consisted of four down-sampling layers) to extract features.RESULTS: Sixty training images were taken from the dorsal forearm using a femtosecond Ti:Sa laser running at 735 nm. The resolution of the images is 128×128 pixels. Experimental results confirmed that the accuracy of Dense-UNet (92.54%) was higher than that of U-Net (88.59%), with a significantly lower loss value of 0.1681. The 90.60% Dice coefficient value of Dense-UNet outperformed U-Net by 11.07%. The F1-Score of Dense-UNet, U-Net, and Seg-Net was 93.35%, 90.02%, and 85.04%, respectively.CONCLUSIONS: The deepened down-sampling path improved the ability of the model to capture cellular fined-detailed boundary features, while the symmetrical up-sampling path provided a more accurate location based on the test result. These results were the first time that the segmentation of MPM in vivo images had been adopted by introducing a deep CNN to bridge this gap in Dense-UNet technology. Dense-UNet has reached ultramodern performance for MPM images, especially for in vivo images with low resolution. This implementation supplies an automatic segmentation model based on deep learning for high-precision segmentation of MPM images in vivo.

U-Net as a deep learning-based method for platelets segmentation in microscopic images

U-Net: deep learning for cell counting, detection, and morphometry

Analysis of the performance of U-Net neural networks for the segmentation of living cells

Automatic segmentation of leukocytes images using deep learning

U-Net based vessel segmentation for murine brains with small micro-magnetic resonance imaging reference datasets

DeepSplit: Segmentation of Microscopy Images Using Multi-task Convolutional Networks

Improved Segmentation of Cellular Nuclei Using UNET Architectures for Enhanced Pathology Imaging

Image Segmentation and Classification for Sickle Cell Disease using Deformable U-Net

BloodCell-Net: A lightweight convolutional neural network for the classification of all microscopic blood cell images of the human body

A U-Net Deep Learning Framework for High Performance Vessel Segmentation in Patients With Cerebrovascular Disease

Retinal blood vessel segmentation using a deep learning method based on modified U-NET model

Edge U-Net: Brain tumor segmentation using MRI based on deep U-Net model with boundary information

A Method for Retina Segmentation by Means of U-Net Network

Scalable model for segmenting Cells' Nuclei using the U-NET architecture

U-Net-based Deep Learning for Tracking and Quantitative Analysis of Intracellular Vesicles in Time-Lapse Microscopy Images

Automated Blood Cell Detection and Counting via Deep Learning for Microfluidic Point-of-Care Medical Devices

GCT-UNET: U-Net Image Segmentation Model for a Small Sample of Adherent Bone Marrow Cells Based on a Gated Channel Transform Module

Dense-UNet: a novel multiphoton in vivo cellular image segmentation model based on a convolutional neural network

U-Net-Based Medical Image Segmentation

MixMicrobleedNet: segmentation of cerebral microbleeds using nnU-Net

Deep Multi-Scale U-Net Architecture and Label-Noise Robust Training Strategies for Histopathological Image Segmentation