Abstract:Microscopic surgical image analysis is very important in surgical skill analysis, workflow recognition, and autonomous robotic surgery. Semantic segmentation of microscopic image is a prerequisite. Currently, supervised deep convolutional neural network (CNN) has become the state-of-the-art image segmentation method. However, manual contouring of thousands of images is needed for training a supervised CNN. Semi-supervised or weakly supervised learning can greatly reduce the need for labeling, and the semantic segmentation results are also close to or slightly better than those of supervised learning. However, most existing semi-supervised methods have disadvantages of poor segmentation accuracy and poor robustness. The existing semi-supervised methods can only be close to the segmentation accuracy of the existing supervised methods, and can only be used in large-scale data sets. There are still many limitations to the use of the field. In this article, we proposed a novel semi-supervised learning method based on principle of cross-consistency in microscopic images segmentation. To leverage unlabeled images, we use consistency principle between main decoder and auxiliary decoder. The auxiliary decoder is a variety of interference examples generated by different interference functions, which can improve the accuracy and robustness of the overall output of the network. The network also has good task scalability, and has high segmentation accuracy in fields such as natural scenes and medical surgical scenes. The experimental results of the CATARACTS-Semantic-Segmentation 2020 data set proved the effectiveness of the deep neural network. The proposed method is better than the baseline model in terms of accuracy. The experimental setting 1 segmentation is increased by 1.71%, and the experimental setting 2 segmentation accuracy is improved by 22.34%.

Sequential semi-supervised segmentation for serial electron microscopy image with small number of labels

Semi-Supervised Neuron Segmentation via Reinforced Consistency Learning

Two-stage Generative Models of Simulating Training Data at the Voxel Level for Large-Scale Microscopy Bioimage Segmentation

Evaluation of semi-supervised learning using sparse labeling to segment cell nuclei

Point-supervised Segmentation of Microscopy Images and Volumes via Objectness Regularization

NeuroSeg-III: Efficient Neuron Segmentation in Two-Photon Ca2+ Imaging Data Using Self-Supervised Learning

One-shot and Partially-Supervised Cell Image Segmentation Using Small Visual Prompt

Addressing Distribution Mismatch for Effective Semi-Supervised Neuron Segmentation

OneSeg: Self-learning and One-shot Learning based Single-slice Annotation for 3D Medical Image Segmentation

Weakly-Supervised Cross-Domain Segmentation of Electron Microscopy with Sparse Point Annotation

Learning to segment microscopy images with lazy labels

Knowing What to Label for Few Shot Microscopy Image Cell Segmentation

Semi-supervised Semantic Segmentation of Cataract Surgical Images based on DeepLab v3+

Semi-MedSeq: Semi-supervised Semantic Segmentation for Medical Image Sequences.

Deep learning based supervised semantic segmentation of Electron Cryo-Subtomograms

Label-Efficient 3D Brain Segmentation via Complementary 2D Diffusion Models with Orthogonal Views

Point-supervised Single-cell Segmentation via Collaborative Knowledge Sharing

A weak-labelling and deep learning approach for in-focus object segmentation in 3D widefield microscopy

A Semi-supervised Pipeline for Accurate Neuron Segmentation with Fewer Ground Truth Labels

Semi-Supervised Segmentation of Mitochondria from Electron Microscopy Images Using Spatial Continuity

A deep learning-based strategy for producing dense 3D segmentations from sparsely annotated 2D images