Abstract:Weakly supervised learning, releasing deep learning from highly labor-intensive pixel-wise annotations, has gained great attention, especially for medical image segmentation. With only image-level labels, pixel-wise segmentation/localization usually is achieved based on class activation maps (CAMs) containing the most dis-criminative regions. One common consequence of CAM-based approaches is incomplete foreground segmentation, i.e. under-segmentation/false negatives. Meanwhile, suffering from relatively limited medical imaging data, class-irrelevant tissues can hardly be suppressed during classification, resulting in incorrect background identification, i.e. over-segmentation/false positives. The above two issues are determined by the loose-constraint nature of image-level labels penalizing on the entire image space, and thus how to develop pixel-wise constraints based on image-level labels is the key for performance improvement which is under-explored. In this paper, based on unsupervised clustering, we propose a new paradigm called cluster-re-supervision to evaluate the contribution of each pixel in CAMs to final classification and thus generate pixel-wise supervision (i.e., clustering maps) for CAMs refinement on both over- and under-segmentation reduction. Further-more, based on self-supervised learning, an inter-modality image reconstruction module, together with random masking, is designed to complement local information in feature learning which helps stabilize clustering. Experimental results on two popular public datasets demonstrate the superior performance of the proposed weakly-supervised frame-work for medical image segmentation. More importantly, cluster-re-supervision is independent of specific tasks and highly extendable to other applications. The source code of this paper is publicly available at https://github.com/ HustAlexander/Cluster-Re-Supervision.

Region-based Semi-Supervised Clustering Image Segmentation

Decompose Image into Meaningful Regions Based on Contour Detector and Watershed Algorithm

A Semi-Supervised Color Image Segmentation Method

RWMS: Reliable Weighted Multi-Phase for Semi-supervised Segmentation

Image Segmentation Based on Watershed Transform

3D Shape Segmentation Using Soft Density Peak Clustering and Semi-Supervised Learning

Semi-supervised Remote Sensing Image Segmentation Using Dynamic Region Merging.

Semi-Supervised Image Segmentation Combining Ssfcm and Random Walks

Color Image Segmentation Based on Blocks Clustering and Region Growing

Learnable Pixel Clustering Via Structure and Semantic Dual Constraints for Unsupervised Image Segmentation.

Locally Biased Discriminative Clustering Method for Interactive Image Segmentation.

Weakly Supervised Random Forest for Multi-Label Image Clustering and Segmentation

Unsupervised regions based segmentation using object discovery

Semi-Supervised 3D Shape Segmentation via Self Refining

Unsupervised image segmentation based on local pixel clustering and low-level region merging

Cluster-Re-Supervision: Bridging the Gap Between Image-Level and Pixel-Wise Labels for Weakly Supervised Medical Image Segmentation

Image Annotations Based on Semi-supervised Clustering with Semantic Soft Constraints.

Objectness Supervised Merging Algorithm for Color Image Segmentation

Incorporating Adaptive Local Information Into Fuzzy Clustering for Image Segmentation

Color Image Segmentation Based on Bitmap Cut and Region Merging

Example-Driven Semi-automatic Image Collection Segmentation