Abstract:Weakly supervised learning, releasing deep learning from highly labor-intensive pixel-wise annotations, has gained great attention, especially for medical image segmentation. With only image-level labels, pixel-wise segmentation/localization usually is achieved based on class activation maps (CAMs) containing the most dis-criminative regions. One common consequence of CAM-based approaches is incomplete foreground segmentation, i.e. under-segmentation/false negatives. Meanwhile, suffering from relatively limited medical imaging data, class-irrelevant tissues can hardly be suppressed during classification, resulting in incorrect background identification, i.e. over-segmentation/false positives. The above two issues are determined by the loose-constraint nature of image-level labels penalizing on the entire image space, and thus how to develop pixel-wise constraints based on image-level labels is the key for performance improvement which is under-explored. In this paper, based on unsupervised clustering, we propose a new paradigm called cluster-re-supervision to evaluate the contribution of each pixel in CAMs to final classification and thus generate pixel-wise supervision (i.e., clustering maps) for CAMs refinement on both over- and under-segmentation reduction. Further-more, based on self-supervised learning, an inter-modality image reconstruction module, together with random masking, is designed to complement local information in feature learning which helps stabilize clustering. Experimental results on two popular public datasets demonstrate the superior performance of the proposed weakly-supervised frame-work for medical image segmentation. More importantly, cluster-re-supervision is independent of specific tasks and highly extendable to other applications. The source code of this paper is publicly available at https://github.com/ HustAlexander/Cluster-Re-Supervision.

Weakly Supervised Random Forest for Multi-Label Image Clustering and Segmentation

Weakly Supervised Multilabel Clustering and Its Applications in Computer Vision

RWMS: Reliable Weighted Multi-Phase for Semi-supervised Segmentation

Cluster-Re-Supervision: Bridging the Gap Between Image-Level and Pixel-Wise Labels for Weakly Supervised Medical Image Segmentation

A Semi-Supervised Color Image Segmentation Method

Weak Supervision Learning for Object Co-Segmentation

Global Meets Local: Effective Multi-Label Image Classification Via Category-AwareWeak Supervision

A Probabilistic Associative Model For Segmenting Weakly Supervised Images

Weakly supervised learning for multi-class medical image segmentation via feature decomposition

Weakly Supervised Semantic Segmentation for Social Images

Weakly-Supervised Semantic Segmentation via Sub-category Exploration

Representative Discovery of Structure Cues for Weakly-Supervised Image Segmentation

Compound Weakly Supervised Clustering

Region-based Semi-Supervised Clustering Image Segmentation

Learning From Semi-Supervised Weak-Label Data

Weakly Supervised Multiclass Video Segmentation

Image Segmentation Based on Weakly Supervised MKL on Mixed Visual Features.

A Survey on Label-efficient Deep Image Segmentation: Bridging the Gap between Weak Supervision and Dense Prediction

Multi-Evidence Filtering and Fusion for Multi-Label Classification, Object Detection and Semantic Segmentation Based on Weakly Supervised Learning

Constrained Labeling for Weakly Supervised Learning

Simple Does It: Weakly Supervised Instance and Semantic Segmentation