Abstract:Weakly supervised learning, releasing deep learning from highly labor-intensive pixel-wise annotations, has gained great attention, especially for medical image segmentation. With only image-level labels, pixel-wise segmentation/localization usually is achieved based on class activation maps (CAMs) containing the most dis-criminative regions. One common consequence of CAM-based approaches is incomplete foreground segmentation, i.e. under-segmentation/false negatives. Meanwhile, suffering from relatively limited medical imaging data, class-irrelevant tissues can hardly be suppressed during classification, resulting in incorrect background identification, i.e. over-segmentation/false positives. The above two issues are determined by the loose-constraint nature of image-level labels penalizing on the entire image space, and thus how to develop pixel-wise constraints based on image-level labels is the key for performance improvement which is under-explored. In this paper, based on unsupervised clustering, we propose a new paradigm called cluster-re-supervision to evaluate the contribution of each pixel in CAMs to final classification and thus generate pixel-wise supervision (i.e., clustering maps) for CAMs refinement on both over- and under-segmentation reduction. Further-more, based on self-supervised learning, an inter-modality image reconstruction module, together with random masking, is designed to complement local information in feature learning which helps stabilize clustering. Experimental results on two popular public datasets demonstrate the superior performance of the proposed weakly-supervised frame-work for medical image segmentation. More importantly, cluster-re-supervision is independent of specific tasks and highly extendable to other applications. The source code of this paper is publicly available at https://github.com/ HustAlexander/Cluster-Re-Supervision.

GraphCL: Graph-based Clustering for Semi-Supervised Medical Image Segmentation

3D Graph-S<SUP>2</SUP>Net: Shape-Aware Self-ensembling Network for Semi-supervised Segmentation with Bilateral Graph Convolution

Graph-BAS3Net: Boundary-Aware Semi-Supervised Segmentation Network with Bilateral Graph Convolution

Graph-Based Medical Image Clustering

An image segmentation method based on Simple Linear Iterative Clustering and graph-based semi-supervised learning

Semi-Supervised Medical Image Semantic Segmentation with Multi-scale Graph Cut Loss

Graph-Based Semi-Supervised Deep Image Clustering With Adaptive Adjacency Matrix

Medical Image Retrieval by Graph-based Semi-supervised Learning

Semi-supervised Classification Using Multiple Clusterings

Affinity-Graph-Guided Contractive Learning for Pretext-Free Medical Image Segmentation with Minimal Annotation

Graph-based Semi-Supervised Learning Framework for Medical Image Retrieval

Medical Image Clustering Algorithm Based on Graph Model

Advancing MRI Segmentation with CLIP-driven Semi-Supervised Learning and Semantic Alignment

A Spatial Guided Self-supervised Clustering Network for Medical Image Segmentation

Graph-based Learning for Segmentation of 3D Ultrasound Images.

Semi-Supervised Medical Image Segmentation Via Multi-Group Network with Consistency among Heterogeneous Loss Supervision

Consensus Based Medical Image Segmentation Using Semi-Supervised Learning And Graph Cuts

An Efficient Semi-Supervised Framework with Multi-Task and Curriculum Learning for Medical Image Segmentation

Distributed contrastive learning for medical image segmentation

Cluster-Re-Supervision: Bridging the Gap Between Image-Level and Pixel-Wise Labels for Weakly Supervised Medical Image Segmentation

Graph Flow: Cross-layer Graph Flow Distillation for Dual Efficient Medical Image Segmentation