Abstract:Objective. Histopathology image segmentation can assist medical professionals in identifying and diagnosing diseased tissue more efficiently. Although fully supervised segmentation models have excellent performance, the annotation cost is extremely expensive. Weakly supervised models are widely used in medical image segmentation due to their low annotation cost. Nevertheless, these weakly supervised models have difficulty in accurately locating the boundaries between different classes of regions in pathological images, resulting in a high rate of false alarms. Our objective is to design a weakly supervised segmentation model to resolve the above problems. Approach. The segmentation model is divided into two main stages, the generation of pseudo labels based on Class Residual Attention Accumulation Network (CRAANet) and the semantic segmentation based on Pixel Feature Space Construction Network (PFSCNet). CRAANet provides attention scores for each class through the Class Residual Attention (CRA) module, while the Attention Accumulation (AA) module overlays the attention feature maps generated in each training epoch. PFSCNet employs a network model containing an inflated convolutional residual neural network and a multi-scale feature-aware module as the segmentation backbone, and proposes Dense Energy Loss (DE Loss) and Pixel Clustering (PCL) are modules based on contrast learning to solve the pseudo-labeling-inaccuracy problem. Main results. We validate our method using the lung adenocarcinoma (LUAD-HistoSeg) dataset and the breast cancer (BCSS) dataset. The results of the experiments show that our proposed method outperforms other state-of-the-art methods on both datasets in several metrics. This suggests that it is capable of performing well in a wide variety of histopathological image segmentation tasks. Significance. We propose a weakly supervised semantic segmentation network that achieves approximate fully supervised segmentation performance even in the case of incomplete labels. The proposed attention accumulation and pixel-level contrast learning also make the edges more accurate and can well assist pathologists in their research.

Weakly Supervised Histopathology Image Segmentation with Sparse Point Annotations

Weakly supervised semantic segmentation of histological tissue via attention accumulation and pixel-level contrast learning

Weakly supervised segmentation with point annotations for histopathology images via contrast-based variational model

Weakly-Supervised Semantic Segmentation for Histopathology Images Based on Dataset Synthesis and Feature Consistency Constraint.

EP-SAM: Weakly Supervised Histopathology Segmentation via Enhanced Prompt with Segment Anything

Multi-layer pseudo-supervision for histopathology tissue semantic segmentation using patch-level classification labels

A Comprehensive Analysis of Weakly-Supervised Semantic Segmentation in Different Image Domains

A deep weakly semi-supervised framework for endoscopic lesion segmentation

Using Sparse Patch Annotation for Tumor Segmentation in Histopathological Images.

Enhancing Weakly Supervised Semantic Segmentation with Multi-label Contrastive Learning and LLM Features Guidance

Weakly Supervised Deep Nuclei Segmentation Using Partial Points Annotation in Histopathology Images

TransWS: Transformer-Based Weakly Supervised Histology Image Segmentation.

Weakly supervised learning for multi-class medical image segmentation via feature decomposition

Weakly supervised histopathology image segmentation with self-attention

Semantic-Transferable Weakly-Supervised Endoscopic Lesions Segmentation

Human-machine Interactive Tissue Prototype Learning for Label-efficient Histopathology Image Segmentation

Weakly-Supervised Cross-Domain Adaptation for Endoscopic Lesions Segmentation

CAMEL: A Weakly Supervised Learning Framework for Histopathology Image Segmentation

Weakly-Supervised Cross-Domain Segmentation of Electron Microscopy with Sparse Point Annotation

Combining unsupervised constraints on weakly supervised semantic segmentation of skin cancer

TPRO: Text-Prompting-Based Weakly Supervised Histopathology Tissue Segmentation