Abstract:Objective. Histopathology image segmentation can assist medical professionals in identifying and diagnosing diseased tissue more efficiently. Although fully supervised segmentation models have excellent performance, the annotation cost is extremely expensive. Weakly supervised models are widely used in medical image segmentation due to their low annotation cost. Nevertheless, these weakly supervised models have difficulty in accurately locating the boundaries between different classes of regions in pathological images, resulting in a high rate of false alarms. Our objective is to design a weakly supervised segmentation model to resolve the above problems. Approach. The segmentation model is divided into two main stages, the generation of pseudo labels based on Class Residual Attention Accumulation Network (CRAANet) and the semantic segmentation based on Pixel Feature Space Construction Network (PFSCNet). CRAANet provides attention scores for each class through the Class Residual Attention (CRA) module, while the Attention Accumulation (AA) module overlays the attention feature maps generated in each training epoch. PFSCNet employs a network model containing an inflated convolutional residual neural network and a multi-scale feature-aware module as the segmentation backbone, and proposes Dense Energy Loss (DE Loss) and Pixel Clustering (PCL) are modules based on contrast learning to solve the pseudo-labeling-inaccuracy problem. Main results. We validate our method using the lung adenocarcinoma (LUAD-HistoSeg) dataset and the breast cancer (BCSS) dataset. The results of the experiments show that our proposed method outperforms other state-of-the-art methods on both datasets in several metrics. This suggests that it is capable of performing well in a wide variety of histopathological image segmentation tasks. Significance. We propose a weakly supervised semantic segmentation network that achieves approximate fully supervised segmentation performance even in the case of incomplete labels. The proposed attention accumulation and pixel-level contrast learning also make the edges more accurate and can well assist pathologists in their research.

A Comprehensive Analysis of Weakly-Supervised Semantic Segmentation in Different Image Domains

Survey of Weakly Supervised Semantic Segmentation Methods

Weakly Supervised Semantic Segmentation Based on Deep Learning

Weakly-Supervised Semantic Segmentation with Image-Level Labels: from Traditional Models to Foundation Models

Weakly Supervised Histopathology Image Segmentation with Sparse Point Annotations

Towards Single Stage Weakly Supervised Semantic Segmentation

Looking Beyond Single Images for Weakly Supervised Semantic Segmentation Learning.

Weakly-Supervised Semantic Segmentation for Histopathology Images Based on Dataset Synthesis and Feature Consistency Constraint.

A survey of semi- and weakly supervised semantic segmentation of images

A Survey of Weakly-supervised Image Semantic Segmentation Based on Image-level Labels

Point Based Weakly Supervised Deep Learning for Semantic Segmentation of Remote Sensing Images

Dual Branch Framework Using Positive and Negative Learning for Weakly Supervised Semantic Segmentation

Weakly Supervised Remote Sensing Image Semantic Segmentation with Pseudo Label Noise Suppression

A Survey on Weakly Supervised 3D Point Cloud Semantic Segmentation

Weakly supervised semantic segmentation of histological tissue via attention accumulation and pixel-level contrast learning

Weaklier Supervised Semantic Segmentation with Only One Image Level Annotation Per Category.

A Weakly Supervised Semantic Segmentation Method Based on Local Superpixel Transformation

Weakly-Supervised Semantic Segmentation via Sub-category Exploration

Superpixel Consistency Saliency Map Generation for Weakly Supervised Semantic Segmentation of Remote Sensing Images

EP-SAM: Weakly Supervised Histopathology Segmentation via Enhanced Prompt with Segment Anything

Weakly-supervised Semantic Segmentation with Superpixel Guided Local and Global Consistency