Abstract:Objective. Histopathology image segmentation can assist medical professionals in identifying and diagnosing diseased tissue more efficiently. Although fully supervised segmentation models have excellent performance, the annotation cost is extremely expensive. Weakly supervised models are widely used in medical image segmentation due to their low annotation cost. Nevertheless, these weakly supervised models have difficulty in accurately locating the boundaries between different classes of regions in pathological images, resulting in a high rate of false alarms. Our objective is to design a weakly supervised segmentation model to resolve the above problems. Approach. The segmentation model is divided into two main stages, the generation of pseudo labels based on Class Residual Attention Accumulation Network (CRAANet) and the semantic segmentation based on Pixel Feature Space Construction Network (PFSCNet). CRAANet provides attention scores for each class through the Class Residual Attention (CRA) module, while the Attention Accumulation (AA) module overlays the attention feature maps generated in each training epoch. PFSCNet employs a network model containing an inflated convolutional residual neural network and a multi-scale feature-aware module as the segmentation backbone, and proposes Dense Energy Loss (DE Loss) and Pixel Clustering (PCL) are modules based on contrast learning to solve the pseudo-labeling-inaccuracy problem. Main results. We validate our method using the lung adenocarcinoma (LUAD-HistoSeg) dataset and the breast cancer (BCSS) dataset. The results of the experiments show that our proposed method outperforms other state-of-the-art methods on both datasets in several metrics. This suggests that it is capable of performing well in a wide variety of histopathological image segmentation tasks. Significance. We propose a weakly supervised semantic segmentation network that achieves approximate fully supervised segmentation performance even in the case of incomplete labels. The proposed attention accumulation and pixel-level contrast learning also make the edges more accurate and can well assist pathologists in their research.

TransWS: Transformer-Based Weakly Supervised Histology Image Segmentation.

Weakly Supervised Histopathology Image Segmentation with Sparse Point Annotations

Boosting Weakly-Supervised Image Segmentation Via Representation, Transform, and Compensator

TPRO: Text-Prompting-Based Weakly Supervised Histopathology Tissue Segmentation

LogTrans: Providing Efficient Local-Global Fusion with Transformer and CNN Parallel Network for Biomedical Image Segmentation

MultiTrans: Multi-branch transformer network for medical image segmentation

Evaluating Transformer-based Semantic Segmentation Networks for Pathological Image Segmentation

WeakTr: Exploring Plain Vision Transformer for Weakly-supervised Semantic Segmentation

TransBTSV2: Towards Better and More Efficient Volumetric Segmentation of Medical Images

Transformer based multiple instance learning for weakly supervised histopathology image segmentation

TransBTSV2: Wider Instead of Deeper Transformer for Medical Image Segmentation

Dual-Augmented Transformer Network for Weakly Supervised Semantic Segmentation

Weakly supervised semantic segmentation of histological tissue via attention accumulation and pixel-level contrast learning

A Comprehensive Analysis of Weakly-Supervised Semantic Segmentation in Different Image Domains

CSWin-UNet: Transformer UNet with Cross-Shaped Windows for Medical Image Segmentation

STransFuse: Fusing Swin Transformer and Convolutional Neural Network for Remote Sensing Image Semantic Segmentation

TransSea: Hybrid CNN-Transformer with Semantic Awareness for 3D Brain Tumor Segmentation

TransSea: Hybrid CNN–Transformer With Semantic Awareness for 3-D Brain Tumor Segmentation

Mitigating Undisciplined Over-Smoothing in Transformer for Weakly Supervised Semantic Segmentation

Real-Time Image Segmentation via Hybrid Convolutional-Transformer Architecture Search

EG-TransUNet: a transformer-based U-Net with enhanced and guided models for biomedical image segmentation