Abstract:Obtaining image-level class labels for remote sensing (RS) images is a relatively straightforward process, sparking significant interest in weakly supervised semantic segmentation (WSSS). However, RS images present challenges beyond those encountered in generic WSSS, including complex backgrounds, densely distributed small objects, and considerable scale variations. To address the above issues, we introduce a consistency-constrained multiclass attention model, noted as CocoaNet. Specifically, CocoaNet endeavors to capture both semantic correlation and class distinctiveness using a global-local adaptive attention mechanism, which integrates the self-attention to model global correlation, complemented by a local perception branch that intensifies focus on local regions. The resulting class-specific attention weights and the patch-level pairwise affinity weights are employed to optimize the initial class activation maps (CAMs). This mechanism proves highly effective in mitigating interclass interference and managing the distribution of densely clustered small objects. Moreover, we invoke a consistency constraint to rectify activation inaccuracy. By utilizing a Siamese structure for the mutual supervision of features extracted from images at different scales, we address substantial scale variations in RS scenes. Simultaneously, a class contrast loss is adopted to enhance the discriminativeness of class-specific features. Departing from the conventional CAM optimization, which is rather complex and time-consuming, we harness the prior knowledge from the generic segment anything model (SAM) to design a joint optimization strategy (JOS) that refines target boundaries and further promotes discriminative visual features. We validate the effectiveness of our proposed approach on three benchmark datasets in multiclass RS scenarios, and the experimental results demonstrate that our model yields promising advancements compared to state-of-the-art methods.

Semantic Segmentation of Weakly Annotated Remote Sensing Images Based on Feature Adversary and Uncertainty Perception

Semantic Segmentation for Multi-Scene Remote Sensing Images with Noisy Labels Based on Uncertainty Perception.

Weakly Supervised Remote Sensing Image Semantic Segmentation with Pseudo Label Noise Suppression

Point Based Weakly Supervised Deep Learning for Semantic Segmentation of Remote Sensing Images

Semisupervised Semantic Segmentation With Certainty-Aware Consistency Training for Remote Sensing Imagery

Enhancing Semi-Supervised Semantic Segmentation of Remote Sensing Images via Feature Perturbation-Based Consistency Regularization Methods

Semi-Supervised Remote Sensing Image Semantic Segmentation Via Consistency Regularization And Average Update Of Pseudo-Label

Simple and Efficient: A Semisupervised Learning Framework for Remote Sensing Image Semantic Segmentation

Semi-supervised image semantic segmentation method with semantic regions patching and uncertainty-guided loss

A Comprehensive Analysis of Weakly-Supervised Semantic Segmentation in Different Image Domains

Category-sensitive Semi-Supervised Semantic Segmentation Framework for Land-Use/land-cover Mapping with Optical Remote Sensing Images

Weakly Supervised Semantic Segmentation of Satellite Images

Semantic Annotation of High-Resolution Satellite Images Via Weakly Supervised Learning.

Weakly Supervised Semantic Segmentation of Remote Sensing Images Based on Progressive Mining and Saliency-Enhanced Self-Attention

Weakly Supervised Region of Interest Extraction Based on Uncertainty-Aware Self-Refinement Learning for Remote Sensing Images

Mitigating Distributional Shift in Semantic Segmentation via Uncertainty Estimation From Unlabeled Data

Tackling Ambiguity from Perspective of Uncertainty Inference and Affinity Diversification for Weakly Supervised Semantic Segmentation

Weakly Supervised Semantic Segmentation With Consistency-Constrained Multiclass Attention for Remote Sensing Scenes

Semantic Segmentation of Remote Sensing Images with Self-Supervised Semantic-Aware Inpainting

Weakly Supervised Semantic Segmentation with Consistency-Constrained Multi-Class Attention for Remote Sensing Scenes

Semi-supervised Semantic Labeling of Remote Sensing Images with Improved Image-Level Selection Retraining