Abstract:The semantic segmentation of remote sensing images with few shots has important theoretical and application value. Most of the existing few-shot semantic segmentation frameworks are based on prototype learning methods, in which a single support prototype is designed to guide the query set for prediction. However, the visual differences between the support set and the query set make it difficult for a single support prototype, generated from the support set, to comprehensively encapsulate the semantic information of all the query images. This article introduces an adaptive self-supporting prototype learning network designed for few-shot segmentation (FSS), in order to tackle the challenges mentioned earlier. We propose adaptive hyperprototype representation (HPR), which consists of hyperprototype clustering (HPC) and guided prototype matching (GPM), to generate and assign multiple representative prototypes to compensate for the limitations of a single prototype in representing the semantic information of the query images. Specifically, HPC is a parameter-free and adaptive approach, which can extract more representative prototypes by aggregating similar feature vectors utilizing superpixel feature clustering. Meanwhile, GPM can select matched prototypes to provide more accurate guidance, allowing for uniformly aligned representation of multiple prototypes and complex image semantic information. We also introduce self-supporting matching (SSM) prototype learning, which can accurately guide the query set segmentation by acquiring query set prototypes. SSM generates initial pseudo labels for the query set based on the support set prototypes, and further guides the query set using the pseudo labels, along with the query prototypes generated by its own features, thus effectively avoiding visual differences between the support set and query set. The proposed adaptive self-supporting prototype learning network substantially improves the prototype quality and achieves a superior performance on object-level remote sensing datasets.

Foreground-Covering Prototype Generation and Matching for SAM-Aided Few-Shot Segmentation

Dense Cross-Query-and-Support Attention Weighted Mask Aggregation for Few-Shot Segmentation

CGMGM: A Cross-Gaussian Mixture Generative Model for Few-Shot Semantic Segmentation

Pixel Matching Network for Cross-Domain Few-Shot Segmentation

Adaptive Self-Supporting Prototype Learning for Remote Sensing Few-Shot Semantic Segmentation

Self-Compensating Learning for Few-Shot Segmentation

Dynamic Prototype Convolution Network for Few-Shot Semantic Segmentation

Multi-Similarity Enhancement Network for Few-Shot Segmentation.

Adaptive FSS: A Novel Few-Shot Segmentation Framework Via Prototype Enhancement

Self-Support Few-Shot Semantic Segmentation

Sam-Rsp: A New Few-Shot Segmentation Method Based on Segment Anything Model and Rough Segmentation Prompts

Query Semantic Reconstruction for Background in Few-Shot Segmentation

Self-Calibrated Cross Attention Network for Few-Shot Segmentation

Learning discriminative foreground-and-background features for few-shot segmentation

Symmetrical Joint Learning Support-query Prototypes for Few-shot Segmentation

Learning Prototype from Unlabeled Regions for Few-shot Segmentation

Learning self-target knowledge for few-shot segmentation

Few-Shot Segmentation Via Divide-and-Conquer Proxies

Dual-Guided Frequency Prototype Network for Few-Shot Semantic Segmentation

Support-Query Prototype Fusion Network for Few-shot Medical Image Segmentation