Abstract:Few-shot segmentation is a task that aims to generalize well to segment novel categories in images leveraging only a few annotated samples. Most existing methods adopt the prototype learning architecture, where support prototype vectors are expanded and concatenated with query features to perform conditional segmentation. However, such framework may potentially focus more on query features and neglect the similarity between support and query features. Moreover, it is valuable to mine information and latent categories in the background region to improve method generalization. To address these issues, this paper proposes a contrastive enhancement approach that can mine latent prototypes from background regions and leverage latent classes to raise the utilization of similarity information between prototype and query features. Specifically, a latent prototype sampling module is proposed to generate pseudo-mask and novel prototypes from the region with same category. It is based on feature similarity in high-level features, which is cost-effective for conducting end-to-end learning. This module does not require prior knowledge of object categories and has no strong dependence on clustering numbers like cluster-based method. Besides, a contrastive enhancement module is developed to drive models to provide different predictions with the same query features. It introduces the latent prototypes to regularize the decoder to concentrate more on similarity between support and query features. The proposed modules can be used as auxiliary modules to flexibly integrate into other baselines for better segmentation performance. Extensive experiments show our approach remarkably improves the performance of state-of-the-art methods for 1-shot and 5-shot segmentation, especially outperforming baseline by 5.9% and 7.3% for 5-shot task on Pascal- 5 i and COCO- 20 i .

Learning self-target knowledge for few-shot segmentation

Self-Support Few-Shot Semantic Segmentation

Dense Cross-Query-and-Support Attention Weighted Mask Aggregation for Few-Shot Segmentation

CGMGM: A Cross-Gaussian Mixture Generative Model for Few-Shot Semantic Segmentation

Iterative Few-shot Semantic Segmentation from Image Label Text

SCNet: Enhancing Few-Shot Semantic Segmentation by Self-Contrastive Background Prototypes

A Self-Distillation Embedded Supervised Affinity Attention Model for Few-Shot Segmentation

Learning from the Target: Dual Prototype Network for Few Shot Semantic Segmentation

Dual Branch Multi-Level Semantic Learning for Few-Shot Segmentation

Learning Non-target Knowledge for Few-shot Semantic Segmentation

Progressively Dual Prior Guided Few-shot Semantic Segmentation

Query Semantic Reconstruction for Background in Few-Shot Segmentation

Multi-Similarity Enhancement Network for Few-Shot Segmentation.

Addressing Background Context Bias in Few-Shot Segmentation Through Iterative Modulation

Contrastive enhancement using latent prototype for few-shot segmentation

A Joint Framework Towards Class-aware and Class-agnostic Alignment for Few-shot Segmentation

APANet: Adaptive Prototypes Alignment Network for Few-Shot Semantic Segmentation

Self-Support Matching Networks with Multiscale Attention for Few-shot Semantic Segmentation

Learning Prototype from Unlabeled Regions for Few-shot Segmentation

Self-Regularized Prototypical Network for Few-Shot Semantic Segmentation

Attention-Based Multi-Context Guiding for Few-Shot Semantic Segmentation