Abstract:Few-shot segmentation is an emerging and intriguing subfield within computer vision that tackles the challenging task of segmenting objects or regions in images when only a very limited number of annotated examples are available for each category. Although some existing few-shot segmentation techniques have made notable strides in performance, the task of few-shot segmentation continues to pose significant challenges. Particularly in the context of delving into the actual pixel relation between support and query images, the relation often suffers from the interference due to complicated appearance, shape difference, etc. However, the accuracy of pixel relation concerns the effectiveness of category information transmission, which is crucial for segmenting the target objects. In addition, most models are prone to overfitting observed base classes during the training process, resulting in the learned model being unable to be generalized to a wider range of invisible classes. To this end, a novel framework named Combining Hierarchical Sparse Representation with Adaptive Prompt for Few-shot Segmentation (HSRap) is proposed to mine more precise pixel relations between the support and query images, enhancing the transfer of category information and improving the generalization ability of the model. Specifically, HSRap begins with the design of a hierarchical sparse representation module, which uncovers latent dense relation representations between the support and query images through the reconstruction of dense relations with sparse regularization. Following this, a lightweight adaptive prompt meta-learner is designed to generate multiple prompts for each category, ensuring generalizability to a broader range of unseen classes within the same dataset and reducing sensitivity to class shift. HSRap undergoes extensive testing on three challenging benchmarks: PASCAL-5i, COCO-20i, and FSS-1000. The results demonstrate a significant enhancement in the performance of the baseline, achieving competitive results compared to state-of-the-art methods.

Hierarchical Bidirectional Aggregation with Prior Guided Transformer for Few-Shot Segmentation

Dense Cross-Query-and-Support Attention Weighted Mask Aggregation for Few-Shot Segmentation

Few-shot object segmentation with a new feature aggregation module

A New Local Transformation Module for Few-shot Segmentation

Doubly Deformable Aggregation of Covariance Matrices for Few-shot Segmentation

Few-Shot 3D Point Cloud Semantic Segmentation via Stratified Class-Specific Attention Based Transformer Network

Bi-aggregation-aggregation and Self-Merging Network for Few-Shot Image Semantic Segmentation

Combining Hierarchical Sparse Representation with Adaptive Prompt for Few-Shot Segmentation

Few-Shot Segmentation Via Cycle-Consistent Transformer

Boosting Few-Shot Segmentation via Instance-Aware Data Augmentation and Local Consensus Guided Cross Attention

Adaptive Agent Transformer for Few-Shot Segmentation

Progressively Dual Prior Guided Few-shot Semantic Segmentation

Few-Shot Segmentation with Global and Local Contrastive Learning

Few-Shot Image Segmentation Based on Dual Comparison Module and Sequential K-Shot Integration.

Few-shot Medical Image Segmentation via Cross-Reference Transformer

Self-supervised Learning based Transformer and Convolution Hybrid Network for one-shot Organ Segmentation

Break the Bias: Delving Semantic Transform Invariance for Few-Shot Segmentation

Pseudo-Interacting Guided Network for Few-Shot Segmentation

Graph Affinity Network for Few-Shot Segmentation.

Improved Few-shot Segmentation by Redifinition of the Roles of Multi-level CNN Features

A Joint Framework Towards Class-aware and Class-agnostic Alignment for Few-shot Segmentation