Abstract:Few-shot segmentation segments object regions of new classes with a few of manual annotations. Its key step is to establish the transformation module between support images (annotated images) and query images (unlabeled images), so that the segmentation cues of support images can guide the segmentation of query images. The existing methods form transformation model based on global cues, which however ignores the local cues that are verified in this paper to be very important for the transformation. This paper proposes a new transformation module based on local cues, where the relationship of the local features is used for transformation. To enhance the generalization performance of the network, the relationship matrix is calculated in a high-dimensional metric embedding space based on cosine distance. In addition, to handle the challenging mapping problem from the low-level local relationships to high-level semantic cues, we propose to apply generalized inverse matrix of the annotation matrix of support images to transform the relationship matrix linearly, which is non-parametric and class-agnostic. The result by the matrix transformation can be regarded as an attention map with high-level semantic cues, based on which a transformation module can be built <a class="link-external link-http" href="http://simply.The" rel="external noopener nofollow">this http URL</a> proposed transformation module is a general module that can be used to replace the transformation module in the existing few-shot segmentation frameworks. We verify the effectiveness of the proposed method on Pascal VOC 2012 dataset. The value of mIoU achieves at 57.0% in 1-shot and 60.6% in 5-shot, which outperforms the state-of-the-art method by 1.6% and 3.5%, respectively.

Few-shot Segmentation with Optimal Transport Matching and Message Flow

Dense Cross-Query-and-Support Attention Weighted Mask Aggregation for Few-Shot Segmentation

CGMGM: A Cross-Gaussian Mixture Generative Model for Few-Shot Semantic Segmentation

Multi-Similarity Enhancement Network for Few-Shot Segmentation.

Self-Support Few-Shot Semantic Segmentation

Pixel Matching Network for Cross-Domain Few-Shot Segmentation

Iterative Few-shot Semantic Segmentation from Image Label Text

A New Local Transformation Module for Few-shot Segmentation

Self-Support Matching Networks with Multiscale Attention for Few-shot Semantic Segmentation

Spatial Correlation Fusion Network for Few-Shot Segmentation

Few-shot Segmentation with Duplex Network and Attention Augmented Module.

A Joint Framework Towards Class-aware and Class-agnostic Alignment for Few-shot Segmentation

Boosting Few-Shot Segmentation via Instance-Aware Data Augmentation and Local Consensus Guided Cross Attention

Cross-Domain Few-Shot Semantic Segmentation via Doubly Matching Transformation

Multi-scale Self-similarity Network for Few-Shot Segmentation

Few-Shot Segmentation Via Cycle-Consistent Transformer

Few-shot Semantic Segmentation Via Perceptual Attention and Spatial Control

Blessing Few-Shot Segmentation Via Semi-Supervised Learning with Noisy Support Images

Unleashing the Potential of the Diffusion Model in Few-shot Semantic Segmentation

A New Few-shot Segmentation Network Based on Class Representation.

Rethinking and Improving Few-Shot Segmentation from a Contour-Aware Perspective