Abstract:Few-shot segmentation segments object regions of new classes with a few of manual annotations. Its key step is to establish the transformation module between support images (annotated images) and query images (unlabeled images), so that the segmentation cues of support images can guide the segmentation of query images. The existing methods form transformation model based on global cues, which however ignores the local cues that are verified in this paper to be very important for the transformation. This paper proposes a new transformation module based on local cues, where the relationship of the local features is used for transformation. To enhance the generalization performance of the network, the relationship matrix is calculated in a high-dimensional metric embedding space based on cosine distance. In addition, to handle the challenging mapping problem from the low-level local relationships to high-level semantic cues, we propose to apply generalized inverse matrix of the annotation matrix of support images to transform the relationship matrix linearly, which is non-parametric and class-agnostic. The result by the matrix transformation can be regarded as an attention map with high-level semantic cues, based on which a transformation module can be built <a class="link-external link-http" href="http://simply.The" rel="external noopener nofollow">this http URL</a> proposed transformation module is a general module that can be used to replace the transformation module in the existing few-shot segmentation frameworks. We verify the effectiveness of the proposed method on Pascal VOC 2012 dataset. The value of mIoU achieves at 57.0% in 1-shot and 60.6% in 5-shot, which outperforms the state-of-the-art method by 1.6% and 3.5%, respectively.

Few-shot object segmentation with a new feature aggregation module

Dense Cross-Query-and-Support Attention Weighted Mask Aggregation for Few-Shot Segmentation

Bi-aggregation-aggregation and Self-Merging Network for Few-Shot Image Semantic Segmentation

Boosting Few-Shot Segmentation via Instance-Aware Data Augmentation and Local Consensus Guided Cross Attention

Few-Shot Semantic Segmentation via Mask Aggregation

A Self-Distillation Embedded Supervised Affinity Attention Model for Few-Shot Segmentation

Objectness-Aware Few-Shot Semantic Segmentation

Triple Attention Feature Aggregation for Few-Shot Segmentation

Hierarchical Bidirectional Aggregation with Prior Guided Transformer for Few-Shot Segmentation

Learning self-target knowledge for few-shot segmentation

Few-Shot Object Detection Via Variational Feature Aggregation.

Graph Affinity Network for Few-Shot Segmentation.

Few-shot segmentation based on multi-level and cross-scale clustering

Information Gap Narrowing for Point Cloud Few-shot Segmentation

Adaptive Similarity-Guided Self-Merging Network for Few-Shot Semantic Segmentation

Few-Shot Image Segmentation Based on Dual Comparison Module and Sequential K-Shot Integration.

A New Local Transformation Module for Few-shot Segmentation

Few-Shot Semantic Segmentation with Democratic Attention Networks

Few-shot Segmentation with Duplex Network and Attention Augmented Module.

Attention-Based Multi-Context Guiding for Few-Shot Semantic Segmentation

A Joint Framework Towards Class-aware and Class-agnostic Alignment for Few-shot Segmentation