Abstract:This paper addresses few-shot semantic segmentation and proposes a novel transductive end-to-end method that overcomes three key problems affecting performance. First, we present a novel ensemble of visual features learned from pretrained classification and semantic segmentation networks with the same architecture. Our approach leverages the varying discriminative power of these networks, resulting in rich and diverse visual features that are more informative than a pretrained classification backbone that is not optimized for dense pixel-wise classification tasks used in most state-of-the-art methods. Secondly, the pretrained semantic segmentation network serves as a base class extractor, which effectively mitigates false positives that occur during inference time and are caused by base objects other than the object of interest. Thirdly, a two-step segmentation approach using transductive meta-learning is presented to address the episodes with poor similarity between the support and query images. The proposed transductive meta-learning method addresses the prediction by first learning the relationship between labeled and unlabeled data points with matching support foreground to query features (intra-class similarity) and then applying this knowledge to predict on the unlabeled query image (intra-object similarity), which simultaneously learns propagation and false positive suppression. To evaluate our method, we performed experiments on benchmark datasets, and the results demonstrate significant improvement with minimal trainable parameters of 2.98 M . Specifically, using Resnet-101, we achieve state-of-the-art performance for both 1-shot and 5-shot Pascal- , as well as for 1-shot and 5-shot COCO- .

Hybrid Feature Enhancement Network for Few-Shot Semantic Segmentation

Iterative Few-shot Semantic Segmentation from Image Label Text

Relevant Intrinsic Feature Enhancement Network for Few-Shot Semantic Segmentation

Spatial Correlation Fusion Network for Few-Shot Segmentation

Multi-Similarity Enhancement Network for Few-Shot Segmentation.

MCEENet: Multi-Scale Context Enhancement and Edge-Assisted Network for Few-Shot Semantic Segmentation

Research of improving semantic image segmentation based on a feature fusion model

Learning with Memory for Few-Shot Semantic Segmentation

Self-Enhanced Mixed Attention Network for Three-Modal Images Few-Shot Semantic Segmentation

Rethinking and Improving Few-Shot Segmentation from a Contour-Aware Perspective

Arnet: Attention-Based Refinement Network for Few-Shot Semantic Segmentation

Multi-Layer Features Based Self-Support Network for Few-Shot Segmentation

Memory-guided Network with Uncertainty-based Feature Augmentation for Few-shot Semantic Segmentation

HDNet: Hybrid Distance Network for semantic segmentation

Holistic Mutual Representation Enhancement for Few-Shot Remote Sensing Segmentation

Objectness-Aware Few-Shot Semantic Segmentation

APANet: Adaptive Prototypes Alignment Network for Few-Shot Semantic Segmentation

SCNet: Enhancing Few-Shot Semantic Segmentation by Self-Contrastive Background Prototypes

Progressively Dual Prior Guided Few-shot Semantic Segmentation

Transductive meta-learning with enhanced feature ensemble for few-shot semantic segmentation

On the Texture Bias for Few-Shot CNN Segmentation