Abstract:With the advent of large-scale datasets, significant advancements have been made in image semantic segmentation. However, the annotation of these datasets necessitates substantial human and financial resources. Therefore, the focus of research has shifted towards few-shot semantic segmentation, which leverages a small number of labeled samples to effectively segment unknown categories. The current mainstream methods are to use the meta-learning framework to achieve model generalization, and the main challenges are as follows. (1) The trained model will be biased towards the seen class, so the model will misactivate the seen class when segmenting the unseen class, which makes it difficult to achieve the idealized class agnostic effect. (2) When the sample size is limited, there exists an intra-class gap between the provided support images and the query images, significantly impacting the model’s generalization capability. To solve the above two problems, we propose a network with prototype complementarity characteristics (PCNet). Specifically, we first generate a self-support query prototype based on the query image. Through the self-distillation, the query prototype and the support prototype perform feature complementary learning, which effectively reduces the influence of the intra-class gap on the model generalization. A standard semantic segmentation model is introduced to segment the seen classes during the training process to achieve accurate irrelevant class shielding. After that, we use the rough prediction map to extract its background prototype and shield the background in the query image by the background prototype. In this way, we obtain more accurate fine-grained segmentation results. The proposed method exhibits superiority in extensive experiments conducted on the PASCAL-5i and COCO-20i datasets. We achieve new state-of-the-art results in the few-shot semantic segmentation task, with an mIoU of 71.27% and 51.71% in the 5-shot setting, respectively. Comprehensive ablation experiments and visualization studies show that the proposed method has a significant effect on small-sample semantic segmentation.

Beyond singular prototype: A prototype splitting strategy for few-shot medical image segmentation

Self-Guided Local Prototype Network for Few-Shot Medical Image Segmentation.

Multi-shot Prototype Contrastive Learning and Semantic Reasoning for Medical Image Segmentation

Self-supported Prototype Rectification for Few-shot Medical Image Segmentation

Support-Query Prototype Fusion Network for Few-shot Medical Image Segmentation

Many Birds, One Stone: Medical Image Segmentation with Multiple Partially Labeled Datasets

Prototype-Guided Graph Reasoning Network for Few-Shot Medical Image Segmentation

Few-Shot Medical Image Segmentation with High-Fidelity Prototypes

Few-Shot Medical Image Segmentation with Large Kernel Attention

Few-Shot Medical Image Segmentation via Generating Multiple Representative Descriptors

Prototype Queue Learning for Multi-Class Few-Shot Semantic Segmentation

Partition-A-Medical-Image: Extracting Multiple Representative Subregions for Few-Shot Medical Image Segmentation

Advancing Medical Image Segmentation Via Self-supervised Instance-adaptive Prototype Learning

PCNet: Leveraging Prototype Complementarity to Improve Prototype Affinity for Few-Shot Segmentation

Dual-Guided Prototype Alignment Network for Few-Shot Medical Image Segmentation

Correlation Weighted Prototype-based Self-Supervised One-Shot Segmentation of Medical Images

Learning De-biased prototypes for few-shot medical image segmentation

A Location-Sensitive Local Prototype Network for Few-Shot Medical Image Segmentation

Attentional adversarial training for few-shot medical image segmentation without annotations

Partition-A-Medical-Image: Extracting Multiple Representative Sub-regions for Few-shot Medical Image Segmentation

Prototype Adaption and Projection for Few- and Zero-Shot 3D Point Cloud Semantic Segmentation