Abstract:Few-shot image semantic segmentation is a very challenging task that attempts to segmem objects of new classes using only a few labeled samples. The mamatmam methods often have problems of low discriminative feature and prototype deviation. To alleviate these problems, a new lowshot image semantic segmentation method hased on a bisaggregation and self-merging network is proposed, which can fully mine the similarity of features and reduce prototype hias. Firstly, we propose a feature-mask bi-aggregation module to provide global semantic information for the feature aggregation and mask aggregation by constructing a dense similarity relation between the support features and the query features covering all spatial locations. Specifically, an enhanced feature and an initial mask with guiding information can be obtained for the query image by performing feature and mask bi-aggregation on the similarity matrices. Then, a self-merging decoder is proposed, which reduces the prototype bias by adding the initial mask-based self-prototype with the known support prototypes, and conveys rich category semantic information to the decoder by fusing the merged prototype with the enhancement feature. Finally, the prediction results obtained by the decoder are further optimized by the prediction results of the base classes. The mlou values of our method on the dataset PASCAL-5 achieve 68.33% and 71.5% in the 1-shot and 5-shot cases, respectively, and on the dataset COCO-20 nchieve 46.5% and 51.4% in the 1-shot and 5-shot cases, respectively, which is superior to the segmentation performance of the mainstream methods, and can segment the target region of the new class more accurately.

Information Gap Narrowing for Point Cloud Few-shot Segmentation

Dense Cross-Query-and-Support Attention Weighted Mask Aggregation for Few-Shot Segmentation

Few-shot Point Cloud Semantic Segmentation Via Support-Query Feature Interaction

Robust Few-Shot 3D Point Cloud Scene Segmentation

Few-shot 3D Point Cloud Semantic Segmentation

Tackling background ambiguities in multi-class few-shot point cloud semantic segmentation

Mining Semantic Information from Intra-Image and Cross-Image for Few-Shot Segmentation

Noisy Few-shot 3D Point Cloud Scene Segmentation.

Learning self-target knowledge for few-shot segmentation

Boosting Few-shot 3D Point Cloud Segmentation via Query-Guided Enhancement

Few-shot object segmentation with a new feature aggregation module

Cross-Class Bias Rectification for Point Cloud Few-Shot Segmentation

Query-support Semantic Correlation Mining for Few-Shot Segmentation

Boosting Few-Shot Segmentation via Instance-Aware Data Augmentation and Local Consensus Guided Cross Attention

Compositional Prototype Network with Multi-view Comparision for Few-Shot Point Cloud Semantic Segmentation

See More and Know More: Zero-shot Point Cloud Segmentation via Multi-modal Visual Data

Rethinking Few-shot 3D Point Cloud Semantic Segmentation

Towards Robust Few-shot Point Cloud Semantic Segmentation

A Simple Framework of Few-Shot Learning Using Sparse Annotations for Semantic Segmentation of 3-D Point Clouds

Few-Shot 3D Point Cloud Semantic Segmentation via Stratified Class-Specific Attention Based Transformer Network

Bi-aggregation-aggregation and Self-Merging Network for Few-Shot Image Semantic Segmentation