Abstract:Few-shot segmentation (FSS) is proposed to segment unknown class targets with just a few annotated samples. Most current FSS methods follow the paradigm of mining the semantics from the support images to guide the query image segmentation. However, such a pattern of `learning from others' struggles to handle the extreme intra-class variation, preventing FSS from being directly generalized to remote sensing scenes. To bridge the gap of intra-class variance, we develop a Dual-Mining network named DMNet for cross-image mining and self-mining, meaning that it no longer focuses solely on support images but pays more attention to the query image itself. Specifically, we propose a Class-public Region Mining (CPRM) module to effectively suppress irrelevant feature pollution by capturing the common semantics between the support-query image pair. The Class-specific Region Mining (CSRM) module is then proposed to continuously mine the class-specific semantics of the query image itself in a `filtering' and `purifying' manner. In addition, to prevent the co-existence of multiple classes in remote sensing scenes from exacerbating the collapse of FSS generalization, we also propose a new Known-class Meta Suppressor (KMS) module to suppress the activation of known-class objects in the sample. Extensive experiments on the iSAID and LoveDA remote sensing datasets have demonstrated that our method sets the state-of-the-art with a minimum number of model parameters. Significantly, our model with the backbone of Resnet-50 achieves the mIoU of 49.58% and 51.34% on iSAID under 1-shot and 5-shot settings, outperforming the state-of-the-art method by 1.8% and 1.12%, respectively. The code is publicly available at <a class="link-external link-https" href="https://github.com/HanboBizl/DMNet" rel="external noopener nofollow">this https URL</a>.

Multi-Content Interaction Network for Few-Shot Segmentation

Multi-Similarity Enhancement Network for Few-Shot Segmentation.

Pixel Matching Network for Cross-Domain Few-Shot Segmentation

Dense Cross-Query-and-Support Attention Weighted Mask Aggregation for Few-Shot Segmentation

Deep Dual-Stream Network with Scale Context Selection Attention Module for Semantic Segmentation

Multi-Layer Features Based Self-Support Network for Few-Shot Segmentation

Self-Support Matching Networks with Multiscale Attention for Few-shot Semantic Segmentation

Self-Calibrated Cross Attention Network for Few-Shot Segmentation

Not Just Learning from Others but Relying on Yourself: A New Perspective on Few-Shot Segmentation in Remote Sensing

Layer-Wise Mutual Information Meta-Learning Network for Few-Shot Segmentation

Multi-scale Self-similarity Network for Few-Shot Segmentation

MCEENet: Multi-Scale Context Enhancement and Edge-Assisted Network for Few-Shot Semantic Segmentation

On filling the intra-class and inter-class gaps for few-shot segmentation

Adaptive FSS: A Novel Few-Shot Segmentation Framework Via Prototype Enhancement

Deep Reasoning Network for Few-shot Semantic Segmentation

CIMFNet: Cross-layer Interaction and Multiscale Fusion Network for Semantic Segmentation of High-Resolution Remote Sensing Images

Mining Latent Classes for Few-shot Segmentation

Few-shot Semantic Segmentation with Support-induced Graph Convolutional Network

Eliminating Feature Ambiguity for Few-Shot Segmentation

Masked Cross-image Encoding for Few-shot Segmentation