Abstract:Few-shot segmentation (FSS) is proposed to segment unknown class targets with just a few annotated samples. Most current FSS methods follow the paradigm of mining the semantics from the support images to guide the query image segmentation. However, such a pattern of `learning from others' struggles to handle the extreme intra-class variation, preventing FSS from being directly generalized to remote sensing scenes. To bridge the gap of intra-class variance, we develop a Dual-Mining network named DMNet for cross-image mining and self-mining, meaning that it no longer focuses solely on support images but pays more attention to the query image itself. Specifically, we propose a Class-public Region Mining (CPRM) module to effectively suppress irrelevant feature pollution by capturing the common semantics between the support-query image pair. The Class-specific Region Mining (CSRM) module is then proposed to continuously mine the class-specific semantics of the query image itself in a `filtering' and `purifying' manner. In addition, to prevent the co-existence of multiple classes in remote sensing scenes from exacerbating the collapse of FSS generalization, we also propose a new Known-class Meta Suppressor (KMS) module to suppress the activation of known-class objects in the sample. Extensive experiments on the iSAID and LoveDA remote sensing datasets have demonstrated that our method sets the state-of-the-art with a minimum number of model parameters. Significantly, our model with the backbone of Resnet-50 achieves the mIoU of 49.58% and 51.34% on iSAID under 1-shot and 5-shot settings, outperforming the state-of-the-art method by 1.8% and 1.12%, respectively. The code is publicly available at <a class="link-external link-https" href="https://github.com/HanboBizl/DMNet" rel="external noopener nofollow">this https URL</a>.

Mining Latent Classes for Few-shot Segmentation

Learning Prototype from Unlabeled Regions for Few-shot Segmentation

Multi-Similarity Enhancement Network for Few-Shot Segmentation.

Adaptive FSS: A Novel Few-Shot Segmentation Framework Via Prototype Enhancement

A Joint Framework Towards Class-aware and Class-agnostic Alignment for Few-shot Segmentation

Iterative Few-shot Semantic Segmentation from Image Label Text

Learning What Not to Segment: A New Perspective on Few-Shot Segmentation

Focus on Query: Adversarial Mining Transformer for Few-Shot Segmentation

Not Just Learning from Others but Relying on Yourself: A New Perspective on Few-Shot Segmentation in Remote Sensing

Label-Efficient Few-Shot Semantic Segmentation with Unsupervised Meta-Training

Learn to Few-Shot Segment Remote Sensing Images from Irrelevant Data

Learning self-target knowledge for few-shot segmentation

On filling the intra-class and inter-class gaps for few-shot segmentation

Memory-guided Network with Uncertainty-based Feature Augmentation for Few-shot Semantic Segmentation

High-Performance Few-Shot Segmentation with Foundation Models: An Empirical Study

Self-Support Few-Shot Semantic Segmentation

Cross-Domain Few-Shot Segmentation via Iterative Support-Query Correspondence Mining

Deep Reasoning Network for Few-shot Semantic Segmentation

Few-Shot Segmentation Via Divide-and-Conquer Proxies

MetaMask: Improving Few-Shot Semantic Segmentation Via Multi-Mask Calibriation

Prior-Enhanced Few-Shot Segmentation with Meta-Prototypes