Abstract:Currently, an increasing number of convolutional neural networks (CNNs) focus specifically on capturing contextual features (con. feat) to improve performance in semantic segmentation tasks. However, high-level con. feat are biased towards encoding features of large objects, disregard spatial details, and have a limited capacity to discriminate between easily confused classes (e.g., trees and grasses). As a result, we incorporate low-level features (low. feat) and class-specific discriminative features (dis. feat) to boost model performance further, with low. feat helping the model in recovering spatial information and dis. feat effectively reducing class confusion during segmentation. To this end, we propose a novel deep multi-feature learning framework for the semantic segmentation of VHR RSIs, dubbed MFNet. The proposed MFNet adopts a multi-feature learning mechanism to learn more complete features, including con. feat, low. feat, and dis. feat. More specifically, aside from a widely used context aggregation module for capturing con. feat, we additionally append two branches for learning low. feat and dis. feat. One focuses on learning low. feat at a shallow layer in the backbone network through local contrast processing, while the other groups con. feat and then optimizes each class individually to generate dis. feat with better inter-class discriminative capability. Extensive quantitative and qualitative evaluations demonstrate that the proposed MFNet outperforms most state-of-the-art models on the ISPRS Vaihingen and Potsdam datasets. In particular, thanks to the mechanism of multi-feature learning, our model achieves an overall accuracy score of 91.91% on the Potsdam test set with VGG16 as a backbone, performing favorably against advanced models with ResNet101.

Multi-scale Discriminative Location-aware Network for Few-Shot Semantic Segmentation

Deep Dual-Stream Network with Scale Context Selection Attention Module for Semantic Segmentation

Dense Cross-Query-and-Support Attention Weighted Mask Aggregation for Few-Shot Segmentation

CGMGM: A Cross-Gaussian Mixture Generative Model for Few-Shot Semantic Segmentation

Iterative Few-shot Semantic Segmentation from Image Label Text

Multi-Layer Features Based Self-Support Network for Few-Shot Segmentation

Multi-scale Self-similarity Network for Few-Shot Segmentation

Multi-Similarity Enhancement Network for Few-Shot Segmentation.

Dual Branch Multi-Level Semantic Learning for Few-Shot Segmentation

Self-Support Matching Networks with Multiscale Attention for Few-shot Semantic Segmentation

Dual-Guided Frequency Prototype Network for Few-Shot Semantic Segmentation

Few-shot segmentation based on multi-level and cross-scale clustering

MSDNet: Multi-Scale Decoder for Few-Shot Semantic Segmentation via Transformer-Guided Prototyping

Progressively Dual Prior Guided Few-shot Semantic Segmentation

Deep Reasoning Network for Few-shot Semantic Segmentation

A Self-Supervised Few-Shot Semantic Segmentation Method Based on Multi-Task Learning and Dense Attention Computation

Attention-Based Multi-Context Guiding for Few-Shot Semantic Segmentation

MCEENet: Multi-Scale Context Enhancement and Edge-Assisted Network for Few-Shot Semantic Segmentation

Self-Enhanced Mixed Attention Network for Three-Modal Images Few-Shot Semantic Segmentation

Semantic Segmentation of Very-High-Resolution Remote Sensing Images via Deep Multi-Feature Learning

Cycle association prototype network for few-shot semantic segmentation