Abstract:Currently, an increasing number of convolutional neural networks (CNNs) focus specifically on capturing contextual features (con. feat) to improve performance in semantic segmentation tasks. However, high-level con. feat are biased towards encoding features of large objects, disregard spatial details, and have a limited capacity to discriminate between easily confused classes (e.g., trees and grasses). As a result, we incorporate low-level features (low. feat) and class-specific discriminative features (dis. feat) to boost model performance further, with low. feat helping the model in recovering spatial information and dis. feat effectively reducing class confusion during segmentation. To this end, we propose a novel deep multi-feature learning framework for the semantic segmentation of VHR RSIs, dubbed MFNet. The proposed MFNet adopts a multi-feature learning mechanism to learn more complete features, including con. feat, low. feat, and dis. feat. More specifically, aside from a widely used context aggregation module for capturing con. feat, we additionally append two branches for learning low. feat and dis. feat. One focuses on learning low. feat at a shallow layer in the backbone network through local contrast processing, while the other groups con. feat and then optimizes each class individually to generate dis. feat with better inter-class discriminative capability. Extensive quantitative and qualitative evaluations demonstrate that the proposed MFNet outperforms most state-of-the-art models on the ISPRS Vaihingen and Potsdam datasets. In particular, thanks to the mechanism of multi-feature learning, our model achieves an overall accuracy score of 91.91% on the Potsdam test set with VGG16 as a backbone, performing favorably against advanced models with ResNet101.

MGFEEN: a multi-granularity feature encoding ensemble network for remote sensing image classification

MGML: Multigranularity Multilevel Feature Ensemble Network for Remote Sensing Scene Classification

MGFN: A Multi-Granularity Fusion Convolutional Neural Network for Remote Sensing Scene Classification

Remote Sensing Image Scene Classification by Multiple Granularity Semantic Learning

Attention-Aware Deep Feature Embedding for Remote Sensing Image Scene Classification

EFM-Net: An Essential Feature Mining Network for Target Fine-Grained Classification in Optical Remote Sensing Images

GCFnet: Global Collaborative Fusion Network for Multispectral and Panchromatic Image Classification

EFCNet: Ensemble Full Convolutional Network for Semantic Segmentation of High-Resolution Remote Sensing Images

Land Cover Classification from VHR Optical Remote Sensing Images by Feature Ensemble Deep Learning Network

An End-to-End Local-Global-Fusion Feature Extraction Network for Remote Sensing Image Scene Classification

CMGFNet: A deep cross-modal gated fusion network for building extraction from very high-resolution remote sensing images

Feature Enhancement Network for Object Detection in Optical Remote Sensing Images

Remote sensing image scene classification based on multilayer feature context encoding network

DGFNet: Dual Gate Fusion Network for Land Cover Classification in Very High-Resolution Images

MSE-Net: A novel master–slave encoding network for remote sensing scene classification

Multi-scale Network Via Progressive Multi-Granularity Attention for Fine-Grained Visual Classification

Multiscale Feature Enhancement Network for Salient Object Detection in Optical Remote Sensing Images

Deep Multi-Feature Fusion Network for Remote Sensing Images

Multilayer Feature Fusion Network With Spatial Attention and Gated Mechanism for Remote Sensing Scene Classification

Semantic Segmentation of Very-High-Resolution Remote Sensing Images via Deep Multi-Feature Learning

MCAFNet: Multi-Channel Attention Fusion Network-Based CNN For Remote Sensing Scene Classification