Abstract:Land cover classification (LCC) is an important application in remote sensing data interpretation and invariably faces big intra-class variance and sample imbalance in remote sensing images. The optical image is obtained by satellites capturing the spectral information of the Earth’s surface, and the synthetic aperture radar (SAR) image is produced by the satellite actively transmitting and receiving the electromagnetic wave signals reflected from land covers. Because of the limitations of the optical image, a single modality (optical image) might be disturbed by external conditions, especially complex weather. Using heterogeneous SAR and optical images for LCC can reduce the negative impact caused by single-modal data damage, and multi-modal data can also be used as supplementary information to enhance classification accuracy. However, general LCC methods mainly focus on remote sensing data of a single modality without fully considering the multi-modalities of land covers. Therefore, we propose a dual-stream deep high-resolution network (DDHRNet) to deeply integrate SAR and optical data at the feature level in every branch. The network can effectively exploit the complementary information in heterogeneous images. It improves classification performance and achieves significant improvements in the classification of clouded images. A multi-modal squeeze-and-excitation (MSE) module is also utilized to fuse the features. Compared with the ordinary methods, MSE modules can lead to an improvement of about 1% to 5% in overall accuracy (OA), Kappa coefficients, and mean intersection over union (mIoU). Besides, in order to evaluate our method, we describe in detail the preprocessing process of Gaofen-2 (GF2) and Gaofen-3 (GF3) data before they are used in the LCC task. The experiments show that the proposed method performs well compared with other excellent segmentation methods and obtains the best performance on heterogeneous images from GF2 and GF3. The code and datasets are available at: https://github.com/XD-MG/DDHRNet.

Land Cover Classification in Foggy Conditions: Toward Robust Models

Semantic Representation Fusion-Based Network for Robust Land Cover Classification in Foggy Conditions.

Towards Robust Semantic Segmentation of Land Covers in Foggy Conditions

Learning rich multimodal representation for robust land cover classification in fog

Superpixel-Based Long-Range Dependent Network for High-Resolution Remote-Sensing Image Classification

Emmcnn: An Etps-Based Multi-Scale And Multi-Feature Method Using Cnn For High Spatial Resolution Image Land-Cover Classification

Mapping Impervious Surfaces in Town–Rural Transition Belts Using China’s GF-2 Imagery and Object-Based Deep CNNs

Robust Land Cover Classification with Local-Global Information Decoupling to Address Remote Sensing Anomalous Data

Semantic Labeling of High-Resolution Images Combining a Self-Cascaded Multimodal Fully Convolution Neural Network with Fully Conditional Random Field

Dual Attention Feature Fusion and Adaptive Context for Accurate Segmentation of Very High-Resolution Remote Sensing Images

Attention-Based Context Aware Network for Semantic Comprehension of Aerial Scenery

Urban Land Cover Classification of High-Resolution Aerial Imagery Using a Relation-Enhanced Multiscale Convolutional Network

Assessing CNN and Semantic Segmentation Models for Coarse Resolution Satellite Image Classification in Subcontinental Scale Land Cover Mapping

SFMRNet: Specific Feature Fusion and Multibranch Feature Refinement Network for Land Use Classification

Category-sensitive Semi-Supervised Semantic Segmentation Framework for Land-Use/land-cover Mapping with Optical Remote Sensing Images

Robust Semantic Segmentation By Dense Fusion Network On Blurred VHR Remote Sensing Images

Land-Cover Classification With High-Resolution Remote Sensing Images Using Interactive Segmentation

A Dual-Stream High Resolution Network: Deep Fusion of GF-2 and GF-3 Data for Land Cover Classification

Semantic Segmentation of Very-High-Resolution Remote Sensing Images via Deep Multi-Feature Learning

Robust Semisupervised Land-Use Classification Using Remote Sensing Data With Weak Labels

CNN-based Land Cover Classification Combining Stratified Segmentation and Fusion of Point Cloud and Very High-Spatial Resolution Remote Sensing Image Data.