Abstract:In recent years, remote sensing images of various types have found widespread applications in resource exploration, environmental protection, and land cover classification. However, relying solely on a single optical or synthetic aperture radar (SAR) image as the data source for land cover classification studies may not suffice to achieve the desired accuracy in ground information monitoring. One widely employed neural network for remote sensing image land cover classification is the U-Net network, which is a classical semantic segmentation network. Nonetheless, the U-Net network has limitations such as poor classification accuracy, misclassification and omission of small-area terrains, and a large number of network parameters. To address these challenges, this research paper proposes an improved approach that combines both optical and SAR images in bands for land cover classification and enhances the U-Net network. The approach incorporates several modifications to the network architecture. Firstly, the encoder-decoder framework serves as the backbone terrain-extraction network. Additionally, a convolutional block attention mechanism is introduced in the terrain extraction stage. Instead of pooling layers, convolutions with a step size of 2 are utilized, and the Leaky ReLU function is employed as the network's activation function. This design offers several advantages: it enhances the network's ability to capture terrain characteristics from both spatial and channel dimensions, resolves the loss of terrain map information while reducing network parameters, and ensures non-zero gradients during the training process. The effectiveness of the proposed method is evaluated through land cover classification experiments conducted on optical, SAR, and combined optical and SAR datasets. The results demonstrate that our method achieves classification accuracies of 0.8905, 0.8609, and 0.908 on the three datasets, respectively, with corresponding mIoU values of 0.8104, 0.7804, and 0.8667. Compared to the traditional U-Net network, our method exhibits improvements in both classification accuracy and mIoU to a certain extent.

CFNet: A Cross Fusion Network for Joint Land Cover Classification Using Optical and SAR Images

Multimodal Bilinear Fusion Network with Second-Order Attention-Based Channel Selection for Land Cover Classification

MFFnet: Multimodal Feature Fusion Network for Synthetic Aperture Radar and Optical Image Land Cover Classification

Learning SAR-Optical Cross Modal Features for Land Cover Classification

Collaborative Attention-Based Heterogeneous Gated Fusion Network for Land Cover Classification

Multi-Modal Fusion Architecture Search for Land Cover Classification Using Heterogeneous Remote Sensing Images.

A Joint Convolutional Cross ViT Network for Hyperspectral and Light Detection and Ranging Fusion Classification

Cross Attention-Based Multi-Scale Convolutional Fusion Network for Hyperspectral and LiDAR Joint Classification

Dual-Branch Feature Fusion Network Based Cross-Modal Enhanced CNN and Transformer for Hyperspectral and LiDAR Classification

Hyperspectral and SAR Image Classification via Multiscale Interactive Fusion Network

A Crossmodal Multiscale Fusion Network for Semantic Segmentation of Remote Sensing Data

Land cover classification algorithm based on multi-modal collaboration and boundary-guided fusion

Object-oriented Land Cover Classification of HJ-1B CCD Image Through Multiple Classifier Fusion.

SwinTFNet: Dual-Stream Transformer With Cross Attention Fusion for Land Cover Classification

DAFCNN: A Dual-Channel Feature Extraction and Attention Feature Fusion Convolution Neural Network for SAR Image and MS Image Fusion

Joint Classification of Hyperspectral Images and LiDAR Data Based on Dual-Branch Transformer

MHFNet: an Improved HGR Multimodal Network for Informative Correlation Fusion in Remote Sensing Image Classification

Joint Classification of Hyperspectral and LiDAR Data Using Height Information Guided Hierarchical Fusion-and-Separation Network

Multi-modal land cover mapping of remote sensing images using pyramid attention and gated fusion networks

Research on land cover classification of multi-source remote sensing data based on improved U-net network

Feature-Decision Level Collaborative Fusion Network for Hyperspectral and LiDAR Classification