Abstract:The joint of multi-source remote sensing (RS) data for land cover classification has become a popular research topic. Although studies have shown that the fusion of multi-source data can improve the accuracy of classification, the current limitation lies in the inadequate exploitation of information, resulting in spectral confusion categories overlapping, and varying visual differences within the same category. To address these problems, this paper proposes a multi-scale spectral-spatial attention residual fusion network (MSSARFNet) that aims to enhance the classification performance of multi-source RS data through effective spectral-spatial feature extraction and fusion. Specifically, three modules are designed: the multi-scale spectral attention residual module (MSpeARM), the multi-scale spatial attention residual module (MSpaARM) and multi-scale convolution fusion (MCF) module. Firstly, we divide the channels of the features into multiple paths and apply spectral-spatial attention mechanisms on each path. To further enhance connectivity, convolutional operation is utilized to establish connections between different paths, thus forming MSpeARM and MSpaARM. The MSpeARM suppresses redundant features and enhances effective features along the channel dimension to better differentiate spectral-confused categories. The MSpaARM highlights that different visual patterns of objects in the same category can mutually reinforce each other by weighting all positional features, regardless of their spatial differences. Secondly, to fuse these two sets of features, the MCF module is designed to learn multi-level semantic features and enhance fusion at a granular level. Experimental evaluations on three RS datasets demonstrate that the proposed method achieves excellent classification performance, indicating the effectiveness of MSSARFNet. The source code of the proposed method will be available at https://github.com/wangxu0210/MSSARFNet .

Feature Fusion Classification for Optical Image and SAR Image Based on Spatial-spectral Attention

Hyperspectral and Multispectral Image Fusion Based on Deep Attention Network.

Triplet Attention Feature Fusion Network for SAR and Optical Image Land Cover Classification.

DAFCNN: A Dual-Channel Feature Extraction and Attention Feature Fusion Convolution Neural Network for SAR Image and MS Image Fusion

Hierarchical Attention and Parallel Filter Fusion Network for Multi-Source Data Classification

Hierarchical Attention and Parallel Filter Fusion Network for Multisource Data Classification

Spectral-Spatial Fused Attention Network for Hyperspectral Image Classification

Attention-guided feature fusion and joint learning for remote sensing image scene classification

A Novel Feature Fusion Approach for VHR Remote Sensing Image Classification

Feature Fusion Network Model Based on Dual Attention Mechanism for Hyperspectral Image Classification

Hyperspectral and Multi-source Heterogeneous Data Fusion Classification Based on Multiscale Multi-source Interaction Attention Network

A New Multi-Level Attention Feature Fusion Method for Hyperspectral and Lidar Data Joint Classification

Learning SAR-Optical Cross Modal Features for Land Cover Classification

A Multiscale Dual-Branch Feature Fusion and Attention Network for Hyperspectral Images Classification

A Multi-Feature Fusion Model Based on Denoising Convolutional Neural Network and Attention Mechanism for Image Classification

Spectral Feature Fusion Networks with Dual Attention for Hyperspectral Image Classification

DEN: A New Method for SAR and Optical Image Fusion and Intelligent Classification

A Multi-Branch Feature Fusion Strategy Based on an Attention Mechanism for Remote Sensing Image Scene Classification

Cross Attention-Based Multi-Scale Convolutional Fusion Network for Hyperspectral and LiDAR Joint Classification

A Spatial-Spectral Relation-Guided Fusion Network for Multisource Optical RS Image Classification

Multi-Scale Spectral-Spatial Attention Residual Fusion Network for Multi-Source Remote Sensing Data Classification