Abstract:The joint of multi-source remote sensing (RS) data for land cover classification has become a popular research topic. Although studies have shown that the fusion of multi-source data can improve the accuracy of classification, the current limitation lies in the inadequate exploitation of information, resulting in spectral confusion categories overlapping, and varying visual differences within the same category. To address these problems, this paper proposes a multi-scale spectral-spatial attention residual fusion network (MSSARFNet) that aims to enhance the classification performance of multi-source RS data through effective spectral-spatial feature extraction and fusion. Specifically, three modules are designed: the multi-scale spectral attention residual module (MSpeARM), the multi-scale spatial attention residual module (MSpaARM) and multi-scale convolution fusion (MCF) module. Firstly, we divide the channels of the features into multiple paths and apply spectral-spatial attention mechanisms on each path. To further enhance connectivity, convolutional operation is utilized to establish connections between different paths, thus forming MSpeARM and MSpaARM. The MSpeARM suppresses redundant features and enhances effective features along the channel dimension to better differentiate spectral-confused categories. The MSpaARM highlights that different visual patterns of objects in the same category can mutually reinforce each other by weighting all positional features, regardless of their spatial differences. Secondly, to fuse these two sets of features, the MCF module is designed to learn multi-level semantic features and enhance fusion at a granular level. Experimental evaluations on three RS datasets demonstrate that the proposed method achieves excellent classification performance, indicating the effectiveness of MSSARFNet. The source code of the proposed method will be available at https://github.com/wangxu0210/MSSARFNet .

Multi-Label Remote Sensing Image Land Cover Classification Based on a Multi-Dimensional Attention Mechanism

Remote Sensing Scene Image Classification Model Based on Multi-Scale Features and Attention Mechanism

A Novel Multi-Attention Driven System for Multi-Label Remote Sensing Image Classification

Combining Multilevel Features for Remote Sensing Image Scene Classification With Attention Model

Multi-Scale Spectral-Spatial Attention Residual Fusion Network for Multi-Source Remote Sensing Data Classification

Multi-Attention-Based Semantic Segmentation Network for Land Cover Remote Sensing Images

Attention Based Residual Network For High-Resolution Remote Sensing Imagery Scene Classification

Multi-Modality and Multi-Scale Attention Fusion Network for Land Cover Classification from VHR Remote Sensing Images

Multi-Label Image Classification with Attention Mechanism and Graph Convolutional Networks

A Multiscale Attention Network for Remote Sensing Scene Images Classification

Ebbinghaus-Curve Guided Low-Rank Component-Induced Attention for Multisource Remote Sensing Classification

A Spatial Attention Guided Scene Classification Method for Multiscale Remote Sensing Dataset

Attention-based DenseNet network for multi-source remote sensing classification

Multi-Scale Feature Reconstruction and Inter-Class Attention Weighting for Land Cover Classification

Attention Fusion of Transformer-Based and Scale-Based Method for Hyperspectral and LiDAR Joint Classification

Dual Attention Feature Fusion and Adaptive Context for Accurate Segmentation of Very High-Resolution Remote Sensing Images

Label-Guided Cross-Modal Attention Network for Multi-Label Aerial Image Classification

Semi-Supervised Multi-Spectral Land Cover Classification With Multi-Attention And Adaptive Kernel

A Multi-Scale Pseudo-Siamese Network with an Attention Mechanism for Classification of Hyperspectral and LiDAR Data.

Remote Sensing Scene Classification Via Multi-Branch Local Attention Network.

Multi-Scale Cross-Modal Spatial Attention Fusion for Multi-label Image Recognition.