Abstract:The joint of multi-source remote sensing (RS) data for land cover classification has become a popular research topic. Although studies have shown that the fusion of multi-source data can improve the accuracy of classification, the current limitation lies in the inadequate exploitation of information, resulting in spectral confusion categories overlapping, and varying visual differences within the same category. To address these problems, this paper proposes a multi-scale spectral-spatial attention residual fusion network (MSSARFNet) that aims to enhance the classification performance of multi-source RS data through effective spectral-spatial feature extraction and fusion. Specifically, three modules are designed: the multi-scale spectral attention residual module (MSpeARM), the multi-scale spatial attention residual module (MSpaARM) and multi-scale convolution fusion (MCF) module. Firstly, we divide the channels of the features into multiple paths and apply spectral-spatial attention mechanisms on each path. To further enhance connectivity, convolutional operation is utilized to establish connections between different paths, thus forming MSpeARM and MSpaARM. The MSpeARM suppresses redundant features and enhances effective features along the channel dimension to better differentiate spectral-confused categories. The MSpaARM highlights that different visual patterns of objects in the same category can mutually reinforce each other by weighting all positional features, regardless of their spatial differences. Secondly, to fuse these two sets of features, the MCF module is designed to learn multi-level semantic features and enhance fusion at a granular level. Experimental evaluations on three RS datasets demonstrate that the proposed method achieves excellent classification performance, indicating the effectiveness of MSSARFNet. The source code of the proposed method will be available at https://github.com/wangxu0210/MSSARFNet .

Multi-Scale Spectral-Spatial Attention Residual Fusion Network for Multi-Source Remote Sensing Data Classification

Multiscale 3-D-2-D Mixed CNN and Lightweight Attention-Free Transformer for Hyperspectral and LiDAR Classification

Remote Sensing Scene Image Classification Model Based on Multi-Scale Features and Attention Mechanism

Dynamic Convolution Covariance Network Using Multi-Scale Feature Fusion for Remote Sensing Scene Image Classification

Multi-Scale Cross-Attention Fusion Network Based on Image Super-Resolution

Hyperspectral and SAR Image Classification via Multiscale Interactive Fusion Network

Cross Attention-Based Multi-Scale Convolutional Fusion Network for Hyperspectral and LiDAR Joint Classification

Developing and establishing online student learning communities.

MS2CANet: Multiscale Spatial–Spectral Cross-Modal Attention Network for Hyperspectral Image and LiDAR Classification

Hierarchical Attention and Parallel Filter Fusion Network for Multi-Source Data Classification

MFFnet: Multimodal Feature Fusion Network for Synthetic Aperture Radar and Optical Image Land Cover Classification

Multi-Modal Fusion Architecture Search for Land Cover Classification Using Heterogeneous Remote Sensing Images.

Sparse Focus Network for Multi-Source Remote Sensing Data Classification

Multilayer Feature Fusion Network With Spatial Attention and Gated Mechanism for Remote Sensing Scene Classification

A3 CLNN: Spatial, Spectral and Multiscale Attention ConvLSTM Neural Network for Multisource Remote Sensing Data Classification

MSFF: A Multi-Scale Feature Fusion Convolutional Neural Network for Hyperspectral Image Classification

Adaptive Multiscale Deep Fusion Residual Network for Remote Sensing Image Classification

Ebbinghaus-Curve Guided Low-Rank Component-Induced Attention for Multisource Remote Sensing Classification

Hierarchical Attention and Parallel Filter Fusion Network for Multisource Data Classification

OPT-SAR-MS2Net: A Multi-Source Multi-Scale Siamese Network for Land Object Classification Using Remote Sensing Images

MCAFNet: Multi-Channel Attention Fusion Network-Based CNN For Remote Sensing Scene Classification