Abstract:The joint of multi-source remote sensing (RS) data for land cover classification has become a popular research topic. Although studies have shown that the fusion of multi-source data can improve the accuracy of classification, the current limitation lies in the inadequate exploitation of information, resulting in spectral confusion categories overlapping, and varying visual differences within the same category. To address these problems, this paper proposes a multi-scale spectral-spatial attention residual fusion network (MSSARFNet) that aims to enhance the classification performance of multi-source RS data through effective spectral-spatial feature extraction and fusion. Specifically, three modules are designed: the multi-scale spectral attention residual module (MSpeARM), the multi-scale spatial attention residual module (MSpaARM) and multi-scale convolution fusion (MCF) module. Firstly, we divide the channels of the features into multiple paths and apply spectral-spatial attention mechanisms on each path. To further enhance connectivity, convolutional operation is utilized to establish connections between different paths, thus forming MSpeARM and MSpaARM. The MSpeARM suppresses redundant features and enhances effective features along the channel dimension to better differentiate spectral-confused categories. The MSpaARM highlights that different visual patterns of objects in the same category can mutually reinforce each other by weighting all positional features, regardless of their spatial differences. Secondly, to fuse these two sets of features, the MCF module is designed to learn multi-level semantic features and enhance fusion at a granular level. Experimental evaluations on three RS datasets demonstrate that the proposed method achieves excellent classification performance, indicating the effectiveness of MSSARFNet. The source code of the proposed method will be available at https://github.com/wangxu0210/MSSARFNet .

Semisupervised Remote Sensing Image Fusion Using Multiscale Conditional Generative Adversarial Network with Siamese Structure.

Semi-Supervised Remote Sensing Image Fusion Method Combining Siamese Structure with Generative Adversarial Networks

Remote Sensing Image Fusion with Convolutional Neural Network

Remote Sensing Image Fusion With Task-Inspired Multiscale Nonlocal-Attention Network

Remote Sensing Image Fusion Using Multi-Scale Convolutional Neural Network

A Unified Generative Adversarial Network With Convolution and Transformer for Remote Sensing Image Fusion

Multiresolution Generative Adversarial Networks with Bidirectional Adaptive-Stage Progressive Guided Fusion for Remote Sensing Image

MDRDA-GAN: A Multi-discriminator Generative Adversarial Network Based on Residual Dense Attention for Remote Sensing Image Fusion

SADFusion: A multi-scale infrared and visible image fusion method based on salient-aware and domain-specific

Multispectral Image Fusion Using Super-Resolution Conditional Generative Adversarial Networks

Model-Guided Coarse-to-Fine Fusion Network for Unsupervised Hyperspectral Image Super-Resolution.

Semantic-Aware Fusion Network Based on Super-Resolution

MRASFusion: A Multi-Scale Residual Attention Infrared and Visible Image Fusion Network Based on Semantic Segmentation Guidance

An Adaptive Image Fusion Method for Sentinel-2 Images and High-Resolution Images with Long-Time Intervals.

Multi-Scale Spectral-Spatial Attention Residual Fusion Network for Multi-Source Remote Sensing Data Classification

Lightweight Remote-Sensing Image Super-Resolution Via Attention-Based Multilevel Feature Fusion Network

Remote Sensing Image Super-Resolution Via Residual Aggregation and Split Attentional Fusion Network

Dual attention deep fusion semantic segmentation networks of large-scale satellite remote-sensing images

Hyperspectral and SAR Image Classification via Multiscale Interactive Fusion Network

Semantic-supervised Infrared and Visible Image Fusion via a Dual-discriminator Generative Adversarial Network

Multispectral and SAR Image Fusion for Multiscale Decomposition Based on Least Squares Optimization Rolling Guidance Filtering