Abstract:With the development of remote sensing technology, panchromatic images (PANs) and multispectral images (MSs) can be easily obtained. PAN has higher spatial resolution, while MS has more spectral information. So how to use the two kinds of images’ characteristics to design a network has become a hot research field. In this article, a multi-scale progressive collaborative attention network (MPCA-Net) is proposed for PAN and MS’s fusion classification. Compared to the traditional multi-scale convolution operations, we adopt an adaptive dilation rate selection strategy (ADR-SS) to adaptively select the dilation rate to deal with the problem of category area’s excessive scale differences. For the traditional pixel-by-pixel sliding window sampling strategy, the patches which are generated by adjacent pixels but belonging to different categories contain a considerable overlap of information. So we change original sampling strategy and propose a center pixel migration (CPM) strategy. It migrates the center pixel to the most similar position of the neighborhood information for classification, which reduces network confusion and increases its stability. Moreover, due to the different spatial and spectral characteristics of PAN and MS, the same network structure for the two branches ignores their respective advantages. For a certain branch, as the network deepens, characteristic has different representations in different stages, so using the same module in multiple feature extraction stages is inappropriate. Thus we carefully design different modules for each feature extraction stage of the two branches. Between the two branches, because the strong mapping methods of directly cascading their features are too rough, we design collaborative progressive fusion modules to eliminate the differences. The experimental results verify that our proposed method can achieve competitive performance.

Novel Cross-Resolution Feature-Level Fusion for Joint Classification of Multispectral and Panchromatic Remote Sensing Images

Multi-Scale Cross-Attention Fusion Network Based on Image Super-Resolution

A Novel Feature Fusion Approach for VHR Remote Sensing Image Classification

GCFnet: Global Collaborative Fusion Network for Multispectral and Panchromatic Image Classification

A Novel Adaptive Hybrid Fusion Network for Multiresolution Remote Sensing Images Classification

Aerial Scene Classification Via Multilevel Fusion Based on Deep Convolutional Neural Networks.

A novel cross fusion model with fine-grained detail reconstruction for remote sensing image pan-sharpening

Cross Attention-Based Multi-Scale Convolutional Fusion Network for Hyperspectral and LiDAR Joint Classification

A Spatial-Channel Progressive Fusion ResNet for Remote Sensing Classification.

A Multi-Scale Progressive Collaborative Attention Network for Remote Sensing Fusion Classification.

A Dual-Branch Attention Fusion Deep Network for Multiresolution Remote-Sensing Image Classification

Joint Feature Extraction for Multispectral and Panchromatic Images Based on Convolutional Neural Network

Cross-Resolution Semi-Supervised Adversarial Learning for Pansharpening.

A Joint Convolutional Cross ViT Network for Hyperspectral and Light Detection and Ranging Fusion Classification

Multimodal Sensors Image Fusion for Higher Resolution Remote Sensing Pan Sharpening

Joint Classification of Hyperspectral and LiDAR Data Using a Hierarchical CNN and Transformer

Deep Multi-Level Fusion Network for Multi-Source Image Pixel-Wise Classification

Joint Classification of Hyperspectral and Lidar Data Using Cross-Modal Hierarchical Frequency Fusion Network

A Distributed Fusion Framework of Multispectral and Panchromatic Images Based on Residual Network

A Hierarchical Coarse–Fine Adaptive Fusion Network for the Joint Classification of Hyperspectral and LiDAR Data

Real-time and effective pan-sharpening for remote sensing using multi-scale fusion network