Abstract:Pan-sharpening aims to super-resolve the low-resolution (LR) multispectral (MS) image under the guidance of a high-resolution (HR) panchromatic (PAN) image. Existing deep learning (DL)-based pan-sharpening methods usually adhere to a common philosophy of learning complementary information between MS and PAN images. Despite remarkable advances, few studies consider the band-private characteristics which differ greatly from band to band. An ideal MS image, however, is jointly determined by its diverse spectral bands, thus the accurate restoration of every band will benefit the pan-sharpening performance. In this work, we propose a novel yet effective solution to reconstruct the HRMS image by explicitly modulating every spectral band under the conditions of the PAN image. As a result, we design a spatially-adaptive spectral modulation network, dubbed SSMNet, which consists of three core designs: source-aware spectral modulator (SSM), cross-band information aggregation (CBIA) module, and cross-stage feature integration (CSFI) module. The first predicts a series of spatially-adaptive kernels to capture the local information of every spectral band. Followed by, the second is responsible for facilitating the information communication among various bands to guarantee continuous spectral representations. Furthermore, the third attends to integrate the cross-stage output features to produce the pan-sharpened result. In addition, we also introduce the histogram loss to constrain the band-wise distribution of the final fused products. Extensive experiments demonstrate that our SSMNet achieves favorable performance against other state-of-the-art (SOTA) methods on multiple satellite datasets. The code is available at https://github.com/ez4lionky/SSMNet/ .

Pan-Sharpening Via Rog-Based Filtering

Pansharpening by Combining Enhanced Spatial-Spectral Fidelity and Gradient-Domain Guided Filtering

Pan-sharpening using a guided filter

Pan-Sharpening via Multiscale Dynamic Convolutional Neural Network

Pan-Sharpening by Multilevel Interband Structure Modeling.

An IHS-Based Pan-Sharpening Method for Spectral Fidelity Improvement Using Ripplet Transform and Compressed Sensing

Object-Based Area-to-Point Regression Kriging for Pansharpening

Pan-sharpening of multi-spectral images using a new variational model

A variational approach for pan-sharpening.

Pan-sharpening Based on Common Saliency Feature Analysis and Multiscale Spatial Information Extraction for Multiple Remote Sensing Images

Understanding Pan-Sharpening via Generalized Inverse

Pansharpening Based on Fuzzy Logic and Edge Activity

A Framelet-Based Iterative Pan-Sharpening Approach

A Pan-Sharpening Method Based on the ADMM Algorithm

Pan-sharpening Method Based on Unsupervised and Divide-and-conquer Strategies

Panchromatic and Multispectral Image Fusion via Alternating Reverse Filtering Network

Pansharpening Using Guided Filtering to Improve the Spatial Clarity of VHR Satellite Imagery

Rethinking Pan-Sharpening Via Spectral-Band Modulation

PAN-Guided Band-Aware Multi-Spectral Feature Enhancement for Pan-Sharpening

Low-rank and Sparse Matrix Decomposition-Based Pan Sharpening

Framelet based pan-sharpening via a variational method