Abstract:Pan-sharpening aims to super-resolve the low-resolution (LR) multispectral (MS) image under the guidance of a high-resolution (HR) panchromatic (PAN) image. Existing deep learning (DL)-based pan-sharpening methods usually adhere to a common philosophy of learning complementary information between MS and PAN images. Despite remarkable advances, few studies consider the band-private characteristics which differ greatly from band to band. An ideal MS image, however, is jointly determined by its diverse spectral bands, thus the accurate restoration of every band will benefit the pan-sharpening performance. In this work, we propose a novel yet effective solution to reconstruct the HRMS image by explicitly modulating every spectral band under the conditions of the PAN image. As a result, we design a spatially-adaptive spectral modulation network, dubbed SSMNet, which consists of three core designs: source-aware spectral modulator (SSM), cross-band information aggregation (CBIA) module, and cross-stage feature integration (CSFI) module. The first predicts a series of spatially-adaptive kernels to capture the local information of every spectral band. Followed by, the second is responsible for facilitating the information communication among various bands to guarantee continuous spectral representations. Furthermore, the third attends to integrate the cross-stage output features to produce the pan-sharpened result. In addition, we also introduce the histogram loss to constrain the band-wise distribution of the final fused products. Extensive experiments demonstrate that our SSMNet achieves favorable performance against other state-of-the-art (SOTA) methods on multiple satellite datasets. The code is available at https://github.com/ez4lionky/SSMNet/ .

A Framelet-Based Iterative Pan-Sharpening Approach

Framelet based pan-sharpening via a variational method

A FRAMELET SPARSE RECONSTRUCTION METHOD FOR PANSHARPENING WITH GUARANTEED CONVERGENCE

DuCoFPan: Dual-Condition Flow-based Network for Pan-sharpening

Pansharpening via semi-framelet-guided sparse reconstruction

A Pan-Sharpening Method Based on the ADMM Algorithm

PAN-Guided Band-Aware Multi-Spectral Feature Enhancement for Pan-Sharpening

Pan-Sharpening by Multilevel Interband Structure Modeling.

Pansharpening by Combining Enhanced Spatial-Spectral Fidelity and Gradient-Domain Guided Filtering

Pan-sharpening of multi-spectral images using a new variational model

Pan-sharpening: a Fast Variational Fusion Approach

Learning Interpolation Via Regional Map for Pan-Sharpening

An IHS-Based Pan-Sharpening Method for Spectral Fidelity Improvement Using Ripplet Transform and Compressed Sensing

Multispectral Image Pan-Sharpening Guided by Component Substitution Model

LRTCFPan: Low-Rank Tensor Completion Based Framework for Pansharpening

Pan-sharpening Method Based on Unsupervised and Divide-and-conquer Strategies

A variational approach for pan-sharpening.

Rethinking Pan-Sharpening Via Spectral-Band Modulation

Panchromatic and Multispectral Image Fusion via Alternating Reverse Filtering Network

The Fusion of Panchromatic and Multispectral Remote Sensing Images Via Tensor-Based Sparse Modeling and Hyper-Laplacian Prior

Structure Tensor-Driven Block-Based Adaptive Variational Pansharpening