Abstract:Pan-sharpening aims to super-resolve the low-resolution (LR) multispectral (MS) image under the guidance of a high-resolution (HR) panchromatic (PAN) image. Existing deep learning (DL)-based pan-sharpening methods usually adhere to a common philosophy of learning complementary information between MS and PAN images. Despite remarkable advances, few studies consider the band-private characteristics which differ greatly from band to band. An ideal MS image, however, is jointly determined by its diverse spectral bands, thus the accurate restoration of every band will benefit the pan-sharpening performance. In this work, we propose a novel yet effective solution to reconstruct the HRMS image by explicitly modulating every spectral band under the conditions of the PAN image. As a result, we design a spatially-adaptive spectral modulation network, dubbed SSMNet, which consists of three core designs: source-aware spectral modulator (SSM), cross-band information aggregation (CBIA) module, and cross-stage feature integration (CSFI) module. The first predicts a series of spatially-adaptive kernels to capture the local information of every spectral band. Followed by, the second is responsible for facilitating the information communication among various bands to guarantee continuous spectral representations. Furthermore, the third attends to integrate the cross-stage output features to produce the pan-sharpened result. In addition, we also introduce the histogram loss to constrain the band-wise distribution of the final fused products. Extensive experiments demonstrate that our SSMNet achieves favorable performance against other state-of-the-art (SOTA) methods on multiple satellite datasets. The code is available at https://github.com/ez4lionky/SSMNet/ .

Refined Pan-Sharpening with NSCT and Hierarchical Sparse Autoencoder.

SSETPAN: Spatial-Spectral Enhanced Transformer Based Network for Pansharpening

A New Pansharpening Method Using Multistage Joint Bilateral Filtering

A Scale-Aware Pansharpening Method with Rolling Guidance Filter.

Pan-sharpening Via Multi-Scale and Multiple Deep Neural Networks

Pan-Sharpening Of Remote Sensing Images Via Graph Regularized Sparse Coding

Pansharpening Based on Joint Gaussian Guided Upsampling.

A NOVEL TWO-STAGE GUIDED FILTERING BASED PANSHARPENING METHOD

Two-Step Sparse Coding for the Pan-Sharpening of Remote Sensing Images

A Pansharpening Based on the Non-Subsampled Contourlet Transform and Convolutional Autoencoder: Application to QuickBird Imagery

An IHS-Based Pan-Sharpening Method for Spectral Fidelity Improvement Using Ripplet Transform and Compressed Sensing

Sparse Representation-Based Detail-Injection Method for Pan-Sharpening

Spectral-Driven Pansharpening Using Adaptive Image Segmentation To Reduce Color Distortion

Pan-sharpening via regional division and NSST

Pansharpening with Joint Local Low Rank Decomposition and Hierarchical Geometric Filtering.

Pan-Sharpening by Multilevel Interband Structure Modeling.

Pan-Sharpening Based on Background Prior Saliency and Joint Sparse Detail Extraction

Pansharpening by Combining Enhanced Spatial-Spectral Fidelity and Gradient-Domain Guided Filtering

Rethinking Pan-Sharpening Via Spectral-Band Modulation

Pan-Sharpening via Multiscale Dynamic Convolutional Neural Network

Pansharpening Using a Guided Image Filter Based on Dual-Scale Detail Extraction