Abstract:Pan-sharpening aims to generate high-spatial resolution multi-spectral (MS) image by fusing high-spatial resolution panchromatic (PAN) image and its corresponding low-spatial resolution MS image. Despite the remarkable progress, most existing pan-sharpening methods only work in the spatial domain and rarely explore the potential solutions in the frequency domain. In this paper, we propose a novel pan-sharpening framework by adaptively learning low-high frequency information integration in the spatial and frequency dual domains. It consists of three key designs: mask prediction sub-network, low-frequency learning sub-network and high-frequency learning sub-network. Specifically, the first is responsible for measuring the modality-aware frequency information difference of PAN and MS images and further predicting the low-high frequency boundary in the form of a two-dimensional mask. In view of the mask, the second adaptively picks out the corresponding low-frequency components of different modalities and then restores the expected low-frequency one by spatial and frequency dual domains information integration while the third combines the above refined low-frequency and the original high-frequency for the latent high-frequency reconstruction. In this way, the low-high frequency information is adaptively learned, thus leading to the pleasing results. Extensive experiments validate the effectiveness of the proposed network and demonstrate the favorable performance against other state-of-the-art methods. The source code will be released at https://github.com/manman1995/pansharpening.

High-Quality Bayesian Pansharpening.

DuCoFPan: Dual-Condition Flow-based Network for Pan-sharpening

Pansharpening by Combining Enhanced Spatial-Spectral Fidelity and Gradient-Domain Guided Filtering

Enhanced Back-Projection As Postprocessing for Pansharpening

Pansharpening Based on Fuzzy Logic and Edge Activity

Hyperspectral Pansharpening: A Review

Pan-Sharpening by Multilevel Interband Structure Modeling.

Pan-sharpening: a Fast Variational Fusion Approach

A Pan-Sharpening Method Based on the ADMM Algorithm

PAN-Guided Band-Aware Multi-Spectral Feature Enhancement for Pan-Sharpening

Pan-sharpening of multi-spectral images using a new variational model

A Two-Stage Pansharpening Method for the Fusion of Remote-Sensing Images

Pan-Sharpening Based on Nonparametric Bayesian Adaptive Dictionary Learning

A variational approach for pan-sharpening.

Pansharpening by Exploiting Sharpness of the Spatial Structure

A Variational Pansharpening Approach Based on Reproducible Kernel Hilbert Space and Heaviside Function.

Towards Robust Pansharpening: A Large-Scale High-Resolution Multi-Scene Dataset and Novel Approach

Adaptively Learning Low-high Frequency Information Integration for Pan-sharpening

Pan-sharpening using a guided filter

A Survey of Pansharpening Methods with A New Band-Decoupled Variational Model

A Variational Method with Kernel Estimation and Low Rank Prior for Pansharpening.