Abstract:Pan-sharpening aims to generate high-detail multi-spectral images (HRMS) through the fusion of panchromatic (PAN) and multi-spectral (MS) images. However, existing pan-sharpening methods often suffer from significant performance degradation when dealing with out-of-distribution data, as they assume the training and test datasets are independent and identically distributed. To overcome this challenge, we propose a novel frequency domain-irrelevant feature learning framework that exhibits exceptional generalization capabilities. Our approach involves parallel extraction and processing of domain-irrelevant information from the amplitude and phase components of the input images. Specifically, we design a frequency information separation module to extract the amplitude and phase components of the paired images. The learnable high-pass filter is then employed to eliminate domain-specific information from the amplitude spectrums. After that, we devised two specialized sub-networks (AFL-Net and PFL-Net) to perform targeted learning of the frequency domain-irrelevant information. This allows our method to effectively capture the complementary domain-irrelevant information contained in the amplitude and phase spectra of the images. Finally, the information fusion and restoration module dynamically adjusts the feature channel weights, enabling the network to output high-quality HRMS images. Through this frequency domain-irrelevant feature learning framework, our method balances generalization capability and network performance on the distribution of training dataset. Extensive experiments conducted on various satellite datasets demonstrate the effectiveness of our method for generalized pan-sharpening. Our proposed network outperforms state-of-the-art methods in terms of both quantitative metrics and visual quality, showcasing its superior ability to handle diverse, out-of-distribution data.

Pan-Sharpening Using 2d Cca

DuCoFPan: Dual-Condition Flow-based Network for Pan-sharpening

Pan-Sharpening Based on Multilevel Coupled Deep Network

Pan-sharpening Via Multi-Scale and Multiple Deep Neural Networks

A New Pansharpening Method Using Multistage Joint Bilateral Filtering

Pansharpening Based on Multimodal Texture Correction and Adaptive Edge Detail Fusion

Pansharpening Based on Joint Gaussian Guided Upsampling.

Pan-sharpening via regional division and NSST

Pansharpening by Combining Enhanced Spatial-Spectral Fidelity and Gradient-Domain Guided Filtering

Pan-Sharpening by Multilevel Interband Structure Modeling.

Learning Interpolation Via Regional Map for Pan-Sharpening

Frequency Decoupled Domain-Irrelevant Feature Learning for Pan-sharpening

Pansharpening via sparse regression

Pan-Sharpening with Hessian Nuclear Norm Induced Spatial Consistency.

Pan-Sharpening Based On Parallel Pyramid Convolutional Neural Network

Multiscale Dual-Domain Guidance Network for Pan-Sharpening

A Unified Pansharpening Method with Structure Tensor Driven Spatial Consistency and Deep Plug-and-Play Priors

Pan-sharpening Based on Geometric Clustered Neighbor Embedding

Pansharpening Based on Multi-Branch CNN

Multispectral Pan-sharpening via Dual-Channel Convolutional Network with Convolutional LSTM Based Hierarchical Spatial-Spectral Feature Fusion

Pansharpening Based On An Improved Ratio Enhancement