Abstract:It is generally known that pan-sharpening is fundamentally a PAN-guided multispectral (MS) image super-resolution problem that involves learning the nonlinear mapping from low-resolution (LR) to high-resolution (HR) MS images. Since an infinite number of HR-MS images can be downsampled to produce the same corresponding LR-MS image, learning the mapping from LR-MS to HR-MS image is typically ill-posed and the space of the possible pan-sharpening functions can be extremely large, making it difficult to estimate the optimal mapping solution. To address the above issue, we propose a closed-loop scheme that learns the two opposite mapping including the pan-sharpening and its corresponding degradation process simultaneously to regularize the solution space in a single pipeline. More specifically, an invertible neural network (INN) is introduced to perform a bidirectional closed-loop: the forward operation for LR-MS pan-sharpening and the backward operation for learning the corresponding HR-MS image degradation process. In addition, given the vital importance of high-frequency textures for the Pan-sharpened MS images, we further strengthen the INN by designing a specified multiscale high-frequency texture extraction module. Extensive experimental results demonstrate that the proposed algorithm performs favorably against state-of-the-art methods qualitatively and quantitatively with fewer parameters. Ablation studies also verify the effectiveness of the closed-loop mechanism in pan-sharpening. The source code is made publicly available at https://github.com/manman1995/pan-sharpening-Team-zhouman/.

Iterated Data Sharpening

High-order Data Sharpening with Dependent Errors for Regression Bias Reduction

Data Sharpening Method in Regression Confidence Band

Automatic and asymptotically optimal data sharpening for nonparametric regression

Supervised Kernel Thinning

Rethinking Pan-Sharpening in Closed-Loop Regularization

Understanding Sparse Feature Updates in Deep Networks using Iterative Linearisation

High dimensional analysis reveals conservative sharpening and a stochastic edge of stability

A Variational Pansharpening Approach Based on Reproducible Kernel Hilbert Space and Heaviside Function.

Bias Reduction in Sample-Based Optimization

Efficient and fast spline-backfitted kernel smoothing of additive models

Enhancing Kernel Flexibility Via Learning Asymmetric Locally-Adaptive Kernels.

High-Dimensional Kernel Methods under Covariate Shift: Data-Dependent Implicit Regularization

Local Linear Smoothers Using Asymmetric Kernels

A Gradient-Domain-Based Edge-Preserving Sharpen Filter

Randomized Sharpness-Aware Training for Boosting Computational Efficiency in Deep Learning

On the Interplay Between Stepsize Tuning and Progressive Sharpening

Variable bandwidth kernel regression estimation

Second-order regression models exhibit progressive sharpening to the edge of stability

Efficient and fast spline-backfitted kernel smoothing of additive regression model ∗

Stabilised Inverse Flowline Evolution for Anisotropic Image Sharpening