Abstract:Pansharpening aims to produce a high spatial resolution multispectral (HRMS) image by combining a low spatial resolution multispectral (LRMS) image with a high-resolution panchromatic (PAN) image through a fusion process. Deep learning (DL)-based pansharpening methods have demonstrated impressive results in generating high-quality HRMS images. However, they suffer from a lack of interpretability due to their black-box network architectures. Recently, model-based deep unrolling networks have been proposed to improve the interpretability of networks. Among these approaches, the multisource convolutional sparse coding (MCSC)-based models stand out by effectively learning common and unique features from both LRMS and PAN images, showing promising results. As the LRMS image provides limited information in MCSC-based models, it can result in weak feature response and even lead to incorrect fusion outcomes. To address this issue, we propose a novel deep MCSC-based method that enhances the robustness and performance. Specifically, we build an optimization model that integrates MCSC with a degradation model and a deep prior, which can sufficiently capture the common information shared by the latent HRMS images and PAN images, thereby enabling the recovery of more accurate spectral information. To optimize the proposed model, we adopt an iterative optimization strategy that unfolds the iterative solution into networks. Moreover, we propose an enhanced version of our method that utilizes multiscale dictionaries to capture common and unique features at different scales, thereby facilitating the extraction of more abundant spectral and spatial details. We evaluate the effectiveness of our proposed method on multiple benchmark datasets. Experiment results demonstrate its effectiveness in improving the robustness and performance of MCSC-based models.

USM Sharpening Detection Based on Sparse Coding

Edge Perpendicular Binary Coding for USM Sharpening Detection

An efficient USM sharpening detection method for small-size JPEG image

USM Sharpening Detection Based on Grey-Level Dependence Matrix and Cumulative Sum of Histogram on Difference Image

Anti-Forensics for Unsharp Masking Sharpening in Digital Images

Improved Sparse Representation Algorithm for Optical Coherence Tomography Images

SharpenNet: Detecting Anti-Forensics USM Sharpening Adversarial Examples Based on ConvNeXt

Fast SIFT algorithm based on Sobel edge detector

Sparse Representation over Shared Coefficients in Multispectral Pansharpening

Learning to utilize image second-order derivative information for crisp edge detection

A No-Reference Image Sharpness Metric Based on Structural Information Using Sparse Representation

Pan-sharpening Based on Common Saliency Feature Analysis and Multiscale Spatial Information Extraction for Multiple Remote Sensing Images

CS-Net: Deep Multibranch Network Considering Scene Features for Sharpness Assessment of Remote Sensing Images

Pansharpening Based on Fuzzy Logic and Edge Activity

DMCSC: Deep Multisource Convolutional Sparse Coding Model for Pansharpening

An Object-Oriented Visual Saliency Detection Framework Based on Sparse Coding Representations

An Edge Detection Algorithm for SEM Images of Multilayer Thin Films

Image‐splicing forgery detection based on local binary patterns of DCT coefficients

Pansharpening Using IHS Method on Multi-sensor Data and Multiple Feature Extraction Using Modified Otsu Thresholding

Pan-Sharpening Based on Nonparametric Bayesian Adaptive Dictionary Learning

Extracting Sharp Features from RGB‐D Images