Abstract:Supervised pansharpening methods require the ground truth, which is generally unavailable. Therefore, the popularity of unsupervised pansharpening methods has increased. Generative adversarial networks (GANs) are often employed for unsupervised pansharpening, although achieving precise control over the generation process to capture rich spatial and spectral details is challenging. CycleGAN introduces cycle consistency loss and utilizes the cooperative training of two generators and two discriminators to learn the mapping between different domains. This approach partially addresses the issue of limited control over the generated results in traditional GANs. Therefore, CycleGAN also can be employed to accomplish unsupervised pansharpening tasks. However, it is complicated to directly apply the network structure of CycleGAN to pansharpening. To address this issue, we integrate a process model capable of simulating spatial and spectral degradations into a single-generator CycleGAN, which can learn the target distribution. Specifically, we propose an unsupervised CycleGAN for pansharpening based on spatial and spectral degradations and consists of one lightweight generator and two discriminators. Then, the low-resolution multispectral and panchromatic images are considered as the spatial and spectral degradations of the high-resolution multispectral images. Besides, unsupervised loss functions consisting of cycle consistency, adversarial, spectral angle mapper, and edge enhancement losses are designed to preserve spectral and spatial information. The experimental results on the QuickBird, GeoEye-1, and GF-2 datasets show that the qualitative and quantitative analysis of the proposed method is comparable with most supervised methods and superior to most unsupervised methods.

Unsupervised Cycle-Consistent Generative Adversarial Networks for Pan Sharpening

Self-Supervised Pansharpening Based on a Cycle-Consistent Generative Adversarial Network

DuCoFPan: Dual-Condition Flow-based Network for Pan-sharpening

Pan-GAN: An unsupervised learning method for pan-sharpening in remote sensing image fusion using a generative adversarial network

Unsupervised Frequency Domain Information Guided Generative Adversarial Networks for Pan-Sharpening

Unsupervised Single-Generator CycleGAN-Based Pansharpening with Spatial-Spectral Degradation Modeling

An Unsupervised Generative Adversarial Network Based on U-Shaped Structure for Pansharpening

UPanGAN: Unsupervised pansharpening based on the spectral and spatial loss constrained Generative Adversarial Network

Pan-GAN: An unsupervised pan-sharpening method for remote sensing image fusion

PC-GANs: Progressive Compensation Generative Adversarial Networks for Pan-sharpening

PGMAN: an Unsupervised Generative Multi-adversarial Network for Pan-sharpening

Pan-sharpening Method Based on Unsupervised and Divide-and-conquer Strategies

UPGAN: an Unsupervised Generative Adversarial Network Based on U-Shaped Structure for Pansharpening

Pansharpening Using Unsupervised Generative Adversarial Networks with Recursive Mixed-Scale Feature Fusion

An Improved Method for Pan-Sharpening Based on Pan-GAN

PGMAN: an Unsupervised Generative Multiadversarial Network for Pansharpening

FGF-GAN: A Lightweight Generative Adversarial Network for Pansharpening Via Fast Guided Filter.

Unsupervised Pansharpening Based on Double-Cycle Consistency

PSGAN: A Generative Adversarial Network for Remote Sensing Image Pan-Sharpening

Unsupervised Pan-Sharpening Via Mutually Guided Detail Restoration

Mun-GAN: A Multiscale Unsupervised Network for Remote Sensing Image Pansharpening