Abstract:In remote sensing image fusion, pansharpening is a type of remote sensing image fusion method that aims to fuse panchromatic (PAN) images and multispectral (MS) images to produce high-resolution MS (HRMS) images. Deep learning-based pansharpening technology offers a series of advanced unsupervised algorithms. However, there are several challenges: 1) the existing unsupervised pansharpening methods only consider the fusion of single-scale features; 2) for the fusion of MS and PAN image feature branches, the existing pansharpening methods are implemented directly by concatenation and summation, without paying attention to critical features or suppressing redundant features; and 3) the semantic gap in the long skip connections of the network architecture will create unexpected results. In this article, we design a multiscale unsupervised architecture based on generative adversarial networks (GANs) for remote sensing image pansharpening (Mun-GAN), which consists of a generator and two discriminators. The generator includes a multiscale feature extractor (MFE), a self-adaptation weighted fusion (SWF) module, and a nest feature aggregation (NFA) module. First, the MFE is utilized to extract multiscale feature information from the input images and to then pass this information to the SWF module for adaptive weight fusion. Then, multiscale features are reconstructed by the NFA module to obtain HRMS images. The two discriminators are spectral and spatial discriminators used against the generator. Moreover, we design a hybrid loss function to aggregate the multiscale spectral and spatial feature information. Compared with other state-of-the-art methods using QuickBird, GaoFen-2, and WorldView-3 images, this demonstrates that the Mun-GAN yields better fusion results.

PSGAN: A Generative Adversarial Network for Remote Sensing Image Pan-Sharpening

Pan-GAN: An unsupervised learning method for pan-sharpening in remote sensing image fusion using a generative adversarial network

Pan-GAN: An unsupervised pan-sharpening method for remote sensing image fusion

PC-GANs: Progressive Compensation Generative Adversarial Networks for Pan-sharpening

UPanGAN: Unsupervised pansharpening based on the spectral and spatial loss constrained Generative Adversarial Network

PGMAN: an Unsupervised Generative Multi-adversarial Network for Pan-sharpening

An Improved Method for Pan-Sharpening Based on Pan-GAN

FGF-GAN: A Lightweight Generative Adversarial Network for Pansharpening Via Fast Guided Filter.

PGMAN: an Unsupervised Generative Multiadversarial Network for Pansharpening

Unsupervised Cycle-Consistent Generative Adversarial Networks for Pan Sharpening

Mun-GAN: A Multiscale Unsupervised Network for Remote Sensing Image Pansharpening

Residual Encoder–Decoder Conditional Generative Adversarial Network for Pansharpening

Self-Supervised Pansharpening Based on a Cycle-Consistent Generative Adversarial Network

UPGAN: an Unsupervised Generative Adversarial Network Based on U-Shaped Structure for Pansharpening

Generative Dual-Adversarial Network with Spectral Fidelity and Spatial Enhancement for Hyperspectral Pansharpening

SWPanGAN: A hybrid generative adversarial network for pansharpening

Unsupervised Frequency Domain Information Guided Generative Adversarial Networks for Pan-Sharpening

Generating Adversarial Remote Sensing Images via Pan-Sharpening Technique

E-DBPN: Enhanced Deep Back-Projection Networks for Remote Sensing Scene Image Superresolution

HPGAN: Hyperspectral Pansharpening Using 3-D Generative Adversarial Networks

An Unsupervised Generative Adversarial Network Based on U-Shaped Structure for Pansharpening