Abstract:Interpreting remote sensing images by combining manual visual interpretation and computer automatic classification and recognition is an important application of human–computer interaction (HCI) in the field of remote sensing. Remote sensing images with high spatial resolution and high spectral resolution is an important basis for automatic classification and recognition. However, such images are often difficult to obtain directly. In order to solve the problem, a novel pan-sharpening method via multi-scale and multiple deep neural networks is presented. First, the non-subsampled contourlet transform (NSCT) is employed to decompose the high resolution (HR)/low resolution (LR) panchromatic (PAN) images into the high frequency (HF)/low frequency (LF) images, respectively. For pan-sharpening, the training sets are only sampled from the HF images. Then, the DNN is utilized to learn the feature of the HF images in different directions of HR/LR PAN images, which is trained by the image patch pair sampled from HF images of HR/LR PAN images. Moreover, in the fusion stage, NSCT is also employed to decompose the principal component of initially amplified LR multispectral (MS) image obtained by the transformation of adaptive PCA (A-PCA). The HF image patches of LR MS, as the input data of the trained DNN, go through forward propagation to obtain the output HR MS image. Finally, the output HF sub-band images and the original LF sub-band images of LR MS image fuse into a new sub-band set. The inverse transformations of NSCT and A-PCA , residual compensation are conducted to obtain the pan-sharpened HR MS. The experimental results show that our method is better than other well-known pan-sharpening methods.

Pan-Sharpening via Multiscale Dynamic Convolutional Neural Network

Pan-sharpening Via Multi-Scale and Multiple Deep Neural Networks

A New Pansharpening Method Using Multistage Joint Bilateral Filtering

A Scale-Aware Pansharpening Method with Rolling Guidance Filter.

A Novel Scale-Aware Pansharpening Method

A Multiscale and Multidepth Convolutional Neural Network for Remote Sensing Imagery Pan-Sharpening.

A Remote-Sensing Image Pan-Sharpening Method Based on Multi-Scale Channel Attention Residual Network.

A Two-Stream Multiscale Deep Learning Architecture for Pan-Sharpening

PAN-Guided Band-Aware Multi-Spectral Feature Enhancement for Pan-Sharpening

Pan-Sharpening Based on Multilevel Coupled Deep Network

Pan-Sharpening Based On Parallel Pyramid Convolutional Neural Network

Multiscale Feature Enhancement Network Based on Large Kernel Attention Mechanism for Pansharpening

Progressive Pan-Sharpening Via Cross-Scale Collaboration Networks

Pan-Sharpening Using an Efficient Bidirectional Pyramid Network

Pan-GAN: An unsupervised pan-sharpening method for remote sensing image fusion

Pan-Sharpening with Customized Transformer and Invertible Neural Network

Multiscale Dual-Domain Guidance Network for Pan-Sharpening

Pan-sharpening for compressed remote sensing images

PSMD-Net: A Novel Pan-Sharpening Method Based on a Multiscale Dense Network

A Multi-Direction Subbands And Deep Neural Networks Bassed Pan-Sharpening Method

A Multi-Scale Densely Deep Learning Method for Pansharpening.