Abstract:In the situations of image fusion between the panchromatic (PAN) and the multispectral (MS) image, it is an ideal thing to properly absorb the source image ingredients to reach the best state of the space clarity and the spectrum feature in the fusion image. Principal component analysis (PCA), Contourlet and Curvelet methods are easy to bring about serious color loss during the process of image fusion. The method using PCA and multi-resolution wavelet transform (MWT) with the corresponding fusion rules can be used to remedy the faultiness. MWT includes non-decimated wavelet transform (NDWT), wavelet package transform (WPT) and lifting wavelet transform (LWT) in the study. The main ideas of this study embody the three aspects. Firstly, the original MS image is converted by using PCA to get the first principal component: PC1. Secondly, NDWT, WPT and LWT are applied to decompose the PAN image and the PC1 image, respectively. A new PC1 can be reconstructed after the reversed wavelet transform when the different fusion rules are adopted in the low- and the high-frequency domains separately. Lastly, the inverse PCA transform is performed by combining the new PC1 and the other two components of the MS image. In terms of the same series of MWT, the experimental criteria perform as follows. The proposed fusion rule of each MWT gets the best value of the SSIM, which are 0.7747, 0.7696 and 0.7504 for the first group of data and 0.7747, 0.7696 and 0.7504 for the second group of data. The OP criterion performance ranks the second; and other criteria highlight the advantages of the fusion rule. By comparing with other fusion methods, there are three points concluded as follows. Firstly, fusion methods based on wavelet analysis are better than those based on super-wavelet analysis in some image fusion situations. Secondly, mutual comparison among these three fusion frames which refer to PCA combining with NDWT, WPT and LWT, respectively, can lead to the fusion performances including spatial clarity and spectral loss under various rules. Thirdly, the proposed fusion rule can play the maximum complementarity of the two aspects when combining PCA with WPT.

Principle Component Analysis Based Hyperspectral Image Fusion in Imaging Spectropolarimeter

Curvelet Based Hyperspectral Image Fusion

Spectral-Spatial Classification of Hyperspectral Image Using Improved Functional Principal Component Analysis

Multi-Spectral Remote Sensing Image Enhancement Method Based on Pca and Ihs Transformations

Hyperspectral and Multispectral Image Fusion Based on Deep Attention Network.

Unaligned Hyperspectral Image Fusion Via Registration and Interpolation Modeling

Multi-Dimensional Fusion of Spectral and Polarimetric Images Followed by Pseudo-Color Algorithm Integration and Mapping in HSI Space

Hypercomplex Principle Component Weighted Approach to Multiplespectral and Panchromatic Images Fusions

Pca and Wavelet Transform for Fusing Panchromatic and Multi-Spectral Images

A pixel-level fusion method for multi-source optical remote sensing image combining the principal component analysis and curvelet transform

The Realistic Fusion of Multi-spectral Images

The Study on Image Fusion for Medium and High Spatial Resolution Remote Sensing Images

Performance Comparison of Image Fusion Alternatives Combining PCA with Multi-resolution Wavelet Transforms

Multi-Spectral and Panchromatic Image Fusion Based on His-Wavelet Transform and Mopso Algorithm

Image Fusion for Spatial Enhancement of Hyperspectral Image via Pixel Group Based Non-Local Sparse Representation

PCA applied to Data Fusion for Subsurface Target Imaging of Full-polarimetric GPR

An Optimized Inversion Method for Hyperspectral Image Fusion Based on a Hue–Intensity–Saturation, Wavelet, and Trust-Region Conjugate Gradient Method

Fusion of Hyperspectral and Multispectral Images: A Novel Framework Based on Generalization of Pan-Sharpening Methods

Comparison of Pixel-Based Fusion Between Multi-Spectral Data and High Spatial Resolution Data

Sparse Representation and Pca Method for Image Fusion in Remote Sensing

SWT and PCA image fusion methods for multi-modal imagery