Abstract:Hyperspectral imagery typically possesses high spectral resolution but low spatial resolution. One way to enhance the spatial resolution of a hyperspectral image is to fuse its spectral information and the spatial information of another high resolution image. In this paper, we propose a novel image fusion strategy for hyperspectral image and high spatial resolution panchromatic image, which is based on the curvelet transform. Firstly, determine a synthesized image with the specified RGB bands of the original hyperspectral images according to the optimal index factor (OIF) model. Then use the IHS transform to extract the intensity component of the synthesized image. After that, the histogram matching is performed between the intensity component and the panchromatic image. Thirdly, the curvelet transform is applied to decompose the two source images (the intensity component and the panchromatic image) in different scales and directions. Different fusion strategies are applied to coefficients in various scales and directions. Finally, the fused image is achieved by the inverse IHS transform. The experimental result shows that the proposed method has a superior performance. Comparing with the traditional methods such as the PCA transform, wavelet-based or pyramid-based methods and the multi-resolution fusion methods (shearlet or contourlet decomposition), the fused image achieves the highest entropy index and average gradient value. While providing a better human visual quality, a good correlation coefficient index indicates that the fused image keeps good spectral information. Both visual quality and objective evaluation criteria demonstrate that this method can well preserve the spatial quality and the spectral characteristics.

FUSION OF HYPERSPECTRAL AND PANCHROMATIC IMAGES BASED ON MATTING MODEL

Hyperspectral and Multispectral Image Fusion Based on Deep Attention Network.

Curvelet Based Hyperspectral Image Fusion

Unaligned Hyperspectral Image Fusion Via Registration and Interpolation Modeling

Fusion of infrared and visual images through multiscale hybrid unidirectional total variation

Fusion of Hyperspectral and Multispectral Images: A Novel Framework Based on Generalization of Pan-Sharpening Methods

Multi-Spectral and Panchromatic Image Fusion Based on His-Wavelet Transform and Mopso Algorithm

Coupled Spatial-Spectral Constrained Convolutional Fusion Network for Hyperspectral and Panchromatic images

Fusion of Hyperspectral and Panchromatic Images using Spectral Uumixing Results

Multispectral and Panchromatic Image Fusion Based on Unsubsampled Contourlet Transform

Patch-Aware Deep Hyperspectral and Multispectral Image Fusion by Unfolding Subspace-Based Optimization Model

Hyperspectral and Multispectral Image Fusion Based on Low Rank Constrained Gaussian Mixture Model.

Fusion of multispectral and panchromatic images based on support value transform and adaptive principal component analysis

Multispectral and Hyperspectral Image Fusion Based on Regularized Coupled Non-Negative Block-Term Tensor Decomposition

Multispectral and Panchromatic Image Fusion Based on Improved Bilateral Filter

Remote-sensing Image Fusion Based on IHS and Morphological Wavelet Transforms

Revisiting Spatial-Frequency Information Integration from a Hierarchical Perspective for Panchromatic and Multi-Spectral Image Fusion

Image Fusion for Spatial Enhancement of Hyperspectral Image via Pixel Group Based Non-Local Sparse Representation

A new scheme for fusion of multispectral and panchromatic images based on residual error

Hypercomplex Principle Component Weighted Approach to Multiplespectral and Panchromatic Images Fusions

A Deep Unfolding Network for Multispectral and Hyperspectral Image Fusion