Abstract:Hyperspectral imagery typically possesses high spectral resolution but low spatial resolution. One way to enhance the spatial resolution of a hyperspectral image is to fuse its spectral information and the spatial information of another high resolution image. In this paper, we propose a novel image fusion strategy for hyperspectral image and high spatial resolution panchromatic image, which is based on the curvelet transform. Firstly, determine a synthesized image with the specified RGB bands of the original hyperspectral images according to the optimal index factor (OIF) model. Then use the IHS transform to extract the intensity component of the synthesized image. After that, the histogram matching is performed between the intensity component and the panchromatic image. Thirdly, the curvelet transform is applied to decompose the two source images (the intensity component and the panchromatic image) in different scales and directions. Different fusion strategies are applied to coefficients in various scales and directions. Finally, the fused image is achieved by the inverse IHS transform. The experimental result shows that the proposed method has a superior performance. Comparing with the traditional methods such as the PCA transform, wavelet-based or pyramid-based methods and the multi-resolution fusion methods (shearlet or contourlet decomposition), the fused image achieves the highest entropy index and average gradient value. While providing a better human visual quality, a good correlation coefficient index indicates that the fused image keeps good spectral information. Both visual quality and objective evaluation criteria demonstrate that this method can well preserve the spatial quality and the spectral characteristics.

A New Variational Model for Panchromatic and Multispectral Image Fusion

Infrared and Visible Image Fusion Via Variational Bayesian Approximation Method

Variational Model-Based Very High Spatial Resolution Remote Sensing Image Fusion

Hyperspectral and Multispectral Image Fusion Based on Deep Attention Network.

Fusion of infrared and visual images through multiscale hybrid unidirectional total variation

Multispectral and Panchromatic Image Fusion Based on Improved Bilateral Filter

Curvelet Based Hyperspectral Image Fusion

Region-aware RGB and Near-Infrared Image Fusion

The Study on Image Fusion for Medium and High Spatial Resolution Remote Sensing Images

The Realistic Fusion of Multi-spectral Images

A color image fusion model by saturation-value total variation

An Image Fusion Algorithm Using Spatial Consistency and Bands Correlation

Variational Bayesian Image Fusion Based On Combined Sparse Representations

A new scheme for fusion of multispectral and panchromatic images based on residual error

Deep Hyperspectral and Multispectral Image Fusion with Inter-image Variability

Hyperspectral Image Quality Evaluation Based On Multi-Model Fusion

Multi-Spectral and Panchromatic Image Fusion Based on His-Wavelet Transform and Mopso Algorithm

Comprehensive Evaluation for Fused Images of Multispectral and Panchromatic Images Based on Entropy Weight Method

Perceptual Contrast-Based Image Fusion： A Variational Approach

Spatial-Spectral Fusion by Combining Deep Learning and Variation Model

Hyperspectral and Multispectral Image Fusion Based on Low Rank Constrained Gaussian Mixture Model.