Abstract:Hyperspectral imagery typically possesses high spectral resolution but low spatial resolution. One way to enhance the spatial resolution of a hyperspectral image is to fuse its spectral information and the spatial information of another high resolution image. In this paper, we propose a novel image fusion strategy for hyperspectral image and high spatial resolution panchromatic image, which is based on the curvelet transform. Firstly, determine a synthesized image with the specified RGB bands of the original hyperspectral images according to the optimal index factor (OIF) model. Then use the IHS transform to extract the intensity component of the synthesized image. After that, the histogram matching is performed between the intensity component and the panchromatic image. Thirdly, the curvelet transform is applied to decompose the two source images (the intensity component and the panchromatic image) in different scales and directions. Different fusion strategies are applied to coefficients in various scales and directions. Finally, the fused image is achieved by the inverse IHS transform. The experimental result shows that the proposed method has a superior performance. Comparing with the traditional methods such as the PCA transform, wavelet-based or pyramid-based methods and the multi-resolution fusion methods (shearlet or contourlet decomposition), the fused image achieves the highest entropy index and average gradient value. While providing a better human visual quality, a good correlation coefficient index indicates that the fused image keeps good spectral information. Both visual quality and objective evaluation criteria demonstrate that this method can well preserve the spatial quality and the spectral characteristics.

An Image Fusion Method Based on Curvelet Transform and Guided Filter Enhancement

Infrared and visible image fusion method based on saliency detection and target-enhancement

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

Fusion of Visible and Infrared Images Using Saliency Analysis and Detail Preserving Based Image Decomposition

Detail preserved fusion of visible and infrared images using regional saliency extraction and multi-scale image decomposition

Curvelet Based Hyperspectral Image Fusion

Night Vision Image Fusion Based on Phase Information Modulation and Image Enhancement Technique

Infrared and visual image fusion enhancement by dual-transform

Two-scale Image Fusion of Visible and Infrared Images Using Guided Filter

Infrared and Visible Image Fusion with Hybrid Image Filtering

Infrared and Visible Image Fusion Based on Filtering Enhancement

Fusion of Low-Quality Visible and Infrared Images Based on Multi-Level Latent Low-Rank Representation Joint with Retinex Enhancement and Multi-Visual Weight Information

Infrared and Visual Image Fusion Based on a Local-Extrema-Driven Image Filter

Adaptive low light visual enhancement and high-significant target detection for infrared and visible image fusion

Infrared and visible image fusion with entropy-based adaptive fusion module and mask-guided convolutional neural network

Fusion of infrared and visual images through multiscale hybrid unidirectional total variation

EV-Fusion: A Novel Infrared and Low-Light Color Visible Image Fusion Network Integrating Unsupervised Visible Image Enhancement

An image fusion algorithm based on image clustering theory

Infrared and Visible Image Fusion Algorithm Based on Double-Domain Transform Filter and Contrast Transform Feature Extraction

An Effective Infrared and Visible Image Fusion Approach via Rolling Guidance Filtering and Gradient Saliency Map

Infrared and visible image fusion in a rolling guided filtering framework based on deep feature extraction