Abstract:Hyperspectral imagery typically possesses high spectral resolution but low spatial resolution. One way to enhance the spatial resolution of a hyperspectral image is to fuse its spectral information and the spatial information of another high resolution image. In this paper, we propose a novel image fusion strategy for hyperspectral image and high spatial resolution panchromatic image, which is based on the curvelet transform. Firstly, determine a synthesized image with the specified RGB bands of the original hyperspectral images according to the optimal index factor (OIF) model. Then use the IHS transform to extract the intensity component of the synthesized image. After that, the histogram matching is performed between the intensity component and the panchromatic image. Thirdly, the curvelet transform is applied to decompose the two source images (the intensity component and the panchromatic image) in different scales and directions. Different fusion strategies are applied to coefficients in various scales and directions. Finally, the fused image is achieved by the inverse IHS transform. The experimental result shows that the proposed method has a superior performance. Comparing with the traditional methods such as the PCA transform, wavelet-based or pyramid-based methods and the multi-resolution fusion methods (shearlet or contourlet decomposition), the fused image achieves the highest entropy index and average gradient value. While providing a better human visual quality, a good correlation coefficient index indicates that the fused image keeps good spectral information. Both visual quality and objective evaluation criteria demonstrate that this method can well preserve the spatial quality and the spectral characteristics.

Perceptual Contrast-Based Image Fusion： A Variational Approach

Fusion of infrared and visual images through multiscale hybrid unidirectional total variation

Contrast-enhanced fusion of dual-band infrared image

Curvelet Based Hyperspectral Image Fusion

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

The Realistic Fusion of Multi-spectral Images

One Color Contrast Enhanced Infrared and Visible Image Fusion Method

A New Wavelet Image Fusion Algorithm Based on Human Visual System

A perceptual framework for infrared-visible image fusion based on multiscale structure decomposition and biological vision

A color image fusion model by saturation-value total variation

Fusion of Low-Quality Visible and Infrared Images Based on Multi-Level Latent Low-Rank Representation Joint with Retinex Enhancement and Multi-Visual Weight Information

Contrast Enhanced Color Polarization Image Fusion

An Image Fusion Algorithm Using Spatial Consistency and Bands Correlation

EgeFusion: Towards Edge Gradient Enhancement in Infrared and Visible Image Fusion With Multi-Scale Transform

Infrared and Visual Image Fusion Based on a Local-Extrema-Driven Image Filter

Infrared and Visible Image Fusion with Hierarchical Human Perception

COLOR CONTRAST ENHANCEMENT METHOD TO IMPROVE TARGET DETECTABILITY IN NIGHT VISION FUSION

Non-linear and selective fusion of cross-modal images

Infrared and Visible Image Fusion Based on Local Gradient Constraints.

Variational Image Fusion Approach Based on TGV and Local Information

Fusing Infrared and Visible Images Via a First-Order Model