Abstract:In most of complex wavelet based fusion methods, only magnitude (or absolute value) of a complex coefficient is considered and phase information is neglected. However, more salient image features can be determined by the phase. In this paper, a multimodality image fusion algorithm is proposed with the shiftable complex directional pyramid transform (SCDPT), where phase and magnitudes of complex coefficients are jointly considered. Firstly, a novel similarity index (CCC-EM) is presented by combining the circular correlation coefficient (CCC) of relative phase angles and the traditional energy matching (EM) index. When bandpass directional subband coefficients are merged, the CCC-EM index is employed as the similarity measure and three types of regions between source images are determined for each bandpass directional subband. Then, based on some weights or salience measures, different fusion rules are designed for each type of regions. Especially, for regions with similarity in energy and positive or negative correlation relationship in relative phase, the weighted circular variance (WCV) of relative phase angles is employed. When lowpass subband coefficients are merged, the traditional structural similarity index is employed to distinguish different types of regions. For most of regions, the local energy of lowpass subband coefficients is employed as weights or salience measures. While for regions with similar intensity values but different intensity variation directions, an inter-scale based salience measure is defined by combining the local energy of the lowpass subband coefficients and the WCV of the coarsest bandpass directional subband coefficients. Several pairs of multimodality images are fused with the proposed methods. Fusion results demonstrate that the proposed fusion method can extract more salient features (not just in energy) from source images than some other complex wavelet based fusion methods. Especially, more phase information of source images can be preserved into the fused image, which makes the proposed fusion method with higher performance in spatial consistency.

Fusion of Multisensor Images Based on the Curvelet Transform

Curvelet Based Hyperspectral Image Fusion

Multi-channel Satellite Cloud Image Fusion in the Tetrolet Transform Domain

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

Multi-Frame Image Fusion Method Combining Spatial-Temporal Saliency Detection and Nsct

Fusion of Visible and Infrared Images Using Saliency Analysis and Detail Preserving Based Image Decomposition

The Realistic Fusion of Multi-spectral Images

Fusion of Hyperspectral Images Based on Second Generation Curvelet Transform and Pulse-Coupled Neural Networks

Multisensor video fusion based on spatial-temporal salience detection

Remote Sensing Image Fusion Method Based on Nonsubsampled Contourlet

A Remote Sensing Image Fusion Method Based on Curvelet Transform and IHS Transform

Multimodality image fusion by using both phase and magnitude information

A pixel-level fusion method for multi-source optical remote sensing image combining the principal component analysis and curvelet transform

Detail enhanced multi-source fusion using visual weight map extraction based on multi scale edge preserving decomposition

Multiscale Image Fusion Methods Based on Wavelet-Domain

Image Fusion Algorithm Using Multiwavelet Analysis

Image fusion by multiple features in the propagated filtering domain

Multi-Sensor Medical-Image Fusion Technique Based on Embedding Bilateral Filter in Least Squares and Salient Detection

A Novel Multiscale Transform Decomposition Based Multi-Focus Image Fusion Framework

Multi-modal Image Fusion with the Hybrid ℓ0ℓ1 Layer Decomposing and Multi-Directional Filter Banks

Generation of enhanced information image using curvelet-transform-based image fusion for improving situation awareness of observer during surveillance