Abstract:Infrared (IR) and visible (VIS) image fusion techniques are widely applied to many high-level vision tasks, such as object detection, recognition, and tracking. However, most existing image fusion algorithms exhibit varying degrees of edge-step effect and texture information degradation in their fused images. To improve the fusion quality, an IR and VIS image fusion method based on a variational partial differential equation (VPDE) model and a VGG network is proposed. A productive smoothing segmentation is integrated into the energy function of the VPDE model, which is based on a novel regularization function. To decompose source images into low-frequency and high-frequency components, the new VPDE model is employed. To fuse low-frequency components, a probabilistic parameter model based on space-alternating generalized expectation-maximization (SAGE) is utilized rather than the traditional average fusion rule. Then, multi-layer features of the high-frequency components are extracted using a VGG network. To generate several candidates of the fused detail content, the l1$$l_1$$-norm and weighted average rule are adopted, and the final details are obtained by using the maximum selection strategy. Finally, fused images are obtained by reconstructing the fused low-frequency and high-frequency components. Extensive experiments on the TNO and RoadScene datasets demonstrate that the proposed technique effectively eliminates artifacts as well as the step effect. In the subjective comparison, the proposed method can highlight the salient objects of the fused images while strengthening the texture information. In terms of the evaluation metrics, the proposed method outperforms 13 state-of-the-art methods in objective comparison in addition to the subjective evaluation.

Performance Evaluation of Infrared and Visible Image Fusion Algorithms for Face Recognition

Fusion of infrared and visual images through multiscale hybrid unidirectional total variation

Infrared and Visible Image Fusion Via Variational Bayesian Approximation Method

Infrared and visible image fusion method based on saliency detection and target-enhancement

Image fusion for face recognition

Fusion of Visible and Infrared Imagery for Face Recognition

Fuzzy Fusion for Face Recognition

Multisource Image Fusion for Face Recognition Based on Decision Level

Near-infrared and visible light image fusion algorithm for face recognition

Nonlinear fusion for face recognition using fuzzy integral

Infrared and Visible Image Fusion Algorithm Based on Double-Domain Transform Filter and Contrast Transform Feature Extraction

Fusion of SVD and LDA for face recognition

Singular Value Decomposition-Based Anisotropic Diffusion for Fusion of Infrared and Visible Images

Fusion of visible and thermal images for facial expression recognition

Infrared-visible Image Fusion Using Accelerated Convergent Convolutional Dictionary Learning

Infrared and visible image fusion based on VPDE model and VGG network

Infrared and Visible Image Fusion with Convolutional Neural Networks.

MVSFusion: infrared and visible image fusion method for multiple visual scenarios

Adaptive low light visual enhancement and high-significant target detection for infrared and visible image fusion

Infrared and Visual Image Fusion Via Iterative Quadtree Decomposition and Bézier Interpolation