Abstract:Infrared (IR) and visible (VIS) image fusion techniques are widely applied to many high-level vision tasks, such as object detection, recognition, and tracking. However, most existing image fusion algorithms exhibit varying degrees of edge-step effect and texture information degradation in their fused images. To improve the fusion quality, an IR and VIS image fusion method based on a variational partial differential equation (VPDE) model and a VGG network is proposed. A productive smoothing segmentation is integrated into the energy function of the VPDE model, which is based on a novel regularization function. To decompose source images into low-frequency and high-frequency components, the new VPDE model is employed. To fuse low-frequency components, a probabilistic parameter model based on space-alternating generalized expectation-maximization (SAGE) is utilized rather than the traditional average fusion rule. Then, multi-layer features of the high-frequency components are extracted using a VGG network. To generate several candidates of the fused detail content, the l1$$l_1$$-norm and weighted average rule are adopted, and the final details are obtained by using the maximum selection strategy. Finally, fused images are obtained by reconstructing the fused low-frequency and high-frequency components. Extensive experiments on the TNO and RoadScene datasets demonstrate that the proposed technique effectively eliminates artifacts as well as the step effect. In the subjective comparison, the proposed method can highlight the salient objects of the fused images while strengthening the texture information. In terms of the evaluation metrics, the proposed method outperforms 13 state-of-the-art methods in objective comparison in addition to the subjective evaluation.

Infrared and Visible Image Fusion Via Variational Bayesian Approximation Method

Fusion of infrared and visual images through multiscale hybrid unidirectional total variation

Infrared and visible image fusion method based on saliency detection and target-enhancement

Bayesian fusion for infrared and visible images

A Hierarchical Bayesian Fusion Method of Infrared and Visible Images for Temperature Monitoring of High-Speed Direct-Drive Blower

Infrared and Visible Image Fusion with Hybrid Image Filtering

Infrared and Visual Image Fusion Via Iterative Quadtree Decomposition and Bézier Interpolation

Infrared and visible image fusion based on infrared background suppression

Infrared–Visible Image Fusion through Feature-Based Decomposition and Domain Normalization

Fusion of Infrared and Visible Images Via Multi-Layer Convolutional Sparse Representation

Infrared and Visible Image Fusion with Convolutional Neural Networks.

Infrared and visible image fusion based on VPDE model and VGG network

Infrared and visible image fusion based on particle swarm optimization and dense block

Multi-scale infrared and visible image fusion framework based on dual partial differential equations

Infrared and Visible Image Fusion Method Based on Hierarchical Attention Mechanism

Infrared and Visible Image Fusion Using Dual-Tree Complex Wavelet Transform and Convolutional Sparse Representation

Adaptive low light visual enhancement and high-significant target detection for infrared and visible image fusion

Infrared and Visible Image Fusion Based on Filtering Enhancement

Airborne Infrared and Visible Image Fusion Combined with Region Segmentation

Infrared and Visual Image Fusion Based on a Local-Extrema-Driven Image Filter

Infrared and Visible Image Fusion Technology and Application: A Review