Abstract:In this paper, a new infrared and visible image fusion method based on saliency detection and LatLRR-FPDE is proposed to ensure the saliency of the fused target and improve the clarity of the texture detail information of the latent low-rank representation (LatLRR) fusion method. In the feature representation stage, source images are decomposed into low-rank and sparse parts based on LatLRR. Then Fourth order Partial Differential Equation (FPDE) is used to extract high-frequency detail information from the low-rank part. In the fusion decision stage, according to the characteristic difference of the decomposed sub-bands, a multi-scale fusion scheme is carried out using rules such as EM (expectation-maximization), average (AVG), and the maximum absolute value. To guarantee the integrity of thermal radiation features in the target area in fusion results, an infrared image saliency detection algorithm is proposed, which utilizes the fusion information obtained from the sparse and prior saliency feature. Specifically, the algorithm uses convex hull center prior and contrast prior to obtain the background-suppressed saliency map. Meanwhile, to make full use of the high-dimensional saliency features in the image decomposition stage, the prior saliency map and the sparse saliency map are fused to improve the accuracy of saliency detection without the demand to extract redundant feature, which largely increases time-efficiency of the model. Finally, infrared feature compensation is performed on the target region of the fused image based on the saliency mapping strategy to make the final fused image having a better infrared target feature representation. The experiments are based on registered public datasets and compared with various popular image fusion algorithms. The subjective and objective results show that the proposed algorithm can effectively keep the integrity of salient infrared features and has superior visual quality.

Multi-Sensor Image Fusion Based On Fourth Order Partial Differential Equations

Fusion of Visible and Infrared Images Using Saliency Analysis and Detail Preserving Based Image Decomposition

Multi-scale infrared and visible image fusion framework based on dual partial differential equations

Multi-Sensor Image Fusion Using Optimized Support Vector Machine and Multiscale Weighted Principal Component Analysis

Singular Value Decomposition-Based Anisotropic Diffusion for Fusion of Infrared and Visible Images

Infrared and Visible Image Fusion Algorithm Based on Double-Domain Transform Filter and Contrast Transform Feature Extraction

New Approach for Multimodal Medical Image Fusion using PDE-based Technique

Infrared-visible image fusion method based on sparse and prior joint saliency detection and LatLRR-FPDE

P–M equation based multiscale decomposition and its application to image fusion

Infrared and Visual Image Fusion Via Iterative Quadtree Decomposition and Bézier Interpolation

Infrared and Visible Image Fusion with Hybrid Image Filtering

Infrared and visible image fusion based on VPDE model and VGG network

Adaptive Decomposition Method for Multi-Modal Medical Image Fusion.

An Image Fusion Method Based on Sparse Representation and Sum Modified-Laplacian in NSCT Domain

Infrared and visible image fusion algorithm based on spatial domain and image features

A Variational Method for Multisource Remote-Sensing Image Fusion

Multi-modal remote sensing image fusion method guided by local extremum maps-guided image filter

Multi-sensor Image Fusion Using Discrete Wavelet Frame Transform

Multi-scale Guided Image and Video Fusion: A Fast and Efficient Approach

Multi-focus image fusion using residual removal and fractional order differentiation focus measure

Image Fusion Based on Feature Decoupling and Proportion Preserving.