Abstract:In this paper, a new infrared and visible image fusion method based on saliency detection and LatLRR-FPDE is proposed to ensure the saliency of the fused target and improve the clarity of the texture detail information of the latent low-rank representation (LatLRR) fusion method. In the feature representation stage, source images are decomposed into low-rank and sparse parts based on LatLRR. Then Fourth order Partial Differential Equation (FPDE) is used to extract high-frequency detail information from the low-rank part. In the fusion decision stage, according to the characteristic difference of the decomposed sub-bands, a multi-scale fusion scheme is carried out using rules such as EM (expectation-maximization), average (AVG), and the maximum absolute value. To guarantee the integrity of thermal radiation features in the target area in fusion results, an infrared image saliency detection algorithm is proposed, which utilizes the fusion information obtained from the sparse and prior saliency feature. Specifically, the algorithm uses convex hull center prior and contrast prior to obtain the background-suppressed saliency map. Meanwhile, to make full use of the high-dimensional saliency features in the image decomposition stage, the prior saliency map and the sparse saliency map are fused to improve the accuracy of saliency detection without the demand to extract redundant feature, which largely increases time-efficiency of the model. Finally, infrared feature compensation is performed on the target region of the fused image based on the saliency mapping strategy to make the final fused image having a better infrared target feature representation. The experiments are based on registered public datasets and compared with various popular image fusion algorithms. The subjective and objective results show that the proposed algorithm can effectively keep the integrity of salient infrared features and has superior visual quality.

Infrared dual-band image fusion with simplified pulse coupled neural network and visual saliency map in nonsubsampled shearlet transform domain

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

Multi-Frame Image Fusion Method Combining Spatial-Temporal Saliency Detection and Nsct

Dual Band Image Fusion Method Based on Region Saliency

Infrared and Visible Images Fusion Using Visual Saliency and Dual-PCNN

Fusion of infrared and visual images through multiscale hybrid unidirectional total variation

Infrared and visible image fusion method based on saliency detection and target-enhancement

Infrared and Visible Image Fusion Based on Saliency Detection Dynamic Threshold Neural P Systems in Non-Subsampled Shearlet Transform Domain

Infrared and visible image fusion based on NSST and phase consistency adaptive DUAL channel PCNN

Fusion of Infrared and Visible Light Images Based on Improved Adaptive Dual-Channel Pulse Coupled Neural Network

Fusion of Infrared and Visible Images Via Multi-Layer Convolutional Sparse Representation

Multi-scale Convolutional Neural Networks and Saliency Weight Maps for Infrared and Visible Image Fusion

Novel fusion method for visible light and infrared images based on NSST–SF–PCNN

Infrared and Visible Image Fusion with Convolutional Neural Networks.

Infrared and visible image fusion method based on visual saliency objects and fuzzy region attributes

Adaptive low light visual enhancement and high-significant target detection for infrared and visible image fusion

Infrared and visual image fusion enhancement by dual-transform

Infrared and visible image fusion enhancement technology based on multi-scale directional analysis

Multi-Sensor Fusion of Infrared and Visible Images Based on Modified Side Window Filter and Intensity Transformation

Infrared and Visible Image Fusion Technology and Application: A Review

Infrared-visible image fusion method based on sparse and prior joint saliency detection and LatLRR-FPDE