Abstract:In this paper, a new infrared and visible image fusion method based on saliency detection and LatLRR-FPDE is proposed to ensure the saliency of the fused target and improve the clarity of the texture detail information of the latent low-rank representation (LatLRR) fusion method. In the feature representation stage, source images are decomposed into low-rank and sparse parts based on LatLRR. Then Fourth order Partial Differential Equation (FPDE) is used to extract high-frequency detail information from the low-rank part. In the fusion decision stage, according to the characteristic difference of the decomposed sub-bands, a multi-scale fusion scheme is carried out using rules such as EM (expectation-maximization), average (AVG), and the maximum absolute value. To guarantee the integrity of thermal radiation features in the target area in fusion results, an infrared image saliency detection algorithm is proposed, which utilizes the fusion information obtained from the sparse and prior saliency feature. Specifically, the algorithm uses convex hull center prior and contrast prior to obtain the background-suppressed saliency map. Meanwhile, to make full use of the high-dimensional saliency features in the image decomposition stage, the prior saliency map and the sparse saliency map are fused to improve the accuracy of saliency detection without the demand to extract redundant feature, which largely increases time-efficiency of the model. Finally, infrared feature compensation is performed on the target region of the fused image based on the saliency mapping strategy to make the final fused image having a better infrared target feature representation. The experiments are based on registered public datasets and compared with various popular image fusion algorithms. The subjective and objective results show that the proposed algorithm can effectively keep the integrity of salient infrared features and has superior visual quality.

Saliency Detection Using Mutual Consistency-Guided Spatial Cues Combination

Detecting Saliency in Infrared Images Via Multiscale Local Sparse Representation and Local Contrast Measure

Multi-Frame Image Fusion Method Combining Spatial-Temporal Saliency Detection and Nsct

A New Hybrid Approach for Saliency Detection in Infrared Images

Contrast and Distribution Based Saliency Detection in Infrared Images

A novel visual saliency detection method for infrared video sequences

A saliency-based approach to detection of infrared target

IR Saliency Detection Via a GCF-SB Visual Attention Framework

Mutual Guidance-Based Saliency Propagation for Infrared Pedestrian Images

Spatiotemporal Saliency Model for Small Moving Object Detection in Infrared Videos

Salient Region Detection by Fusing Foreground and Background Cues Extracted from Single Image

A Fusion Algorithm for Infrared and Visible Images Based on Saliency Analysis and Non-Subsampled Shearlet Transform

Visual Saliency Detection via Contrast Combinations

Infrared and visible image fusion using saliency detection based on shearlet transform

Infrared Target Detection Using Intensity Saliency and Self-Attention

Multi-scale saliency measure and orthogonal space for visible and infrared image fusion

Infrared and Visible Image Fusion Using Modified PCNN and Visual Saliency Detection

Infrared-visible image fusion method based on sparse and prior joint saliency detection and LatLRR-FPDE

Contrast Saliency Information Guided Infrared and Visible Image Fusion.

An Interactively Reinforced Paradigm for Joint Infrared-Visible Image Fusion and Saliency Object Detection

Image fusion with saliency map and interest points.