Abstract:When infrared targets are located at the edge of an image or when the targets are relatively small, the standard infrared and visible image fusion algorithm becomes a major problem because it relies on manually designed strategies and low-level image statistics for saliency detection. To address this issue, SeGFuison is proposed. It is a semantic saliency guided infrared and visible image fusion method composed of an autoencoder, a fusion layer, and a Semantic Segmentation-based Deep Saliency model (SSDS). It focuses on the structural information of images and generates saliency maps at the feature level, so that infrared targets can be extracted more accurately, thereby avoiding the introduction of artifacts and noise in fusion images. Incorporating saliency maps dynamically generated by SSDS, our approach effectively guides the training process of the fusion model. This strategic utilization guarantees that the resulting fused image maintains a saliency map that closely resembles that of the original infrared image. Furthermore, saliency maps are employed to partition images into distinct regions, namely target areas and background areas. This segmentation enables the design of distinct loss functions tailored to the unique characteristics of each area. As a result, our approach ensures the fusion of images preserves both salient targets and intricate background details, thus upholding a comprehensive depiction of fusion information. Through rigorous experimentation conducted on widely recognized public datasets including TNO, RoadScene, and MSRS, our algorithm has exhibited distinct advantages over contemporary state-of-the-art algorithms, both in terms of objective metrics and subjective evaluations. Notably, SeGFusion attains remarkable scores on key indicators such as FMI, VIF, and SD, affirming its superiority. Furthermore, it excels in subjective assessments, producing fused images of unparalleled clarity. The obtained experimental results compellingly showcase the inherent potential of our proposed algorithm, thereby substantiating its viability for diverse applications within fields such as infrared instruments and equipment.

Structured Saliency Fusion Based on Dempster–Shafer Theory

Multi-Frame Image Fusion Method Combining Spatial-Temporal Saliency Detection and Nsct

Fusion of Visible and Infrared Images Using Saliency Analysis and Detail Preserving Based Image Decomposition

Salient Object Detection with High-Level Prior Based on Bayesian Fusion.

Image Fusion Method Based on Structure-Based Saliency Map and FDST-PCNN Framework.

Adaptive fractional multi-scale edge-preserving decomposition and saliency detection fusion algorithm

An Innovative Saliency Detection Framework with an Example of Image Montage

SeGFusion: A semantic saliency guided infrared and visible image fusion method

Video Saliency Detection Via Spatial-Temporal Fusion and Low-Rank Coherency Diffusion

Employing Bilinear Fusion and Saliency Prior Information for RGB-D Salient Object Detection

A Novel Remote-Sensing Image Fusion Method Based on Hybrid Visual Saliency Analysis

S4Fusion: Saliency-aware Selective State Space Model for Infrared Visible Image Fusion

Infrared and Visible Image Fusion Based on Saliency Detection Dynamic Threshold Neural P Systems in Non-Subsampled Shearlet Transform Domain

Unsupervised Salient Object Detection Via Inferring from Imperfect Saliency Models.

A Deep Multiscale Fusion Method via Low-Rank Sparse Decomposition for Object Saliency Detection Based on Urban Data in Optical Remote Sensing Images

Infrared and Visible Image Fusion Based on Deep Decomposition Network and Saliency Analysis

Hierarchical Saliency: A New Salient Target Detection Framework

Video Saliency Detection Using Dynamic Fusion of Spatial-Temporal Features in Complex Background with Disturbance

Learning Coupled Convolutional Networks Fusion for Video Saliency Prediction

Improved Saliency Detection in RGB-D Images Using Two-Phase Depth Estimation and Selective Deep Fusion

Multi-Camera Saliency.