Abstract:Image fusion methods may lose their ability to retain crucial image information when faced with suboptimal conditions, such as poor contrast, excessive noise, or intense illumination, leading to the loss of valuable image features. In this work, an improved CsdFusion algorithm is proposed to increase the visibility of infrared targets in fused images. Firstly, to accomplish clear background textures and structural information, a hybrid image decomposition model combining LatLRR and NSST is established. This process entails the division of the original infrared and visible images into low-rank components (base layers) and salient components (saliency layers) through the Latent Low-Rank Representation (LatLRR) approach. Subsequently, the base layers of both the infrared and visible images undergo the Non-Subsampled Shearlet Transform (NSST), decomposing them into high-frequency and low-frequency layers. The processed high-frequency and low-frequency layers are then subjected to inverse NSST to obtain the fused base layer, ensuring that the fused image retains maximum background information while effectively filtering noise. Secondly, to identify and extract the most significant regions or features in infrared images, the Central-contrast priori Saliency Map (CSM) algorithm is applied. This algorithm calculates the central prior saliency value using Harris corners and the contrast prior saliency value using guided filtering and background suppression. It then combines these two prior saliency values using a feature compensation strategy to compute the infrared saliency map. To validate the effectiveness of the proposed algorithm, comparative evaluation studies on benchmark open datasets are carried out. The results thus obtained through the proposed algorithm demonstrate superior performance in both subjective and objective experiments, generating fused images that not only preserve the crucial details and characteristics of both infrared and visible images but also reflect significant enhancement in visibility and discriminability of target objects, outperforming 10 state-of-the-art image fusion algorithms.

An improved hybrid multiscale fusion algorithm based on NSST for infrared–visible images

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

Multi-Frame Image Fusion Method Combining Spatial-Temporal Saliency Detection and Nsct

Fusion of Visible and Infrared Images Using Saliency Analysis and Detail Preserving Based Image Decomposition

Detail preserved fusion of visible and infrared images using regional saliency extraction and multi-scale image decomposition

Fusion of infrared and visual images through multiscale hybrid unidirectional total variation

Infrared and visible image fusion method based on saliency detection and target-enhancement

Infrared and Visible Image Fusion Based on Saliency Detection Dynamic Threshold Neural P Systems in Non-Subsampled Shearlet Transform Domain

Infrared and visible image fusion enhancement technology based on multi-scale directional analysis

Infrared and Visible Images Fusion Using Visual Saliency and Dual-PCNN

Fusion of Low-Quality Visible and Infrared Images Based on Multi-Level Latent Low-Rank Representation Joint with Retinex Enhancement and Multi-Visual Weight Information

Novel fusion method for visible light and infrared images based on NSST–SF–PCNN

Saliency-Guided Nonsubsampled Shearlet Transform for Multisource Remote Sensing Image Fusion

Infrared dual-band image fusion with simplified pulse coupled neural network and visual saliency map in nonsubsampled shearlet transform domain

A novel image fusion algorithm for infrared and visible light

Fusion of Infrared and Visible Light Images Based on Improved Adaptive Dual-Channel Pulse Coupled Neural Network

Multimodal image fusion based on global-regional-local rule in NSST domain

Infrared-visible image fusion method based on multi-scale shearing Co-occurrence filter

Image fusion based on nonsubsampled contourlet transform for infrared and visible light image

CsdlFusion: An Infrared and Visible Image Fusion Method Based on LatLRR-NSST and Compensated Saliency Detection

MGFuse: An Infrared and Visible Image Fusion Algorithm Based on Multiscale Decomposition Optimization and Gradient-Weighted Local Energy