Abstract:By merging different portraits of a particular scene, image fusion attempts to create a blended image that combines details from all the images. Infrared (IR) and visible image fusion can be accomplished in a variety of ways, including recent deep-learning-based techniques. However, edge-preserving filter (EPF) based fusion works well since it retains all the information from both images. Local filtering-based techniques, on the other hand, limit the fusion performance by introducing multiple gradient reversal artifacts and halos. This work presents an advanced IR and visible image fusion approach depending on three-level decomposition using multi-level co-occurrence filtering, which aims to overcome the common shortfalls such as halo effects seen in existing EPF based fusion. The reference images are decomposed in to base layer, small-scale layers and large-scale layers using multi-level co-occurrence filtering (MLCoF). Since most of the low frequency details are contained in the base layer, the conventional merging strategy by averaging is replaced with novel foreground information map (FIM) based fusion strategy. Small-scale layers are combined by applying max-absolute fusion strategy. A novel weight-map guided edge preserving fusion strategy is put forward for the integration of large-scale layers. Later, fused image is generated by the superposition of these different layers. Subjective visual and objective quantitative analysis shows that the suggested technique attains more notable performance in contrast with other modern fusion methods including many deep-learning techniques. In terms of visual perspective view, the results produced by the proposed approach are superior and include all details from both images. Additionally, it produces outcomes free of gradient reversal and halo artifacts.

Infrared and visible image fusion via multi-scale multi-layer rolling guidance filter

Fusion of infrared and visual images through multiscale hybrid unidirectional total variation

Infrared and visible image fusion method based on saliency detection and target-enhancement

Two-scale Image Fusion of Visible and Infrared Images Using Guided Filter

Detail preserved fusion of visible and infrared images using regional saliency extraction and multi-scale image decomposition

An Effective Infrared and Visible Image Fusion Approach via Rolling Guidance Filtering and Gradient Saliency Map

Infrared and visible image fusion in a rolling guided filtering framework based on deep feature extraction

Multi-Scale Fusion of Stretched Infrared and Visible Images

Infrared and Visible Image Fusion with Hybrid Image Filtering

Edge preserving infrared and visible image fusion with three layer decomposition based on multi-level co-occurrence filtering

Infrared and visible image fusion based on edge-preserving guided filter and infrared feature decomposition

Infrared-visible image fusion method based on multi-scale shearing Co-occurrence filter

Fusion of Infrared and Visible Images Via Multi-Layer Convolutional Sparse Representation

Fusion of Low-Quality Visible and Infrared Images Based on Multi-Level Latent Low-Rank Representation Joint with Retinex Enhancement and Multi-Visual Weight Information

Multi-scale infrared and visible image fusion framework based on dual partial differential equations

Fusion of Visible and Infrared Images Using Saliency Analysis and Detail Preserving Based Image Decomposition

Infrared and visible image fusion based on edge-preserving filter and weighted least square optimization

Infrared and visible image fusion based on saliency detection and deep multi-scale orientational features

The fusion of infrared and visible images via decomposition-based structure transfer and local saliency detection

Enhanced low-light image fusion through multi-stage processing with Bayesian analysis and quadratic contrast function

Infrared and Visible Image Fusion Based on Filtering Enhancement