Abstract:Infrared and visible image fusion is a crucial technique in the field of computer vision, aiming to create synthetic images that simultaneously capture salient features and rich texture details. These fused images play a pivotal role in enhancing various downstream tasks. However, existing fusion methods often encounter challenges such as texture loss and deficiencies in edge information, resulting in less than optimal fusion outcomes. Additionally, straightforward up-sampling techniques struggle to preserve source information from multiscale features. To tackle these issues, a novel fusion network based on the decomposition pooling (de-pooling) manner is proposed, termed as Decomposition Pooling-based Fusion (DePF). DePF features a de-pooling-based encoder designed to extract multiscale image and detail features from source images concurrently. Furthermore, a spatial attention model aggregates these salient features, and the decoder employs a de-pooling reversed operation instead of the typical up-sampling operator to reconstruct the fused features. Unlike conventional max-pooling techniques, the de-pooling layer preserves abundant detail information, facilitating a richer texture and multiscale information retention during the reconstruction phase. Significantly, our approach exhibits remarkable efficiency, requiring merely 23 ms to integrate a pair of infrared and visible images, each with dimensions of $640\,\, {}\times {}480$ . Furthermore, empirical findings corroborate the exceptional fusion efficacy of our methodology in the domains of object detection and noise-related assessments, surpassing the performance of contemporary techniques within numerous image fusion benchmarks.

Develop then Rival: A Human Vision-Inspired Framework for Superimposed Image Decomposition.

Single Image Reflection Separation via Component Synergy

Efficient Blind Separation Of Reflection Layers With Nonparametric Transformations

A new Image Decomposition Approach using Pixel-wise Analysis Sparsity Model

Decomposition-based and Interference Perception for Infrared and Visible Image Fusion in Complex Scenes

Revisiting Deep Image Smoothing and Intrinsic Image Decomposition.

Non-Uniform Illumination Image Enhancement via a Retinal Mechanism Inspired Decomposition

When Image Decomposition Meets Deep Learning: A Novel Infrared and Visible Image Fusion Method

Decoupling Image Deblurring Into Twofold: A Hierarchical Model for Defocus Deblurring

Strong and Controllable Blind Image Decomposition

Intrinsic Image Decomposition by Pursuing Reflectance Image.

Revisiting Deep Intrinsic Image Decompositions.

A perceptual framework for infrared-visible image fusion based on multiscale structure decomposition and biological vision

Progressive Stereo Image Dehazing Network Via Cross-view Region Interaction

Deep Decomposition Network for Image Processing: A Case Study for Visible and Infrared Image Fusion

Generative Image Layer Decomposition with Visual Effects

DePF: A Novel Fusion Approach Based on Decomposition Pooling for Infrared and Visible Images

Compositional Image Decomposition with Diffusion Models

Effective Two-Stage Image Segmentation: A New Non-Lipschitz Decomposition Approach with Convergent Algorithm

Multi-scale infrared and visible image fusion framework based on dual partial differential equations

A Novel Precise Decomposition Method For Infrared And Visible Image Fusion