Abstract:We propose a simple yet effective structural patch decomposition approach for multi-exposure image fusion (MEF) that is robust to ghosting effect. We decompose an image patch into three conceptually independent components: signal strength, signal structure, and mean intensity. Upon fusing these three components separately, we reconstruct a desired patch and place it back into the fused image. This novel patch decomposition approach benefits MEF in many aspects. First, as opposed to most pixel-wise MEF methods, the proposed algorithm does not require post-processing steps to improve visual quality or to reduce spatial artifacts. Second, it handles RGB color channels jointly, and thus produces fused images with more vivid color appearance. Third and most importantly, the direction of the signal structure component in the patch vector space provides ideal information for ghost removal. It allows us to reliably and efficiently reject inconsistent object motions with respect to a chosen reference image without performing computationally expensive motion estimation. We compare the proposed algorithm with 12 MEF methods on 21 static scenes and 12 deghosting schemes on 19 dynamic scenes (with camera and object motion). Extensive experimental results demonstrate that the proposed algorithm not only outperforms previous MEF algorithms on static scenes but also consistently produces high quality fused images with little ghosting artifacts for dynamic scenes. Moreover, it maintains a lower computational cost compared with the state-of-the-art deghosting schemes.

RDGMEF: a Multi-Exposure Image Fusion Framework Based on Retinex Decompostion and Guided Filter

Multi Exposure Fusion for High Dynamic Range Imaging Via Multi-Channel Gradient Tensor

Ref-MEF: Reference-Guided Flexible Gated Image Reconstruction Network for Multi-Exposure Image Fusion

Multi-Scale Exposure Fusion Via Content Adaptive Edge-Preserving Smoothing Pyramids.

Perceptual Multi-Exposure Fusion

Multi-exposure image fusion based on well-exposedness assessment

An enhanced multi-scale weight assignment strategy of two-exposure fusion

A Precise Multi-Exposure Image Fusion Method Based on Low-level Features.

Multiexposure Fusion Based on Multiscale Edge Information Measurement and Adaptive Pyramid Optimization

Rethinking Multi-Exposure Image Fusion with Extreme and Diverse Exposure Levels: A Robust Framework Based on Fourier Transform and Contrastive Learning.

Multi-Exposure Image Fusion Techniques: A Comprehensive Review

Multi-exposure Image Fusion Via Perception Enhanced Structural Patch Decomposition

Efficient Multi-exposure Image Fusion Via Filter-dominated Fusion and Gradient-driven Unsupervised Learning.

A detail-preserved and luminance-consistent multi-exposure image fusion algorithm

Multi-Exposure Fusion of Gray Images Under Low Illumination Based on Low-Rank Decomposition

A Novel Multi-Exposure Image Fusion Method Based on Adaptive Patch Structure

Multi-exposure image fusion via deep perceptual enhancement

Robust Multi-Exposure Image Fusion: A Structural Patch Decomposition Approach

A multi-exposure generation and fusion method for low-light image enhancement