Abstract:Multi-exposure image fusion inevitably causes ghost artifacts owing to inaccurate image registration. In this study, we propose a deep learning technique for the seamless fusion of multi-exposed low dynamic range (LDR) images using a focus-pixel sensor. For auto-focusing in mobile cameras, a focus-pixel sensor originally provides left (L) and right (R) luminance images simultaneously with a full-resolution RGB image. These L/R images are less saturated than the RGB images because they are summed up to be a normal pixel value in the RGB image of the focus pixel sensor. These two features of the focus pixel image, namely, relatively short exposure and perfect alignment are utilized in this study to provide fusion cues for high dynamic range (HDR) imaging. To minimize fusion artifacts, luminance and chrominance fusions are performed separately in two sub-nets. In a luminance recovery network, two heterogeneous images, the focus pixel image and the corresponding overexposed LDR image, are first fused by joint learning to produce an HDR luminance image. Subsequently, a chrominance network fuses the color components of the misaligned underexposed LDR input to obtain a 3-channel HDR image. Existing deep-neural-network-based HDR fusion methods fuse misaligned multi-exposed inputs directly. They suffer from visual artifacts that are observed mostly in saturated regions because pixel values are clipped out. Meanwhile, the proposed method reconstructs missing luminance with aligned unsaturated focus pixel image first, and thus, the luma-recovered image provides the cues for accurate color fusion. The experimental results show that the proposed method not only accurately restores fine details in saturated areas, but also produce ghost-free high-quality HDR images without pre-alignment.

Weighted sparse representation multi-scale transform fusion algorithm for high dynamic range imaging with a low-light dual-channel camera.

Detail Preserving Exposure Fusion for A Dual Sensor Camera

Dual-Focal Camera Hdr Imaging Based On Convolutional Neural Network

Multi-exposure image fusion based on well-exposedness assessment

Ghost Detection And Removal Based On Super-Pixel Grouping In Exposure Fusion

Texture Aware Learning-based Image Fusion Method for Fixed Focal-length Cameras

IFT: Image Fusion Transformer for Ghost-free High Dynamic Range Imaging

Learning Regularized Multi-Scale Feature Flow for High Dynamic Range Imaging

Multi-Exposure Image Fusion Algorithm Based on Improved Weight Function

Detail enhanced multi-source fusion using visual weight map extraction based on multi scale edge preserving decomposition

Progressive and Selective Fusion Network for High Dynamic Range Imaging

Multi-Scale Exposure Fusion Via Content Adaptive Edge-Preserving Smoothing Pyramids.

HDR Imaging with Spatially Varying Signal-to-Noise Ratios

Research on multi-sensor high dynamic range imaging technology and application

Ghost-Free Deep High-Dynamic-Range Imaging Using Focus Pixels for Complex Motion Scenes

Wavelet-Based Network For High Dynamic Range Imaging

MIEHDR CNN: Main Image Enhancement based Ghost-Free High Dynamic Range Imaging using Dual-Lens Systems

High dynamic range imaging by a pseudo exposure fusion method based on artificial remapping

HDRTransDC: High Dynamic Range Image Reconstruction with Transformer Deformation Convolution

A novel multi-scale fusion framework for detail-preserving low-light image enhancement