Abstract:Multi-exposure image fusion inevitably causes ghost artifacts owing to inaccurate image registration. In this study, we propose a deep learning technique for the seamless fusion of multi-exposed low dynamic range (LDR) images using a focus-pixel sensor. For auto-focusing in mobile cameras, a focus-pixel sensor originally provides left (L) and right (R) luminance images simultaneously with a full-resolution RGB image. These L/R images are less saturated than the RGB images because they are summed up to be a normal pixel value in the RGB image of the focus pixel sensor. These two features of the focus pixel image, namely, relatively short exposure and perfect alignment are utilized in this study to provide fusion cues for high dynamic range (HDR) imaging. To minimize fusion artifacts, luminance and chrominance fusions are performed separately in two sub-nets. In a luminance recovery network, two heterogeneous images, the focus pixel image and the corresponding overexposed LDR image, are first fused by joint learning to produce an HDR luminance image. Subsequently, a chrominance network fuses the color components of the misaligned underexposed LDR input to obtain a 3-channel HDR image. Existing deep-neural-network-based HDR fusion methods fuse misaligned multi-exposed inputs directly. They suffer from visual artifacts that are observed mostly in saturated regions because pixel values are clipped out. Meanwhile, the proposed method reconstructs missing luminance with aligned unsaturated focus pixel image first, and thus, the luma-recovered image provides the cues for accurate color fusion. The experimental results show that the proposed method not only accurately restores fine details in saturated areas, but also produce ghost-free high-quality HDR images without pre-alignment.

A Dynamic Scene HDR Fusion Method Based on Dual-channel Low-light-level CMOS Camera

Detail Preserving Exposure Fusion for A Dual Sensor Camera

Multi-exposure image fusion based on well-exposedness assessment

An Extending Dynamic Range Method Based on Digital Image Synthesis

Ghost Detection And Removal Based On Super-Pixel Grouping In Exposure Fusion

Dual-Focal Camera Hdr Imaging Based On Convolutional Neural Network

Low-light Image Pairs Fusion Method Based on Patch-match

Fast detail-preserving exposure fusion

Weighted sparse representation multi-scale transform fusion algorithm for high dynamic range imaging with a low-light dual-channel camera.

Graphic-Processing-Unit-Accelerated Real-Time Exposure Fusion Method Using Pixel-Level Optimal Exposure Criterion

Research on multi-sensor high dynamic range imaging technology and application

Multi-exposure Fusion with JPEG Compression Guidance

Research on Hdr Image Fusion Algorithm Based on Laplace Pyramid Weight Transform with Extreme-Low-Light Cmos

High dynamic range imaging by a pseudo exposure fusion method based on artificial remapping

Direct high dynamic range imaging method using experiential optimal exposure criterion

High Dynamic Range Imaging on Mobile Devices Using Fusion of Multiexposure Images

Multiple-Exposure Image Fusion for HDR Image Synthesis Using Learned Analysis Transformations

Ghost-Free Deep High-Dynamic-Range Imaging Using Focus Pixels for Complex Motion Scenes

Deep Guided and Self-learning-based Method for High Dynamic Range Imaging

A novel multi-scale fusion framework for detail-preserving low-light image enhancement

Multiple Exposure Fusion for High Dynamic Range Image Acquisition