Abstract:Light field (LF) imaging is an effective way to enable immersive applications. However, limited by the potential well capacity of the image sensor, the acquired LF images suffer from low dynamic range and are thus prone to under-exposure or over-exposure. High dynamic range (HDR) LF imaging is an efficacious avenue to improve the LF imaging's dynamic range. Unfortunately, for dynamic scenes, existing methods are inclined to produce ghosting artifacts and lose details in the saturated regions, while potentially damaging the parallax structure of generated HDR LF images. To address the above challenges, in this paper, we propose a new ghost-free HDR LF imaging method based on a deformable aggregation and angular embedding network. Specifically, considering the four-dimensional geometric structure of the LF image, a deformable alignment module is first designed to handle dynamic regions in the spatial domain, and then the aligned spatial features are fully fused through an aggregation operation. Subsequently, an angular embedding module is constructed to explore angular information to enhance the aggregated spatial features. Based on this, the above two modules are cascaded in a multi-scale manner to achieve multi-level feature extraction and enhance the feature representation ability. Finally, a decoder is leveraged to recover the ghost-free HDR LF image from the enhanced multi-scale features. For performance evaluation, this paper establishes a large-scale benchmark dataset with multi-exposure inputs and ground truth images. Extensive experimental results show that the proposed method generates visually pleasing HDR LF images while preserving accurate angular consistency. Moreover, the proposed method surpasses the state-of-the-art methods in both quantitative and qualitative comparisons. The code and dataset will be available at https://github.com/YeyaoChen/HDRLFI .

Robust Ghost-Free High-Dynamic-Range Imaging by Visual Salience Based Bilateral Motion Detection and Stack Extension Based Exposure Fusion.

Visual Salience And Stack Extension Based Ghost Removal For High-Dynamic-Range Imaging

Ghost Detection And Removal Based On Super-Pixel Grouping In Exposure Fusion

Robust ghost-free multiexposure fusion for dynamic scenes.

Detail Preserving Exposure Fusion for A Dual Sensor Camera

Multi-exposure image fusion based on well-exposedness assessment

Dual-Focal Camera Hdr Imaging Based On Convolutional Neural Network

Ghost-Free Deep High-Dynamic-Range Imaging Using Focus Pixels for Complex Motion Scenes

Learning Regularized Multi-Scale Feature Flow for High Dynamic Range Imaging

Motion Area Based Exposure Fusion Algorithm for Ghost Removal in High Dynamic Range Video Generation

Multi-Attention Learning and Exposure Guidance Toward Ghost-Free High Dynamic Range Light Field Imaging

Multiple Exposure Fusion for High Dynamic Range Image Acquisition

HDR Video Reconstruction with Tri-Exposure Quad-Bayer Sensors

Robust High Dynamic Range (HDR) Imaging with Complex Motion and Parallax.

High Dynamic Range Imaging of Dynamic Scenes with Saturation Compensation but without Explicit Motion Compensation

High dynamic range imaging by a pseudo exposure fusion method based on artificial remapping

Dual-Attention-Guided Network for Ghost-Free High Dynamic Range Imaging

Attention-guided Network for Ghost-free High Dynamic Range Imaging

Selective Kernel and Motion-emphasized Loss Based Attention-guided Network for HDR Imaging of Dynamic Scenes

IFT: Image Fusion Transformer for Ghost-free High Dynamic Range Imaging

HDR Light Field Imaging of Dynamic Scenes: A Learning-based Method and A Benchmark Dataset