Abstract:Light field (LF) imaging is an effective way to enable immersive applications. However, limited by the potential well capacity of the image sensor, the acquired LF images suffer from low dynamic range and are thus prone to under-exposure or over-exposure. High dynamic range (HDR) LF imaging is an efficacious avenue to improve the LF imaging's dynamic range. Unfortunately, for dynamic scenes, existing methods are inclined to produce ghosting artifacts and lose details in the saturated regions, while potentially damaging the parallax structure of generated HDR LF images. To address the above challenges, in this paper, we propose a new ghost-free HDR LF imaging method based on a deformable aggregation and angular embedding network. Specifically, considering the four-dimensional geometric structure of the LF image, a deformable alignment module is first designed to handle dynamic regions in the spatial domain, and then the aligned spatial features are fully fused through an aggregation operation. Subsequently, an angular embedding module is constructed to explore angular information to enhance the aggregated spatial features. Based on this, the above two modules are cascaded in a multi-scale manner to achieve multi-level feature extraction and enhance the feature representation ability. Finally, a decoder is leveraged to recover the ghost-free HDR LF image from the enhanced multi-scale features. For performance evaluation, this paper establishes a large-scale benchmark dataset with multi-exposure inputs and ground truth images. Extensive experimental results show that the proposed method generates visually pleasing HDR LF images while preserving accurate angular consistency. Moreover, the proposed method surpasses the state-of-the-art methods in both quantitative and qualitative comparisons. The code and dataset will be available at https://github.com/YeyaoChen/HDRLFI .

Physics-based supervised learning method for high dynamic range 3D measurement with high fidelity

High-speed high dynamic range 3D shape measurement based on deep learning

Efficient automated high dynamic range 3D measurement via deep reinforcement learning

Universal and High-Fidelity Resolution Extending for Fluorescence Microscopy Using a Single-Training Physics-Informed Sparse Neural Network

A Learning-Based Method Using Epipolar Geometry for Light Field Depth Estimation

Learning from General Diffuse Surfaces: An Event-driven Approach for High Dynamic Range Industrial Optical Measurement

High dynamic range 3D measurements based on space-time speckle correlation and color camera

Deep learning based measurement accuracy improvement of high dynamic range objects in fringe projection profilometry

Learning Regularized Multi-Scale Feature Flow for High Dynamic Range Imaging

High dynamic range 3D measurements with fringe projection profilometry: a review

Learning Inter- and Intra-frame Representations for Non-Lambertian Photometric Stereo

A multi-task learning-based approach for single-projection HDR 3D reconstruction

Single-Exposure 3-D Measurement of High-Dynamic-Range Surfaces via Untrained Neural Network

High dynamic range 3D measurement based on polarization and multispectrum co-modulation

Deep Learning for HDR Imaging: State-of-the-Art and Future Trends

HDR Light Field Imaging of Dynamic Scenes: A Learning-based Method and A Benchmark Dataset

Spatiotemporally Consistent HDR Indoor Lighting Estimation

Learning Rank-1 Diffractive Optics for Single-Shot High Dynamic Range Imaging

Ultra-High-Definition Image HDR Reconstruction via Collaborative Bilateral Learning

Efficient 3D measurement of a HDR surface based on adaptive fringe projection