Abstract:Light field (LF) imaging is an effective way to enable immersive applications. However, limited by the potential well capacity of the image sensor, the acquired LF images suffer from low dynamic range and are thus prone to under-exposure or over-exposure. High dynamic range (HDR) LF imaging is an efficacious avenue to improve the LF imaging's dynamic range. Unfortunately, for dynamic scenes, existing methods are inclined to produce ghosting artifacts and lose details in the saturated regions, while potentially damaging the parallax structure of generated HDR LF images. To address the above challenges, in this paper, we propose a new ghost-free HDR LF imaging method based on a deformable aggregation and angular embedding network. Specifically, considering the four-dimensional geometric structure of the LF image, a deformable alignment module is first designed to handle dynamic regions in the spatial domain, and then the aligned spatial features are fully fused through an aggregation operation. Subsequently, an angular embedding module is constructed to explore angular information to enhance the aggregated spatial features. Based on this, the above two modules are cascaded in a multi-scale manner to achieve multi-level feature extraction and enhance the feature representation ability. Finally, a decoder is leveraged to recover the ghost-free HDR LF image from the enhanced multi-scale features. For performance evaluation, this paper establishes a large-scale benchmark dataset with multi-exposure inputs and ground truth images. Extensive experimental results show that the proposed method generates visually pleasing HDR LF images while preserving accurate angular consistency. Moreover, the proposed method surpasses the state-of-the-art methods in both quantitative and qualitative comparisons. The code and dataset will be available at https://github.com/YeyaoChen/HDRLFI .

Beyond the Pixel: a Photometrically Calibrated HDR Dataset for Luminance and Color Temperature Prediction

Beyond the Pixel: a Photometrically Calibrated HDR Dataset for Luminance and Color Prediction

DiLiGenT102: A Photometric Stereo Benchmark Dataset with Controlled Shape and Material Variation

From Faces to Outdoor Light Probes

Beyond Visual Attractiveness: Physically Plausible Single Image HDR Reconstruction for Spherical Panoramas

Imagery dataset of interior and exterior northern architectural spaces for photobiological lighting analyses

Consolidated Dataset and Metrics for High-Dynamic-Range Image Quality

A New Corresponding Color Dataset Covering a Wide Luminance Range under High Dynamic Range Viewing Condition

HDR Light Field Imaging of Dynamic Scenes: A Learning-based Method and A Benchmark Dataset

NTIRE 2021 Challenge on High Dynamic Range Imaging: Dataset, Methods and Results

Dataset of images for visual and non-visual analysis of colour applications in architecture

DarkVision: A Benchmark for Low-light Image/Video Perception

GTA-HDR: A Large-Scale Synthetic Dataset for HDR Image Reconstruction

HDRT: Infrared Capture for HDR Imaging

Large-Scale Crowdsourced Study for Tone-Mapped HDR Pictures

Learning to predict indoor illumination from a single image

Calibrating lighting simulation with panoramic high dynamic range imaging

Deep Lighting Environment Map Estimation from Spherical Panoramas

Caltech Aerial RGB-Thermal Dataset in the Wild

Imagery datasets for photobiological lighting analysis of architectural models with shading panels

A High Resolution Multi-exposure Stereoscopic Image & Video Database of Natural Scenes