Abstract:The reconstruction of high dynamic range (HDR) images from multi-exposure low dynamic range (LDR) images in dynamic scenes presents significant challenges, especially in preserving and restoring information in oversaturated regions and avoiding ghosting artifacts. However, current methods often struggle to address these challenges. To this end, our work aims to bridge this gap by developing a multi-exposure HDR image reconstruction (MHDR) network for dynamic scenes, complemented by single-frame HDR image reconstruction (SHDR). This network, comprising SHDR with enhanced stop image (SHDR-ESI) and SHDR-ESI-assisted MHDR (SHDR-A-MHDR), effectively leverages the ghost-free characteristic of SHDR and the detail-enhancing capability of ESI in oversaturated areas. Specifically, SHDR-ESI innovatively integrates SHDR with the utilization of ESI. This integration not only optimizes the SHDR process but also effectively guides the synthesis of multi-exposure HDR images in SHDR-A-MHDR. In this method, SHDR is specifically applied to reduce potential ghosting effects in multi-exposure HDR synthesis, while the use of ESI images assists in enhancing the detail information in the HDR synthesis process. Technically, SHDR-ESI incorporates a detail enhancement mechanism, which includes a self-representation module and a mutual-representation module, designed to aggregate crucial information from both reference image and ESI. To fully leverage the complementary information from non-reference images, a feature interaction fusion module is integrated within SHDR-A-MHDR. Additionally, a ghost suppression module, guided by the ghost-free results of SHDR-ESI, is employed to suppress the ghosting artifacts. Experimental results on four public datasets demonstrate the efficacy and superiority of the proposed method.

Attention-guided Network with Inverse Tone-Mapping Guided Up-Sampling for HDR Imaging of Dynamic Scenes

Selective Kernel and Motion-emphasized Loss Based Attention-guided Network for HDR Imaging of Dynamic Scenes

Attention-guided Network for Ghost-free High Dynamic Range Imaging

Dual-Focal Camera Hdr Imaging Based On Convolutional Neural Network

Dual-Attention-Guided Network for Ghost-Free High Dynamic Range Imaging

Deep HDR Imaging via A Non-local Network

High Dynamic Range Imaging for Dynamic Scenes With Large-Scale Motions and Severe Saturation

Progressive and Selective Fusion Network for High Dynamic Range Imaging

Multi-scale Contextual Attention Based HDR Reconstruction of Dynamic Scenes

Learning Regularized Multi-Scale Feature Flow for High Dynamic Range Imaging

Deep SR-HDR: Joint Learning of Super-Resolution and High Dynamic Range Imaging for Dynamic Scenes

Deep Progressive Feature Aggregation Network for High Dynamic Range Imaging

HDRNET: Single-Image-based HDR Reconstruction Using Channel Attention CNN

Deep progressive feature aggregation network for multi-frame high dynamic range imaging

Robust High Dynamic Range (HDR) Imaging with Complex Motion and Parallax.

FastHDRNet: A new efficient method for SDR-to-HDR Translation

Pyramid Spatial Feature Transform and Shared-Offsets Deformable Alignment Based Convolutional Network for HDR Imaging

Single-Image HDR Reconstruction Assisted Ghost Suppression and Detail Preservation Network for Multi-Exposure HDR Imaging

Wavelet-Based Network For High Dynamic Range Imaging

ArtHDR-Net: Perceptually Realistic and Accurate HDR Content Creation

ADNet: Attention-guided Deformable Convolutional Network for High Dynamic Range Imaging