Abstract:The reconstruction of high dynamic range (HDR) images from multi-exposure low dynamic range (LDR) images in dynamic scenes presents significant challenges, especially in preserving and restoring information in oversaturated regions and avoiding ghosting artifacts. However, current methods often struggle to address these challenges. To this end, our work aims to bridge this gap by developing a multi-exposure HDR image reconstruction (MHDR) network for dynamic scenes, complemented by single-frame HDR image reconstruction (SHDR). This network, comprising SHDR with enhanced stop image (SHDR-ESI) and SHDR-ESI-assisted MHDR (SHDR-A-MHDR), effectively leverages the ghost-free characteristic of SHDR and the detail-enhancing capability of ESI in oversaturated areas. Specifically, SHDR-ESI innovatively integrates SHDR with the utilization of ESI. This integration not only optimizes the SHDR process but also effectively guides the synthesis of multi-exposure HDR images in SHDR-A-MHDR. In this method, SHDR is specifically applied to reduce potential ghosting effects in multi-exposure HDR synthesis, while the use of ESI images assists in enhancing the detail information in the HDR synthesis process. Technically, SHDR-ESI incorporates a detail enhancement mechanism, which includes a self-representation module and a mutual-representation module, designed to aggregate crucial information from both reference image and ESI. To fully leverage the complementary information from non-reference images, a feature interaction fusion module is integrated within SHDR-A-MHDR. Additionally, a ghost suppression module, guided by the ghost-free results of SHDR-ESI, is employed to suppress the ghosting artifacts. Experimental results on four public datasets demonstrate the efficacy and superiority of the proposed method.

From Dynamic to Static: Stepwisely Generate HDR Image for Ghost Removal

Ghost Detection And Removal Based On Super-Pixel Grouping In Exposure Fusion

Robust ghost-free multiexposure fusion for dynamic scenes.

Learning Regularized Multi-Scale Feature Flow for High Dynamic Range Imaging

Towards High-quality HDR Deghosting with Conditional Diffusion Models

Progressive and Selective Fusion Network for High Dynamic Range Imaging

Attention-guided Network with Inverse Tone-Mapping Guided Up-Sampling for HDR Imaging of Dynamic Scenes

Selective Kernel and Motion-emphasized Loss Based Attention-guided Network for HDR Imaging of Dynamic Scenes

Generating Content for HDR Deghosting from Frequency View

Deep Progressive Feature Aggregation Network for High Dynamic Range Imaging

Implementing evidence-based practice in Taiwanese nursing homes: attitudes and perceived barriers and facilitators.

Single-Image HDR Reconstruction Assisted Ghost Suppression and Detail Preservation Network for Multi-Exposure HDR Imaging

Deep progressive feature aggregation network for multi-frame high dynamic range imaging

Dual-Attention-Guided Network for Ghost-Free High Dynamic Range Imaging

Robust High Dynamic Range (HDR) Imaging with Complex Motion and Parallax.

Ghost-Free Deep High-Dynamic-Range Imaging Using Focus Pixels for Complex Motion Scenes

Exploring Early Stage Cost-Estimation Methods Using Off-the-Shelf Tools: A Preliminary Study

Robust Ghost-Free High-Dynamic-Range Imaging by Visual Salience Based Bilateral Motion Detection and Stack Extension Based Exposure Fusion.

Attention-guided Network for Ghost-free High Dynamic Range Imaging