Abstract:The reconstruction of high dynamic range (HDR) images from multi-exposure low dynamic range (LDR) images in dynamic scenes presents significant challenges, especially in preserving and restoring information in oversaturated regions and avoiding ghosting artifacts. However, current methods often struggle to address these challenges. To this end, our work aims to bridge this gap by developing a multi-exposure HDR image reconstruction (MHDR) network for dynamic scenes, complemented by single-frame HDR image reconstruction (SHDR). This network, comprising SHDR with enhanced stop image (SHDR-ESI) and SHDR-ESI-assisted MHDR (SHDR-A-MHDR), effectively leverages the ghost-free characteristic of SHDR and the detail-enhancing capability of ESI in oversaturated areas. Specifically, SHDR-ESI innovatively integrates SHDR with the utilization of ESI. This integration not only optimizes the SHDR process but also effectively guides the synthesis of multi-exposure HDR images in SHDR-A-MHDR. In this method, SHDR is specifically applied to reduce potential ghosting effects in multi-exposure HDR synthesis, while the use of ESI images assists in enhancing the detail information in the HDR synthesis process. Technically, SHDR-ESI incorporates a detail enhancement mechanism, which includes a self-representation module and a mutual-representation module, designed to aggregate crucial information from both reference image and ESI. To fully leverage the complementary information from non-reference images, a feature interaction fusion module is integrated within SHDR-A-MHDR. Additionally, a ghost suppression module, guided by the ghost-free results of SHDR-ESI, is employed to suppress the ghosting artifacts. Experimental results on four public datasets demonstrate the efficacy and superiority of the proposed method.

Neural Augmentation-Based Saturation Restoration for LDR Images of HDR Scenes.

Hybrid Saturation Restoration for LDR Images of HDR Scenes

Attention-Guided Progressive Neural Texture Fusion for High Dynamic Range Image Restoration

LTM-NeRF: Embedding 3D Local Tone Mapping in HDR Neural Radiance Field

Single-Image HDR Reconstruction Assisted Ghost Suppression and Detail Preservation Network for Multi-Exposure HDR Imaging

Model and Data Driven Pseudo-HDR Imaging

HDR-LMDA: A Local Area-Based Mixed Data Augmentation Method for Hdr Video Reconstruction

Luminance Attentive Networks for HDR Image and Panorama Reconstruction

Single Image LDR to HDR Conversion using Conditional Diffusion

Single Exposure High Dynamic Range Image Reconstruction Based on Deep Dual-Branch Network

HDRNET: Single-Image-based HDR Reconstruction Using Channel Attention CNN

A Unified HDR Imaging Method with Pixel and Patch Level

Divide and Conquer: Rethinking HDR Reconstruction Utilizing HSV Color Space

High Dynamic Range Imaging for Dynamic Scenes With Large-Scale Motions and Severe Saturation

Efficient Content Reconstruction for High Dynamic Range Imaging

Low-Light Image Restoration With Short- and Long-Exposure Raw Pairs

Attention-guided Network with Inverse Tone-Mapping Guided Up-Sampling for HDR Imaging of Dynamic Scenes

Single Image HDR Reconstruction via A Feature Modulation Network

High Dynamic Range Imaging of Dynamic Scenes with Saturation Compensation but without Explicit Motion Compensation

Progressive and Selective Fusion Network for High Dynamic Range Imaging