Abstract:Ghosting artifacts caused by moving objects and misalignments are a key challenge in constructing high dynamic range (HDR) images. Current methods first register the input low dynamic range (LDR) images using optical flow before merging them. This process is error-prone, and often causes ghosting in the resulting merged image. We propose a novel dual-attention-guided end-to-end deep neural network, called DAHDRNet, which produces high-quality ghost-free HDR images. Unlike previous methods that directly stack the LDR images or features for merging, we use dual-attention modules to guide the merging according to the reference image. DAHDRNet thus exploits both spatial attention and feature channel attention to achieve ghost-free merging. The spatial attention modules automatically suppress undesired components caused by misalignments and saturation, and enhance the fine details in the non-reference images. The channel attention modules adaptively rescale channel-wise features by considering the inter-dependencies between channels. The dual-attention approach is applied recurrently to further improve feature representation, and thus alignment. A dilated residual dense block is devised to make full use of the hierarchical features and increase the receptive field when hallucinating missing details. We employ a hybrid loss function, which consists of a perceptual loss, a total variation loss, and a content loss to recover photo-realistic images. Although DAHDRNet is not flow-based, it can be applied to flow-based registration to reduce artifacts caused by optical-flow estimation errors. Experiments on different datasets show that the proposed DAHDRNet achieves state-of-the-art quantitative and qualitative results.

PASTA: Towards Flexible and Efficient HDR Imaging Via Progressively Aggregated Spatio-Temporal Aligment.

PASTA: Towards Flexible and Efficient HDR Imaging Via Progressively Aggregated Spatio-Temporal Alignment

Alignment-free HDR Deghosting with Semantics Consistent Transformer

Robust High Dynamic Range (HDR) Imaging with Complex Motion and Parallax.

Attention-guided Network for Ghost-free High Dynamic Range Imaging

Deep progressive feature aggregation network for multi-frame high dynamic range imaging

HDRTransDC: High Dynamic Range Image Reconstruction with Transformer Deformation Convolution

IFT: Image Fusion Transformer for Ghost-free High Dynamic Range Imaging

Learning Regularized Multi-Scale Feature Flow for High Dynamic Range Imaging

Dual-Attention-Guided Network for Ghost-Free High Dynamic Range Imaging

High Dynamic Range Imaging with Context-aware Transformer

Deep Progressive Feature Aggregation Network for High Dynamic Range Imaging

Multi-Level Spatial-Temporal Feature Aggregation and Alignment-Based Selective Residual Dense Propagation Module for HDR Video Reconstruction

Ghost-free High Dynamic Range Imaging with Context-aware Transformer

Ghost-free High Dynamic Range Imaging via Hybrid CNN-Transformer and Structure Tensor

Multi-scale Contextual Attention Based HDR Reconstruction of Dynamic Scenes

High Dynamic Range Imaging for Dynamic Scenes With Large-Scale Motions and Severe Saturation

Attention-guided Network with Inverse Tone-Mapping Guided Up-Sampling for HDR Imaging of Dynamic Scenes

Multi-Attention Learning and Exposure Guidance Toward Ghost-Free High Dynamic Range Light Field Imaging

SAFNet: Selective Alignment Fusion Network for Efficient HDR Imaging

Deep HDR Imaging via A Non-local Network