Abstract:Two key challenges exist in high dynamic range (HDR) imaging from multiexposure low dynamic range (LDR) images for dynamic scenes: 1) aligning the input images with large-scale foreground motions and 2) recovering large saturated regions from a limited number of input LDR images. To tackle these challenges, several deep convolutional neural networks have been proposed that have made significant progress. However, these methods tend to suffer from ghosting and saturation artifacts when applied to some challenging scenes. In this article, we propose an end-to-end deformable HDR imaging network, called DHDRNet, which attempts to alleviate these problems by building an effective aligning module and adopting self-guided attention. First, we analyze the alignment process in the HDR imaging task and correspondingly design a pyramidal deformable module (PDM) that aligns LDR images at multiple scales and reconstructs aligned features in a coarse-to-fine manner. In this way, the proposed DHDRNet can handle large-scale complex motions and suppress ghosting artifacts caused by misalignments. Moreover, we adopt self-guided attention to reduce the influence of saturated regions during the aligning and merging processes, which helps suppress artifacts and retain fine details in the final HDR image. Extensive qualitative and quantitative comparisons demonstrate that the proposed model outperforms the existing start-of-the-art methods and that it is robust to challenging scenes with large-scale motions and severe saturation. The source code is available at: https://github.com/Tx000/DHDRNet.

A Joint Visual-Inertial Image Registration For Mobile Hdr Imaging

A Fast Approach Against Large Foreground Motion in Real-time Image Stabilization

Locally Non-rigid Registration for Mobile HDR Photography

A Fully Automatic Registration Approach Based on Contour and SIFT for HJ-1 Images

Leveraging Local Planar Motion Property for Robust Visual Matching and Localization.

Joint HDR Denoising and Fusion: A Real-World Mobile HDR Image Dataset

High Dynamic Range Imaging of Dynamic Scenes with Saturation Compensation but without Explicit Motion Compensation

Inertia Sensor Aided Alignment for Burst Pipeline in Low Light Conditions

Joint RGB-Spectral Decomposition Model Guided Image Enhancement in Mobile Photography

Photomontage for Robust HDR Imaging with Hand-Held Cameras

Efficient HDR Reconstruction from Real-World Raw Images

High Dynamic Range Imaging for Dynamic Scenes With Large-Scale Motions and Severe Saturation

A Robust Infrared and Visible Image Registration Method for Dual Sensor UAV System

Camera Attributes Control for Visual Odometry With Motion Blur Awareness

A Fast and Automatic Fusion Algorithm for Unregistered Multi-Exposure Image Sequence

Inertial Sensors Aided Image Alignment and Stitching for Panorama on Mobile Phones

Anti-Shake HDR Imaging Using RAW Image Data

Progressive Joint Low-Light Enhancement and Noise Removal for Raw Images

HDRT: Infrared Capture for HDR Imaging

Automatic exposure strategy network for robust visual odometry in environments with high dynamic range