Abstract:One of the most challenging problems in reconstructing a high dynamic range (HDR) image from multiple low dynamic range (LDR) inputs is the ghosting artifacts caused by the object motion across different inputs. When the object motion is slight, most existing methods can well suppress the ghosting artifacts through aligning LDR inputs based on optical flow or detecting anomalies among them. However, they often fail to produce satisfactory results in practice, since the real object motion can be very large. In this study, we present a novel deep framework, termed NHDRRnet, which adopts an alternative direction and attempts to remove ghosting artifacts by exploiting the non-local correlation in inputs. In NHDRRnet, we first adopt an Unet architecture to fuse all inputs and map the fusion results into a low-dimensional deep feature space. Then, we feed the resultant features into a novel global non-local module which reconstructs each pixel by weighted averaging all the other pixels using the weights determined by their correspondences. By doing this, the proposed NHDRRnet is able to adaptively select the useful information (e.g., which are not corrupted by large motions or adverse lighting conditions) in the whole deep feature space to accurately reconstruct each pixel. In addition, we also incorporate a triple-pass residual module to capture more powerful local features, which proves to be effective in further boosting the performance. Extensive experiments on three benchmark datasets demonstrate the superiority of the proposed NDHRnet in terms of suppressing the ghosting artifacts in HDR reconstruction, especially when the objects have large motions.

Learning Rank-1 Diffractive Optics for Single-Shot High Dynamic Range Imaging

A novel high dynamic range microscopic video system based on REC.2020

Elimination of Varying Chromatic Aberrations Based on Diffractive Optics

Multishot Hyperspectral Imaging Based on Tunable Diffractive Lenses

Learning from General Diffuse Surfaces: An Event-driven Approach for High Dynamic Range Industrial Optical Measurement

Pixel-wise Exposure Control for Single-Shot HDR Imaging: A Joint Optimization Approach

NTIRE 2021 Challenge on High Dynamic Range Imaging: Dataset, Methods and Results

Efficient HDR Reconstruction from Real-World Raw Images

Deep HDR Imaging via A Non-local Network

Pix2HDR -- A pixel-wise acquisition and deep learning-based synthesis approach for high-speed HDR videos

Learned HDR Image Compression for Perceptually Optimal Storage and Display

Pixel-wise Optical Encoder Driven by Video Prediction: Towards Single-Shot High Dynamic Range Moving Object Recognition

HDR Imaging with Spatially Varying Signal-to-Noise Ratios

HDR Video Reconstruction with a Large Dynamic Dataset in Raw and sRGB Domains

Physics Constrained Unsupervised Deep Learning for Rapid, High Resolution Scanning Coherent Diffraction Reconstruction

HDR-GS: Efficient High Dynamic Range Novel View Synthesis at 1000x Speed via Gaussian Splatting

HDRT: Infrared Capture for HDR Imaging

HDR reconstruction from a single exposure LDR using texture and structure dual-stream generation

Deep Learning for HDR Imaging: State-of-the-Art and Future Trends