Abstract:One of the most challenging problems in reconstructing a high dynamic range (HDR) image from multiple low dynamic range (LDR) inputs is the ghosting artifacts caused by the object motion across different inputs. When the object motion is slight, most existing methods can well suppress the ghosting artifacts through aligning LDR inputs based on optical flow or detecting anomalies among them. However, they often fail to produce satisfactory results in practice, since the real object motion can be very large. In this study, we present a novel deep framework, termed NHDRRnet, which adopts an alternative direction and attempts to remove ghosting artifacts by exploiting the non-local correlation in inputs. In NHDRRnet, we first adopt an Unet architecture to fuse all inputs and map the fusion results into a low-dimensional deep feature space. Then, we feed the resultant features into a novel global non-local module which reconstructs each pixel by weighted averaging all the other pixels using the weights determined by their correspondences. By doing this, the proposed NHDRRnet is able to adaptively select the useful information (e.g., which are not corrupted by large motions or adverse lighting conditions) in the whole deep feature space to accurately reconstruct each pixel. In addition, we also incorporate a triple-pass residual module to capture more powerful local features, which proves to be effective in further boosting the performance. Extensive experiments on three benchmark datasets demonstrate the superiority of the proposed NDHRnet in terms of suppressing the ghosting artifacts in HDR reconstruction, especially when the objects have large motions.

HDR-Net-Fusion: Real-time 3D dynamic scene reconstruction with a hierarchical deep reinforcement network

Deep HDR Imaging via A Non-local Network

Deep SR-HDR: Joint Learning of Super-Resolution and High Dynamic Range Imaging for Dynamic Scenes

Online Global Non-rigid Registration for 3D Object Reconstruction Using Consumer-level Depth Cameras

Learning Regularized Multi-Scale Feature Flow for High Dynamic Range Imaging

HDR Video Reconstruction with a Large Dynamic Dataset in Raw and sRGB Domains

NeuralRecon: Real-Time Coherent 3D Scene Reconstruction from Monocular Video

DV-Net: Dual-view Network for 3D Reconstruction by Fusing Multiple Sets of Gated Control Point Clouds

FineRecon: Depth-aware Feed-forward Network for Detailed 3D Reconstruction

NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Video.

Learning To Reconstruct High-Quality 3d Shapes With Cascaded Fully Convolutional Networks

Deep high dynamic range imaging of dynamic scenes

High-Quality Textured 3D Shape Reconstruction with Cascaded Fully Convolutional Networks

Ultra-High-Definition Image HDR Reconstruction via Collaborative Bilateral Learning

High Dynamic Range Imaging for Dynamic Scenes With Large-Scale Motions and Severe Saturation

DGNS: Deformable Gaussian Splatting and Dynamic Neural Surface for Monocular Dynamic 3D Reconstruction

DI-Fusion: Online Implicit 3D Reconstruction with Deep Priors

HDM-Net: Monocular Non-Rigid 3D Reconstruction with Learned Deformation Model

FastFusion: Real-Time Indoor Scene Reconstruction with Fast Sensor Motion