Abstract:Neuromorphic imaging reacts to per-pixel brightness changes of a dynamic scene with high temporal precision and responds with asynchronous streaming events as a result. It also often supports a simultaneous output of an intensity image. Nevertheless, the raw events typically involve a large amount of noise due to the high sensitivity of the sensor, while capturing fast-moving objects at low frame rates results in blurry images. These deficiencies significantly degrade human observation and machine processing. Fortunately, the two information sources are inherently complementary — events with microsecond-level temporal resolution, which are triggered by the edges of objects recorded in a latent sharp image, can supply rich motion details missing from the blurry one. In this work, we bring the two types of data together and introduce a simple yet effective unifying algorithm to jointly reconstruct blur-free images and noise-robust events in an iterative coarse-to-fine fashion. Specifically, an event-regularized prior offers precise high-frequency structures and dynamic features for blind deblurring, while image gradients serve as a kind of faithful supervision in regulating neuromorphic noise removal. Comprehensively evaluated on real and synthetic samples, such a synergy delivers superior reconstruction quality for both images with severe motion blur and raw event streams with a storm of noise, and also exhibits greater robustness to challenging realistic scenarios such as varying levels of illumination, contrast and motion magnitude. Meanwhile, it can be driven by much fewer events and holds a competitive edge at computational time overhead, rendering itself preferable as available computing resources are limited. Our solution gives impetus to the improvement of both sensing data and paves the way for highly accurate neuromorphic reasoning and analysis.

IMAGING METHOD AND DEVICE

Dual-Focal Camera Hdr Imaging Based On Convolutional Neural Network

A novel high dynamic range microscopic video system based on REC.2020

Hybrid High Dynamic Range Imaging fusing Neuromorphic and Conventional Images

Neuromorphic Camera Guided High Dynamic Range Imaging

Ghost-Free Deep High-Dynamic-Range Imaging Using Focus Pixels for Complex Motion Scenes

Progressive and Selective Fusion Network for High Dynamic Range Imaging

High dynamic range imaging by a pseudo exposure fusion method based on artificial remapping

Deep HDR Imaging via A Non-local Network

Deep high dynamic range imaging of dynamic scenes

Neuromorphic Imaging with Super-Resolution

Deep SR-HDR: Joint Learning of Super-Resolution and High Dynamic Range Imaging for Dynamic Scenes

Low-Light Color Imaging via Dual Camera Acquisition.

High Dynamic Range Imaging for Dynamic Scenes With Large-Scale Motions and Severe Saturation

Graphic-Processing-Unit-Accelerated Real-Time Exposure Fusion Method Using Pixel-Level Optimal Exposure Criterion

Application of deep learning model based on image definition in real-time digital image fusion

Deep progressive feature aggregation network for multi-frame high dynamic range imaging

Neuromorphic Imaging With Joint Image Deblurring and Event Denoising

High Dynamic Range Image Capturing And Displaying

High resolution light field image recreation method and imaging device

A real-time high dynamic range intensified complementary metal oxide semiconductor camera based on FPGA