Abstract:Event cameras, such as dynamic vision sensors (DVS), are biologically inspired vision sensors that have advanced over conventional cameras in high dynamic range, low latency and low power consumption, showing great application potential in many fields. Event cameras are more sensitive to junction leakage current and photocurrent as they output differential signals, losing the smoothing function of the integral imaging process in the RGB camera. The logarithmic conversion further amplifies noise, especially in low-contrast conditions. Recently, researchers proposed a series of datasets and evaluation metrics but limitations remain: 1) the existing datasets are small in scale and insufficient in noise diversity, which cannot reflect the authentic working environments of event cameras; and 2) the existing denoising evaluation metrics are mostly referenced evaluation metrics, relying on APS information or manual annotation. To address the above issues, we construct a large-scale event denoising dataset (multilevel benchmark for event denoising, E-MLB) for the first time, which consists of 100 scenes, each with four noise levels, that is 12 times larger than the largest existing denoising dataset. We also propose the first nonreference event denoising metric, the event structural ratio (ESR), which measures the structural intensity of given events. ESR is inspired by the contrast metric, but is independent of the number of events and projection direction. Based on the proposed benchmark and ESR, we evaluate the most representative denoising algorithms, including classic and SOTA, and provide denoising baselines under various scenes and noise levels. The corresponding results and codes are available at https://github.com/KugaMaxx/cuke-emlb

Denoising algorithm based on event camera

Denoising Method Based on Salient Region Recognition for the Spatiotemporal Event Stream

Event Stream Denoising Method Based on Spatio-Temporal Density and Time Sequence Analysis

Event Camera Denoising Using Asynchronous Spatio-Temporal Event Denoising Neural Network

Denoising of Event-Based Sensors with Deep Neural Networks

Adaptive Event Address Map Denoising for Event Cameras

Denoising of Event-Based Sensors with Spatial-Temporal Correlation

Event camera object recognition using spatiotemporal event time surface and reward-modulated spike-timing-dependent plasticity learning rule

A Plug-and-play Demosaicing and Denoising Method on Mobile Cameras

Low Cost and Latency Event Camera Background Activity Denoising

STCC-Filter: A Space-Time-content Correlation-Based Noise Filter with Self-Adjusting Threshold for Event Camera

E-MLB: Multilevel Benchmark for Event-Based Camera Denoising

LED: A Large-scale Real-world Paired Dataset for Event Camera Denoising

A Review of Image Reconstruction Based on Event Cameras

Neuromorphic Imaging With Density-Based Spatiotemporal Denoising

A motion denoising algorithm with Gaussian self-adjusting threshold for event camera

Two-stage Local Spatio-temporal Event Filter Based on Adaptive Thresholds

Deblurring Low-Light Images with Events.

Robust Intensity Image Reconstruciton Based on Event Cameras

Event-based Camera Simulation using Monte Carlo Path Tracing with Adaptive Denoising

Learning to Deblur and Generate High Frame Rate Video with an Event Camera