Abstract:Dynamic Vision Sensor (DVS) is a new type of neuromorphic event-based sensor, which has an innate advantage in capturing fast-moving objects. Due to the interference of DVS hardware itself and many external factors, noise is unavoidable in the output of DVS. Different from frame/image with structural data, the output of DVS is in the form of address-event representation (AER), which means that the traditional denoising methods cannot be used for the output (i.e., event stream) of the DVS. In this paper, we propose a novel event stream denoising method based on probabilistic undirected graph model (PUGM). The motion of objects always shows a certain regularity/trajectory in space and time, which reflects the spatio-temporal correlation between effective events in the stream. Meanwhile, the event stream of DVS is composed by the effective events and random noise. Thus, a probabilistic undirected graph model is constructed to describe such priori knowledge (i.e., spatio-temporal correlation). The undirected graph model is factorized into the product of the cliques energy function, and the energy function is defined to obtain the complete expression of the joint probability distribution. Better denoising effect means a higher probability (lower energy), which means the denoising problem can be transfered into energy optimization problem. Thus, the iterated conditional modes (ICM) algorithm is used to optimize the model to remove the noise. Experimental results on denoising show that the proposed algorithm can effectively remove noise events. Moreover, with the preprocessing of the proposed algorithm, the recognition accuracy on AER data can be remarkably promoted. The source code of the proposed method is available at https://web.xidian.edu.cn/wjj/paper.html.

A motion denoising algorithm with Gaussian self-adjusting threshold for event camera

Beyond Camera Motion Removing: How to Handle Outliers in Deblurring

A New Approach for Real-Time Segmenting Moving Objects under Cluttered Background

Adaptive Event Address Map Denoising for Event Cameras

Low Cost and Latency Event Camera Background Activity Denoising

Denoising algorithm based on event camera

Denoising Method Based on Salient Region Recognition for the Spatiotemporal Event Stream

E-MLB: Multilevel Benchmark for Event-Based Camera Denoising

Denoising of Event-Based Sensors with Spatial-Temporal Correlation

Event Camera Denoising Using Asynchronous Spatio-Temporal Event Denoising Neural Network

Event Stream Denoising Method Based on Spatio-Temporal Density and Time Sequence Analysis

Globally-Optimal Event Camera Motion Estimation

ProgressiveMotionSeg: Mutually Reinforced Framework for Event-Based Motion Segmentation

STCC-Filter: A Space-Time-content Correlation-Based Noise Filter with Self-Adjusting Threshold for Event Camera

Deblurring Low-Light Images with Events.

Event-based Motion Deblurring via Multi-Temporal Granularity Fusion

Probabilistic Undirected Graph Based Denoising Method for Dynamic Vision Sensor

Denoising Method for Dynamic Vision Sensor Based on Two-Dimensional Event Density

Learning Event-Driven Video Deblurring and Interpolation

A Cascaded Timestamp-Free Event Camera Image Compression Method for Gesture Recognition

Update The Gmms Via Adaptive Kalman Filtering