Abstract:Event cameras are asynchronous sensors that operate in a completely different way from traditional cameras.Rather than catching pictures at a steady rate,event cameras measure light changes (called events) separately for every pixel.As a sequence,it alleviates the problems of traditional cameras in complex light conditions and scenes where objects move at high speed.With the development of convolutional neural networks,learning-based pattern recognition methods have made great progress in visual tasks such as optical flow estimation and target recognition by converting the output of the event camera into a pseudo-ima-ge representation.However,such methods abandon the temporal correlation between the event streams,so that the texture of the pseudo image is not clear enough,and it is difficult to extract the features.The key to solving this problem lies in how to model relevant information between events in the sample.Therefore,a neural network framework based on event stream partition algorithm is proposed,which explicitly integrates the temporal information of event streams.The framework divides the incoming stream of events into several parts,and a weight distribution network assigns different weights to each piece of the streams.Then,the framework uses convolutional neural network to fuse temporal information and extract advanced features.Finally,the input sample is classified.We thoroughly validate the proposed framework on object recognition.Comparison experiments on N-Caltech101 and N-cars datasets show that the proposed framework has a significant improvement in classification accuracy compared with the most advanced existing algorithms.

Intensity-image reconstruction for event cameras using convolutional neural network

Event-Based Fusion for Motion Deblurring with Cross-modal Attention

Event Enhanced High-Quality Image Recovery

MEFNet: Multi-scale Event Fusion Network for Motion Deblurring

Intensity/Inertial Integration-Aided Feature Tracking on Event Cameras

A Review of Image Reconstruction Based on Event Cameras

Learning to Reconstruct High Speed and High Dynamic Range Videos from Events

EvIntSR-Net: Event Guided Multiple Latent Frames Reconstruction and Super-resolution

Hybrid Event-Enhanced Image De-Occlusion

Time Information Integration Network for Event Cameras

Continuous-time Intensity Estimation Using Event Cameras

EventHDR: from Event to High-Speed HDR Videos and Beyond

Real-Time Intensity-Image Reconstruction for Event Cameras Using Manifold Regularisation

Learning to Deblur and Generate High Frame Rate Video with an Event Camera

A Residual Learning Approach to Deblur and Generate High Frame Rate Video with an Event Camera

Image De-occlusion via Event-enhanced Multi-modal Fusion Hybrid Network

Learning Adaptive Parameter Representation for Event-based Video Reconstruction

Sparse-E2VID: A Sparse Convolutional Model for Event-Based Video Reconstruction Trained with Real Event Noise.

Event-Driven Video Restoration with Spiking-Convolutional Architecture

Event-based Video Reconstruction Using Transformer

Event-based High Dynamic Range Image and Very High Frame Rate Video Generation using Conditional Generative Adversarial Networks