Abstract:Event cameras are event-driven bio-inspired sensors, owing to the following advantages: high temporal resolution, high dynamic range, low power, and high imaging speed. Artificial neural networks (ANNs) cannot directly process their output spike signal. Spiking neural networks (SNNs) are neuromorphic computing methods with a high temporal resolution and are event-driven, which fits well with event cameras. However, deep SNNs require large storage space and neuronal computing resources, which limits their deployment in mobile edge computing. Based on the feature dimension mapping, this paper proposes a lightweight SNN for embedded devices to reduce storage requirements, improve efficiency, and enhance network performance. First, by analyzing the relationship between the parameter number and the fitting function of the network, the SNN parameter bottleneck is clear. Subsequently, a general lightweight feature extraction structure, SpikeFire, is proposed based on a low-dimensional feature extraction-fusion strategy, which significantly reduces network parameters on the premise that the basic properties of the receptive field and feature dimension are the same as those of a spiking convolution. Additionally, the module simulates the complex connection of the brain and adopts the skip connection, which not only increases the extraction of multi-scale information but also contributes to deep network optimization. Finally, the lightweight network is deployed in embedded hardware to build an event-driven imaging recognition system. Experiments show that our method can reduce the parameter number and improve the running speed without weakening the performance in public, self-built real scenes, and extreme imaging scene datasets.

Event camera object recognition using spatiotemporal event time surface and reward-modulated spike-timing-dependent plasticity learning rule

[A bio-inspired hierarchical spiking neural network with biological synaptic plasticity for event camera object recognition].

Event-based Action Recognition Using Motion Information and Spiking Neural Networks

Denoising algorithm based on event camera

Event Stream Learning Using Spatio-Temporal Event Surface

Graph-based Asynchronous Event Processing for Rapid Object Recognition

Event-based Object Detection with Lightweight Spatial Attention Mechanism

Denoising Method Based on Salient Region Recognition for the Spatiotemporal Event Stream

Event Camera Denoising Using Asynchronous Spatio-Temporal Event Denoising Neural Network

Effective AER Object Classification Using Segmented Probability-Maximization Learning in Spiking Neural Networks

An Event-based Feature Representation Method for Event Stream Classification Using Deep Spiking Neural Networks

An Event-based Categorization Model Using Spatio-temporal Features in a Spiking Neural Network.

Event Stream Super-Resolution Via Spatiotemporal Constraint Learning

Multi-scale Harmonic Mean Time Surfaces for Event-based Object Classification

An Event-Driven Object Recognition Model Using Activated Connected Domain Detection

Denoising of Event-Based Sensors with Deep Neural Networks

An Event-Driven Computational System With Spiking Neurons For Object Recognition

Towards Event Camera Signal Recognition Using a Lightweight Spiking Neural Network

ECSNet: Spatio-Temporal Feature Learning for Event Camera

A Time-Related Voxel Representation Method for Event Camera

Denoising of Event-Based Sensors with Spatial-Temporal Correlation