Abstract:Event cameras are event-driven bio-inspired sensors, owing to the following advantages: high temporal resolution, high dynamic range, low power, and high imaging speed. Artificial neural networks (ANNs) cannot directly process their output spike signal. Spiking neural networks (SNNs) are neuromorphic computing methods with a high temporal resolution and are event-driven, which fits well with event cameras. However, deep SNNs require large storage space and neuronal computing resources, which limits their deployment in mobile edge computing. Based on the feature dimension mapping, this paper proposes a lightweight SNN for embedded devices to reduce storage requirements, improve efficiency, and enhance network performance. First, by analyzing the relationship between the parameter number and the fitting function of the network, the SNN parameter bottleneck is clear. Subsequently, a general lightweight feature extraction structure, SpikeFire, is proposed based on a low-dimensional feature extraction-fusion strategy, which significantly reduces network parameters on the premise that the basic properties of the receptive field and feature dimension are the same as those of a spiking convolution. Additionally, the module simulates the complex connection of the brain and adopts the skip connection, which not only increases the extraction of multi-scale information but also contributes to deep network optimization. Finally, the lightweight network is deployed in embedded hardware to build an event-driven imaging recognition system. Experiments show that our method can reduce the parameter number and improve the running speed without weakening the performance in public, self-built real scenes, and extreme imaging scene datasets.

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

CSNN: an Augmented Spiking Based Framework with Perceptron-Inception

RSNN: Recurrent Spiking Neural Networks for Dynamic Spatial-Temporal Information Processing

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Spiking Deep Residual Networks.

Biologically Inspired Structure Learning with Reverse Knowledge Distillation for Spiking Neural Networks

An Efficient Learning Algorithm for Direct Training Deep Spiking Neural Networks

Event-based Action Recognition Using Motion Information and Spiking Neural Networks

Efficient Spiking Neural Networks with Sparse Selective Activation for Continual Learning

An Event-based Feature Representation Method for Event Stream Classification Using Deep Spiking Neural Networks

CompSNN: A lightweight spiking neural network based on spatiotemporally compressive spike features

Ultra-low Latency Spiking Neural Networks with Spatio-Temporal Compression and Synaptic Convolutional Block

Deep Pulse-Coupled Neural Networks

Unsupervised Multi-layer Spiking Convolutional Neural Network Using Layer-Wise Sparse Coding.

Deep Spiking Convolutional Neural Networks for Programmable Neuro-synaptic System

Progressive Tandem Learning for Pattern Recognition with Deep Spiking Neural Networks

Bio-Inspired Deep Spiking Neural Network For Image Classification

Convolutional Spiking Neural Networks for Spatio-Temporal Feature Extraction

Temporal-Coded Deep Spiking Neural Network with Easy Training and Robust Performance.

Towards Event Camera Signal Recognition Using a Lightweight Spiking Neural Network

Spiking Deep Residual Network