Abstract:Address event representation (AER) sensors, recording frameless event data, have recently attracted more attention due to the advantages of sparsed spatiotemporal representation. Spiking neural network (SNN) is a representative biologically plausible model, which is inherently suitable for event-driven AER data processing. However, AER object classification using SNN is still challenging due to the lack of robustness for free moving object recognition. This paper proposes a novel event-driven hierarchical recognition model using an activated connected domain (ACD) location method and an SNN classifier with fusion mechanism. The proposed model extracts bio-inspired cortex-like features by Gabor filters with multiple orientations and scales. Meanwhile, the ACD mechanism coordinates with feature extraction to obtain stable features under random movement of objects. Finally, the features are discriminated by the Tempotron classifier with feature fusion to reduce computing consumption while maintaining comparable performance. Comprehensive experiments conducted on several AER datasets have shown superior performance of the proposed system. Besides, we extend the MNIST-DVS dataset to simulate random moving objects by adding a random continuous spatial offset to the event streams of its samples. Ablation experiments demonstrate that the ACD mechanism enriches the model recognizing capability for free moving objects, especially for training samples only with fixed trajectory movement, which reflects the applicability and robustness. This model equips a high potential for innovation and development in the recognition of moving objects in natural scenes.

A dynamic vision sensor object recognition model based on trainable event-driven convolution and spiking attention mechanism

RSNN: Recurrent Spiking Neural Networks for Dynamic Spatial-Temporal Information Processing

Spiking Neural Network Recognition Method Based on Dynamic Visual Motion Features

CSNN: an Augmented Spiking Based Framework with Perceptron-Inception

Event-Based Multimodal Spiking Neural Network with Attention Mechanism

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

An Event-Driven Object Recognition Model Using Activated Connected Domain Detection

Sparse Temporal Encoding of Visual Features for Robust Object Recognition by Spiking Neurons

An Event-Driven Computational System With Spiking Neurons For Object Recognition

Sparser spiking activity can be better: Feature Refine-and-Mask spiking neural network for event-based visual recognition

Event-based Action Recognition Using Motion Information and Spiking Neural Networks

An Event-based Categorization Model Using Spatio-temporal Features in a Spiking Neural Network.

SpikingViT: a Multi-scale Spiking Vision Transformer Model for Event-based Object Detection

Lightweight Convolutional SNN for Address Event Representation Signal Recognition.

A Spike Learning System for Event-driven Object Recognition

A 1000 fps Spiking Neural Network Tracking Algorithm for On-Chip Processing of Dynamic Vision Sensor Data

An Event-Driven Categorization Model for AER Image Sensors Using Multispike Encoding and Learning

An Event Coding Method Based on Frame Images with Dynamic Vision Sensor Modeling

A Retinotopic Spiking Neural Network System for Accurate Recognition of Moving Objects Using NeuCube and Dynamic Vision Sensors

A Spatial–Channel–Temporal-Fused Attention for Spiking Neural Networks