Abstract:Address event representation (AER) sensors, recording frameless event data, have recently attracted more attention due to the advantages of sparsed spatiotemporal representation. Spiking neural network (SNN) is a representative biologically plausible model, which is inherently suitable for event-driven AER data processing. However, AER object classification using SNN is still challenging due to the lack of robustness for free moving object recognition. This paper proposes a novel event-driven hierarchical recognition model using an activated connected domain (ACD) location method and an SNN classifier with fusion mechanism. The proposed model extracts bio-inspired cortex-like features by Gabor filters with multiple orientations and scales. Meanwhile, the ACD mechanism coordinates with feature extraction to obtain stable features under random movement of objects. Finally, the features are discriminated by the Tempotron classifier with feature fusion to reduce computing consumption while maintaining comparable performance. Comprehensive experiments conducted on several AER datasets have shown superior performance of the proposed system. Besides, we extend the MNIST-DVS dataset to simulate random moving objects by adding a random continuous spatial offset to the event streams of its samples. Ablation experiments demonstrate that the ACD mechanism enriches the model recognizing capability for free moving objects, especially for training samples only with fixed trajectory movement, which reflects the applicability and robustness. This model equips a high potential for innovation and development in the recognition of moving objects in natural scenes.

Classification of Spatiotemporal Events Based on Random Forest

Very High Resolution Remote Sensing Imagery Classification Using a Fusion of Random Forest and Deep Learning Technique—Subtropical Area for Example

An Event-based Categorization Model Using Spatio-temporal Features in a Spiking Neural Network.

Feedforward Categorization on AER Motion Events Using Cortex-Like Features in a Spiking Neural Network

On random hyper-class random forest for visual classification

An Event-Driven Categorization Model for AER Image Sensors Using Multispike Encoding and Learning

An Event-Driven Object Recognition Model Using Activated Connected Domain Detection

Effective AER Object Classification Using Segmented Probability-Maximization Learning in Spiking Neural Networks

An Event-based Feature Representation Method for Event Stream Classification Using Deep Spiking Neural Networks

Exploiting Spectral–Spatial Information Using Deep Random Forest for Hyperspectral Imagery Classification

Bio-inspired Categorization Using Event-Driven Feature Extraction and Spike-Based Learning.

Bag of Events: an Efficient Probability-Based Feature Extraction Method for AER Image Sensors

High-order Local Spatial Context Modeling by Spatialized Random Forest.

A bio-inspired feedforward system for categorization of AER motion events

Multi-scale Harmonic Mean Time Surfaces for Event-based Object Classification

Efficient Image Classification Using Sparse Coding and Random Forest

Hyperspectral Image Classification with Rotation Random Forest Via KPCA

Image Classification and Recognition Based on Deep Learning and Random Forest Algorithm

Neural Forest Learning.

Building Emerging Pattern (EP) Random Forest for Recognition

Deep Representation Via Convolutional Neural Network for Classification of Spatiotemporal Event Streams