Abstract:A new multiple orientation event-based neurobiological recognition system is proposed by integrating recognition and tracking function in this paper, which is used for asynchronous address-event representation (AER) image sensors. The characteristic of this system has been enriched to recognize the objects in multiple orientations with only training samples moving in a single orientation. The system extracts multi-scale and multi-orientation line features inspired by models of the primate visual cortex. An orientation detector based on modified Gaussian blob tracking algorithm is introduced for object tracking and orientation detection. The orientation detector and feature extraction block work in simultaneous mode, without any increase in categorization time. An addresses lookup table (addresses LUT) is also presented to adjust the feature maps by addresses mapping and reordering, and they are categorized in the trained spiking neural network. This recognition system is evaluated with the MNIST dataset which have played important roles in the development of computer vision, and the accuracy is increased owing to the use of both ON and OFF events. AER data acquired by a dynamic vision senses (DVS) are also tested on the system, such as moving digits, pokers, and vehicles. The experimental results show that the proposed system can realize event-based multi-orientation recognition. The work presented in this paper makes a number of contributions to the event-based vision processing system for multi-orientation object recognition. It develops a new tracking-recognition architecture to feedforward categorization system and an address reorder approach to classify multi-orientation objects using event-based data. It provides a new way to recognize multiple orientation objects with only samples in single orientation.

Feedforward Categorization on AER Motion Events Using Cortex-Like Features in a Spiking Neural Network

A bio-inspired feedforward system for categorization of AER motion events

Bio-inspired Categorization Using Event-Driven Feature Extraction and Spike-Based Learning.

An Event-based Categorization Model Using Spatio-temporal Features in a Spiking Neural Network.

An Event-Driven Categorization Model for AER Image Sensors Using Multispike Encoding and Learning

An Event-Driven Object Recognition Model Using Activated Connected Domain Detection

An Event-Driven Computational System With Spiking Neurons For Object Recognition

Effective AER Object Classification Using Segmented Probability-Maximization Learning in Spiking Neural Networks

Bag of Events: an Efficient Probability-Based Feature Extraction Method for AER Image Sensors

EventF2S: Asynchronous and Sparse Spiking AER Framework using Neuromorphic-Friendly Algorithm

Efficient Motion Symbol Detection and Multi-kernel Learning for AER Object Recognition

An Event-based Feature Representation Method for Event Stream Classification Using Deep Spiking Neural Networks

A Bio-Inspired Hierarchical Spiking Neural Network With Reward-Modulated STDP Learning Rule for AER Object Recognition

Recognition for AER Objects Based on Hierarchical Feature Construction

An Event-Based Neurobiological Recognition System with Orientation Detector for Objects in Multiple Orientations

Event-driven Spiking Neural Networks with Spike-Based Learning

Event-based Action Recognition Using Motion Information and Spiking Neural Networks

ASIE: An Asynchronous SNN Inference Engine for AER Events Processing

Neuromorphic Computing with AER using Time-to-Event-Margin Propagation

Unsupervised AER Object Recognition Based on Multiscale Spatio-Temporal Features and Spiking Neurons

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.