Abstract:This letter introduces a study to precisely measure what an increase in spike timing precision can add to spike-driven pattern recognition algorithms. The concept of generating spikes from images by converting gray levels into spike timings is currently at the basis of almost every spike-based modeling of biological visual systems. The use of images naturally leads to generating incorrect artificial and redundant spike timings and, more important, also contradicts biological findings indicating that visual processing is massively parallel, asynchronous with high temporal resolution. A new concept for acquiring visual information through pixel-individual asynchronous level-crossing sampling has been proposed in a recent generation of asynchronous neuromorphic visual sensors. Unlike conventional cameras, these sensors acquire data not at fixed points in time for the entire array but at fixed amplitude changes of their input, resulting optimally sparse in space and time-pixel individually and precisely timed only if new, (previously unknown) information is available (event based). This letter uses the high temporal resolution spiking output of neuromorphic event-based visual sensors to show that lowering time precision degrades performance on several recognition tasks specifically when reaching the conventional range of machine vision acquisition frequencies (30-60 Hz). The use of information theory to characterize separability between classes for each temporal resolution shows that high temporal acquisition provides up to 70% more information that conventional spikes generated from frame-based acquisition as used in standard artificial vision, thus drastically increasing the separability between classes of objects. Experiments on real data show that the amount of information loss is correlated with temporal precision. Our information-theoretic study highlights the potentials of neuromorphic asynchronous visual sensors for both practical applications and theoretical investigations. Moreover, it suggests that representing visual information as a precise sequence of spike times as reported in the retina offers considerable advantages for neuro-inspired visual computations.

What can neuromorphic event-driven precise timing add to spike-based pattern recognition?

Spiking-timing based pattern recognition with real-world visual stimuli

A Spike-Timing Based Integrated Model for Pattern Recognition

Precise spiking motifs in neurobiological and neuromorphic data

Sparse Temporal Encoding of Visual Features for Robust Object Recognition by Spiking Neurons

Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Application Of Precise-Spike-Driven Rule In Spiking Neural Networks For Optical Character Recognition

Impact of spiking neurons leakages and network recurrences on event-based spatio-temporal pattern recognition

Precise-Spike-Driven Synaptic Plasticity: Learning Hetero-Association of Spatiotemporal Spike Patterns

NeuSpike-Net: High Speed Video Reconstruction via Bio-inspired Neuromorphic Cameras

Ultra-high Temporal Resolution Visual Reconstruction from a Fovea-like Spike Camera via Spiking Neuron Model

Computational event-driven vision sensors for in-sensor spiking neural networks

A Sparse Coding Multi-Scale Precise-Timing Machine Learning Algorithm for Neuromorphic Event-Based Sensors

A Neurally Inspired Pattern Recognition Approach with Latency-Phase Encoding and Precise-Spike-driven Rule in Spiking Neural Network.

Temporal Encoding and Multispike Learning Framework for Efficient Recognition of Visual Patterns.

Coding static natural images using spiking event times: do neurons cooperate?

Pattern Recognition Computation in a Spiking Neural Network with Temporal Encoding and Learning

Learning heterogeneous delays in a layer of spiking neurons for fast motion detection

Design and Mathematical Modelling of Inter Spike Interval of Temporal Neuromorphic Encoder for Image Recognition

Fast Unsupervised Learning for Visual Pattern Recognition Using Spike Timing Dependent Plasticity.