Abstract:Tactile sensing is essential for a variety of daily tasks. Inspired by the event-driven nature and sparse spiking communication of the biological systems, recent advances in event-driven tactile sensors and Spiking Neural Networks (SNNs) spur the research in related fields. However, SNN-enabled event-driven tactile learning is still in its infancy due to the limited representation abilities of existing spiking neurons and high spatio-temporal complexity in the event-driven tactile data. In this paper, to improve the representation capability of existing spiking neurons, we propose a novel neuron model called "location spiking neuron," which enables us to extract features of event-based data in a novel way. Specifically, based on the classical Time Spike Response Model (TSRM), we develop the Location Spike Response Model (LSRM). In addition, based on the most commonly-used Time Leaky Integrate-and-Fire (TLIF) model, we develop the Location Leaky Integrate-and-Fire (LLIF) model. Moreover, to demonstrate the representation effectiveness of our proposed neurons and capture the complex spatio-temporal dependencies in the event-driven tactile data, we exploit the location spiking neurons to propose two hybrid models for event-driven tactile learning. Specifically, the first hybrid model combines a fully-connected SNN with TSRM neurons and a fully-connected SNN with LSRM neurons. And the second hybrid model fuses the spatial spiking graph neural network with TLIF neurons and the temporal spiking graph neural network with LLIF neurons. Extensive experiments demonstrate the significant improvements of our models over the state-of-the-art methods on event-driven tactile learning, including event-driven tactile object recognition and event-driven slip detection. Moreover, compared to the counterpart artificial neural networks (ANNs), our SNN models are 10× to 100× energy-efficient, which shows the superior energy efficiency of our models and may bring new opportunities to the spike-based learning community and neuromorphic engineering. Finally, we thoroughly examine the advantages and limitations of various spiking neurons and discuss the broad applicability and potential impact of this work on other spike-based learning applications.

Event-driven Spiking Neural Networks with Spike-Based Learning

Event-Driven Learning for Spiking Neural Networks

RSNN: Recurrent Spiking Neural Networks for Dynamic Spatial-Temporal Information Processing

An Event-based Feature Representation Method for Event Stream Classification Using Deep Spiking Neural Networks

Effective AER Object Classification Using Segmented Probability-Maximization Learning in Spiking Neural Networks

An Event-based Categorization Model Using Spatio-temporal Features in a Spiking Neural Network.

Training Spiking Neural Networks with Event-driven Backpropagation

A Spike-Timing Based Integrated Model for Pattern Recognition

An Event-Driven Computational System With Spiking Neurons For Object Recognition

Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

An Event-Driven Categorization Model for AER Image Sensors Using Multispike Encoding and Learning

Spiking Neural Networks for event-based action recognition: A new task to understand their advantage

Boost event-driven tactile learning with location spiking neurons

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

Spiking Neural Network Recognition Method Based on Dynamic Visual Motion Features

A Spike Learning System for Event-driven Object Recognition

SSTDP: Supervised Spike Timing Dependent Plasticity for Efficient Spiking Neural Network Training

An Efficient Learning Algorithm for Direct Training Deep Spiking Neural Networks

PT-Spike: A Precise-Time-Dependent Single Spike Neuromorphic Architecture with Efficient Supervised Learning

EAS-SNN: End-to-End Adaptive Sampling and Representation for Event-based Detection with Recurrent Spiking Neural Networks