Abstract:Tactile sensing is essential for a variety of daily tasks. Inspired by the event-driven nature and sparse spiking communication of the biological systems, recent advances in event-driven tactile sensors and Spiking Neural Networks (SNNs) spur the research in related fields. However, SNN-enabled event-driven tactile learning is still in its infancy due to the limited representation abilities of existing spiking neurons and high spatio-temporal complexity in the event-driven tactile data. In this paper, to improve the representation capability of existing spiking neurons, we propose a novel neuron model called "location spiking neuron," which enables us to extract features of event-based data in a novel way. Specifically, based on the classical Time Spike Response Model (TSRM), we develop the Location Spike Response Model (LSRM). In addition, based on the most commonly-used Time Leaky Integrate-and-Fire (TLIF) model, we develop the Location Leaky Integrate-and-Fire (LLIF) model. Moreover, to demonstrate the representation effectiveness of our proposed neurons and capture the complex spatio-temporal dependencies in the event-driven tactile data, we exploit the location spiking neurons to propose two hybrid models for event-driven tactile learning. Specifically, the first hybrid model combines a fully-connected SNN with TSRM neurons and a fully-connected SNN with LSRM neurons. And the second hybrid model fuses the spatial spiking graph neural network with TLIF neurons and the temporal spiking graph neural network with LLIF neurons. Extensive experiments demonstrate the significant improvements of our models over the state-of-the-art methods on event-driven tactile learning, including event-driven tactile object recognition and event-driven slip detection. Moreover, compared to the counterpart artificial neural networks (ANNs), our SNN models are 10× to 100× energy-efficient, which shows the superior energy efficiency of our models and may bring new opportunities to the spike-based learning community and neuromorphic engineering. Finally, we thoroughly examine the advantages and limitations of various spiking neurons and discuss the broad applicability and potential impact of this work on other spike-based learning applications.

Spiking Neural Network Tactile Classification Method with Faster and More Accurate Membrane Potential Representation

Robot Tactile Data Classification Method Using Spiking Neural Network

Constructing Lightweight and Efficient Spiking Neural Networks for EEG-based Motor Imagery Classification

Spiking Neural Network Robot Tactile Object Recognition Method with Regularization Constraints

Object Tactile Classification Based on Convolutional Spiking Neural Network with Attention Mechanism

Event-driven Spiking Neural Network Based on Membrane Potential Modulation for Remote Sensing Image Classification

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Fast and Accurate Classification with a Multi-Spike Learning Algorithm for Spiking Neurons.

AM-SGCN: Tactile Object Recognition for Adaptive Multichannel Spiking Graph Convolutional Neural Networks

Boost event-driven tactile learning with location spiking neurons

Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

Simultaneous Velocity and Texture Classification from a Neuromorphic Tactile Sensor Using Spiking Neural Networks

Ggt-Snn: Graph Learning and Gaussian Prior Integrated Spiking Graph Neural Network for Event-Driven Tactile Object Recognition

G2T-SNN: Fusing Topological Graph and Gaussian Prior Spiking Neural Networks for Tactile Object Recognition

High-Accuracy Spiking Neural Network for Objective Recognition Based on Proportional Attenuating Neuron

CIRM-SNN: Certainty Interval Reset Mechanism Spiking Neuron for Enabling High Accuracy Spiking Neural Network

The Spiking Rates Inspired Encoder and Decoder for Spiking Neural Networks: an Illustration of Hand Gesture Recognition

An Intrinsically Knowledge-Transferring Developmental Spiking Neural Network for Tactile Classification

RRAM-Based Spiking Neural Network with Target-Modulated Spike-Timing-Dependent Plasticity

A Highly Effective and Robust Membrane Potential-Driven Supervised Learning Method for Spiking Neurons

Improving Spiking Neural Network With Frequency Adaptation for Image Classification