Abstract:Despite significant advances in computational algorithms and development of tactile sensors, artificial tactile sensing is strikingly less efficient and capable than the human tactile perception. Inspired by efficiency of biological systems, we aim to develop a neuromorphic system for tactile pattern recognition. We particularly target texture recognition as it is one of the most necessary and challenging tasks for artificial sensory systems. Our system consists of a piezoresistive fabric material as the sensor to emulate skin, an interface that produces spike patterns to mimic neural signals from mechanoreceptors, and an extreme learning machine (ELM) chip to analyze spiking activity. Benefiting from intrinsic advantages of biologically inspired event-driven systems and massively parallel and energy-efficient processing capabilities of the ELM chip, the proposed architecture offers a fast and energy-efficient alternative for processing tactile information. Moreover, it provides the opportunity for the development of low-cost tactile modules for large-area applications by integration of sensors and processing circuits. We demonstrate the recognition capability of our system in a texture discrimination task, where it achieves a classification accuracy of 92% for categorization of ten graded textures. Our results confirm that there exists a tradeoff between response time and classification accuracy (and information transfer rate). A faster decision can be achieved at early time steps or by using a shorter time window. This, however, results in deterioration of the classification accuracy and information transfer rate. We further observe that there exists a tradeoff between the classification accuracy and the input spike rate (and thus energy consumption). Our work substantiates the importance of development of efficient sparse codes for encoding sensory data to improve the energy efficiency. These results have a significance for a wide range of wearable, robotic, prosthetic, and industrial applications.

Spatio-temporal encoding improves neuromorphic tactile texture classification

Invariant neuromorphic representations of tactile stimuli improve robustness of a real-time texture classification system

Simultaneous Velocity and Texture Classification from a Neuromorphic Tactile Sensor Using Spiking Neural Networks

Spike Timing–based Coding in Neuromimetic Tactile System Enables Dynamic Object Classification

Neuromorphic Tactile Edge Orientation Classification in an Unsupervised Spiking Neural Network

An Extreme Learning Machine-Based Neuromorphic Tactile Sensing System for Texture Recognition

Texture recognition based on multi-sensory integration of proprioceptive and tactile signals

Object Tactile Classification Based on Convolutional Spiking Neural Network with Attention Mechanism

Robust Transcoding Sensory Information with Neural Spikes

From sensors to spikes: evolving receptive fields to enhance sensorimotor information in a robot-arm

Neural Implementation of Precise Temporal Patterns in Motor Cortex

A robotic sensory system with high spatiotemporal resolution for texture recognition

AM-SGCN: Tactile Object Recognition for Adaptive Multichannel Spiking Graph Convolutional Neural Networks

Deep Tactile Experience: Estimating Tactile Sensor Output from Depth Sensor Data

Sparse Temporal Encoding of Visual Features for Robust Object Recognition by Spiking Neurons

Tactile Sensory Coding and Learning with Bio-Inspired Optoelectronic Spiking Afferent Nerves

Spiking Neural Network Tactile Classification Method with Faster and More Accurate Membrane Potential Representation

Pre-neuronal biomechanical filtering modulates and diversifies whole-hand tactile encoding

Robot Tactile Data Classification Method Using Spiking Neural Network

Adaptive Subsampling and Learned Model Improve Spatiotemporal Resolution of Tactile Skin

Artificial Tactile Receptor System for Sensitive Pressure-Neural Spike Conversion