Abstract:Despite significant advances in computational algorithms and development of tactile sensors, artificial tactile sensing is strikingly less efficient and capable than the human tactile perception. Inspired by efficiency of biological systems, we aim to develop a neuromorphic system for tactile pattern recognition. We particularly target texture recognition as it is one of the most necessary and challenging tasks for artificial sensory systems. Our system consists of a piezoresistive fabric material as the sensor to emulate skin, an interface that produces spike patterns to mimic neural signals from mechanoreceptors, and an extreme learning machine (ELM) chip to analyze spiking activity. Benefiting from intrinsic advantages of biologically inspired event-driven systems and massively parallel and energy-efficient processing capabilities of the ELM chip, the proposed architecture offers a fast and energy-efficient alternative for processing tactile information. Moreover, it provides the opportunity for the development of low-cost tactile modules for large-area applications by integration of sensors and processing circuits. We demonstrate the recognition capability of our system in a texture discrimination task, where it achieves a classification accuracy of 92% for categorization of ten graded textures. Our results confirm that there exists a tradeoff between response time and classification accuracy (and information transfer rate). A faster decision can be achieved at early time steps or by using a shorter time window. This, however, results in deterioration of the classification accuracy and information transfer rate. We further observe that there exists a tradeoff between the classification accuracy and the input spike rate (and thus energy consumption). Our work substantiates the importance of development of efficient sparse codes for encoding sensory data to improve the energy efficiency. These results have a significance for a wide range of wearable, robotic, prosthetic, and industrial applications.

Fast and Accurate Object Recognition Based on Tactile Data by Using Dendrite Net.

Object Tactile Classification Based on Convolutional Spiking Neural Network with Attention Mechanism

Highly efficient recognition of similar objects based on ionic robotic tactile sensors

Tactile Glove-Decode and Classify the Human Grasping Process

Tactile-GAT: tactile graph attention networks for robot tactile perception classification

9DTact: A Compact Vision-Based Tactile Sensor for Accurate 3D Shape Reconstruction and Generalizable 6D Force Estimation

DenseTact 2.0: Optical Tactile Sensor for Shape and Force Reconstruction

Tactile Perception Information Recognition of Prosthetic Hand Based on DNN-LSTM

DenseTact: Optical Tactile Sensor for Dense Shape Reconstruction

A multisensory-feedback tactile glove with dense coverage of sensing arrays for object recognition

Compressed Learning for Tactile Object Classification

Robot Tactile Data Classification Method Using Spiking Neural Network

Object Recognition Using Tactile Measurements: Kernel Sparse Coding Methods

Tactile Object Recognition for Humanoid Robots Using New Designed Piezoresistive Tactile Sensor and DCNN

Visual–tactile Object Recognition of a Soft Gripper Based on Faster Region-based Convolutional Neural Network and Machining Learning Algorithm

DelTact: A Vision-based Tactile Sensor Using Dense Color Pattern

A Stable and Efficient Vision-Based Tactile Sensor with Tactile Detection Using Neural Network.

High-resolution, High-Speed and Low-Cost Flexible Tactile Sensor Array System

An Extreme Learning Machine-Based Neuromorphic Tactile Sensing System for Texture Recognition

PseudoTouch: Efficiently Imaging the Surface Feel of Objects for Robotic Manipulation

Inter-finger Small Object Manipulation With DenseTact Optical Tactile Sensor