Abstract:Despite significant advances in computational algorithms and development of tactile sensors, artificial tactile sensing is strikingly less efficient and capable than the human tactile perception. Inspired by efficiency of biological systems, we aim to develop a neuromorphic system for tactile pattern recognition. We particularly target texture recognition as it is one of the most necessary and challenging tasks for artificial sensory systems. Our system consists of a piezoresistive fabric material as the sensor to emulate skin, an interface that produces spike patterns to mimic neural signals from mechanoreceptors, and an extreme learning machine (ELM) chip to analyze spiking activity. Benefiting from intrinsic advantages of biologically inspired event-driven systems and massively parallel and energy-efficient processing capabilities of the ELM chip, the proposed architecture offers a fast and energy-efficient alternative for processing tactile information. Moreover, it provides the opportunity for the development of low-cost tactile modules for large-area applications by integration of sensors and processing circuits. We demonstrate the recognition capability of our system in a texture discrimination task, where it achieves a classification accuracy of 92% for categorization of ten graded textures. Our results confirm that there exists a tradeoff between response time and classification accuracy (and information transfer rate). A faster decision can be achieved at early time steps or by using a shorter time window. This, however, results in deterioration of the classification accuracy and information transfer rate. We further observe that there exists a tradeoff between the classification accuracy and the input spike rate (and thus energy consumption). Our work substantiates the importance of development of efficient sparse codes for encoding sensory data to improve the energy efficiency. These results have a significance for a wide range of wearable, robotic, prosthetic, and industrial applications.

Design and Verification of Tactile Sensor for Texture Recognition

Fine Texture Detection Based on a Solid-Liquid Composite Flexible Tactile Sensor Array

A Dual-Modal Vision-Based Tactile Sensor for Robotic Hand Grasping.

A robotic sensory system with high spatiotemporal resolution for texture recognition

Flexible Tactile Sensor Array for Slippage and Grooved Surface Recognition in Sliding Movement

Fingerprint-inspired Biomimetic Tactile Sensors for the Surface Texture Recognition

Texture Recognition Based on Perception Data from a Bionic Tactile Sensor

Design and tactile classification of flexible tactile sensor for soft gripper

Seeing Through your Skin: Recognizing Objects with a Novel Visuotactile Sensor

Real-time Marker Recognition Using Vision-based Tactile Sensor

Surface Texture Recognition by Deep Learning‐Enhanced Tactile Sensing

Multifunctional Tactile Sensors for Object Recognition

Design of a Biomimetic Tactile Sensor for Material Classification

Finger‐Skin‐Inspired Flexible Optical Sensor for Force Sensing and Slip Detection in Robotic Grasping

Human-Touch-Inspired Material Recognition for Robotic Tactile Sensing

DelTact: A Vision-based Tactile Sensor Using Dense Color Pattern

An Extreme Learning Machine-Based Neuromorphic Tactile Sensing System for Texture Recognition

A novel tactile sensor with multimodal vision and tactile units for multifunctional robot interaction

A Stable and Efficient Vision-Based Tactile Sensor with Tactile Detection Using Neural Network.

Signal Processing Circuit for Vision-Based Tactile Sensor

Design, Optimization and Application of Tactile Sensor Based on Virtual Binocular Vision