Abstract:Despite significant advances in computational algorithms and development of tactile sensors, artificial tactile sensing is strikingly less efficient and capable than the human tactile perception. Inspired by efficiency of biological systems, we aim to develop a neuromorphic system for tactile pattern recognition. We particularly target texture recognition as it is one of the most necessary and challenging tasks for artificial sensory systems. Our system consists of a piezoresistive fabric material as the sensor to emulate skin, an interface that produces spike patterns to mimic neural signals from mechanoreceptors, and an extreme learning machine (ELM) chip to analyze spiking activity. Benefiting from intrinsic advantages of biologically inspired event-driven systems and massively parallel and energy-efficient processing capabilities of the ELM chip, the proposed architecture offers a fast and energy-efficient alternative for processing tactile information. Moreover, it provides the opportunity for the development of low-cost tactile modules for large-area applications by integration of sensors and processing circuits. We demonstrate the recognition capability of our system in a texture discrimination task, where it achieves a classification accuracy of 92% for categorization of ten graded textures. Our results confirm that there exists a tradeoff between response time and classification accuracy (and information transfer rate). A faster decision can be achieved at early time steps or by using a shorter time window. This, however, results in deterioration of the classification accuracy and information transfer rate. We further observe that there exists a tradeoff between the classification accuracy and the input spike rate (and thus energy consumption). Our work substantiates the importance of development of efficient sparse codes for encoding sensory data to improve the energy efficiency. These results have a significance for a wide range of wearable, robotic, prosthetic, and industrial applications.

Real-Time Recurrent Tactile Recognition: Momentum Batch-Sequential Echo State Networks

Fix-Budget And Recurrent Data Mining For Online Haptic Perception

Efficient Spatio-Temporal Tactile Object Recognition With Randomized Tiling Convolutional Networks In A Hierarchical Fusion Strategy

End-to-End ConvNet for Tactile Recognition Using Residual Orthogonal Tiling and Pyramid Convolution Ensemble

An Extreme Learning Machine-Based Neuromorphic Tactile Sensing System for Texture Recognition

Braille letter reading: A benchmark for spatio-temporal pattern recognition on neuromorphic hardware

Real-Time EMG Signal Classification via Recurrent Neural Networks

Recurrent Aggregation Learning for Multi-View Echocardiographic Sequences Segmentation

Gradient adaptive sampling and multiple temporal scale 3D CNNs for tactile object recognition

Selective spatiotemporal features learning for dynamic gesture recognition

Spatiotemporal Recurrent Convolutional Networks for Recognizing Spontaneous Micro-expressions

LDS-FCM: A Linear Dynamical System Based Fuzzy C-Means Method for Tactile Recognition

What Matters for Active Texture Recognition With Vision-Based Tactile Sensors

Active Exploration for Real-Time Haptic Training

Lifelong Learning for Tactile Emotion Recognition

Event-Driven Visual-Tactile Sensing and Learning for Robots

G2T-SNN: Fusing Topological Graph and Gaussian Prior Spiking Neural Networks for Tactile Object Recognition

Dynamic Spatiotemporal Pattern Recognition with Recurrent Spiking Neural Network

Surface Texture Recognition by Deep Learning‐Enhanced Tactile Sensing

Deep Tactile Experience: Estimating Tactile Sensor Output from Depth Sensor Data

Simultaneous Velocity and Texture Classification from a Neuromorphic Tactile Sensor Using Spiking Neural Networks