Abstract:To date, numerous tactile sensors and algorithms have been developed to tackle various perception problems. However, excessive endeavors are devoted to the multifarious definition, extraction, and analysis of hand-crafted features in order to improve perception accuracy. To address this problem, in this article, we designed a tactile finger containing four sensing elements (SE) to perceive both dynamic and static stimuli and meanwhile proposed a novel signal processing pipeline. The pipeline mainly consisted of time-series signals conversion, an automatic deep features extractor, and a shallow recognition model. When the tactile finger was applied to explore 16 surfaces based on a robotic platform, the four-channel signals were converted and concatenated into a time-frequency image via continuous wavelet transform (CWT). A deep feature extraction network was constructed based on a pretrained deep learning (DL) model, Resnet101, to extract the required features, which acted as high-level representations of the most discriminative components from the tactile images. Finally, these features were fed into a shallow machine learning (ML) model, i.e., extreme learning machine (ELM), achieving an accuracy as high as 92.38%. In such a manner, the powerful learning capability of DL models was transferred to the new recognition model directly while the tedious feature extraction procedures were alleviated. Besides, several relevant issues, such as the layer depth, the DL model type, and the shallow recognition model, are addressed and discussed to reveal their influences on performance.

Multi-IMF Sample Entropy Features with Machine Learning for Surface Texture Recognition Based on Robot Tactile Perception

Recognition of surface texture with wearable tactile sensor array: A pilot Study

Surface Texture Recognition by Deep Learning‐Enhanced Tactile Sensing

Texture Recognition Based on Perception Data from a Bionic Tactile Sensor

Recognition of Complex Surfaces Based on Multiscale Temporal Networks

Multimodal Surface Sensing Based on Hybrid Flexible Triboelectric and Piezoresistive Sensor.

Flexible Tactile Sensor Array for Slippage and Grooved Surface Recognition in Sliding Movement

Surface material recognition through haptic exploration using an intelligent contact sensing finger

Surface Recognition With a Tactile Finger Based on Automatic Features Transferred From Deep Learning

A flexible triboelectric tactile sensor for simultaneous material and texture recognition

Human-Touch-Inspired Material Recognition for Robotic Tactile Sensing

Multimodal Material Classification for Robots using Spectroscopy and High Resolution Texture Imaging

Surface texture recognition network based on flexible electronic skin

Object Recognition Using Tactile and Image Information.

Material Recognition Using Robotic Hand With Capacitive Tactile Sensor Array and Machine Learning

Fingerprint-inspired Biomimetic Tactile Sensors for the Surface Texture Recognition

Surface Material Recognition Using Active Multi-modal Extreme Learning Machine.

Magnetostrictive-based multimodal tactile sensors for object recognition

Texture recognition based on magnetostrictive tactile sensor array and convolutional neural network

Tactile Perception Object Recognition Based on an Improved Support Vector Machine

A robotic sensory system with high spatiotemporal resolution for texture recognition