Abstract:To date, numerous tactile sensors and algorithms have been developed to tackle various perception problems. However, excessive endeavors are devoted to the multifarious definition, extraction, and analysis of hand-crafted features in order to improve perception accuracy. To address this problem, in this article, we designed a tactile finger containing four sensing elements (SE) to perceive both dynamic and static stimuli and meanwhile proposed a novel signal processing pipeline. The pipeline mainly consisted of time-series signals conversion, an automatic deep features extractor, and a shallow recognition model. When the tactile finger was applied to explore 16 surfaces based on a robotic platform, the four-channel signals were converted and concatenated into a time-frequency image via continuous wavelet transform (CWT). A deep feature extraction network was constructed based on a pretrained deep learning (DL) model, Resnet101, to extract the required features, which acted as high-level representations of the most discriminative components from the tactile images. Finally, these features were fed into a shallow machine learning (ML) model, i.e., extreme learning machine (ELM), achieving an accuracy as high as 92.38%. In such a manner, the powerful learning capability of DL models was transferred to the new recognition model directly while the tedious feature extraction procedures were alleviated. Besides, several relevant issues, such as the layer depth, the DL model type, and the shallow recognition model, are addressed and discussed to reveal their influences on performance.

Convolutional Autoencoder for Feature Extraction in Tactile Sensing

Deep Tactile Experience: Estimating Tactile Sensor Output from Depth Sensor Data

End-to-End ConvNet for Tactile Recognition Using Residual Orthogonal Tiling and Pyramid Convolution Ensemble

DenseTact: Optical Tactile Sensor for Dense Shape Reconstruction

A Skin-Inspired PDMS Optical Tactile Sensor Driven by a Convolutional Neural Network

Design, Motivation and Evaluation of a Full-Resolution Optical Tactile Sensor

Learning Deep Features for Robotic Inference from Physical Interactions.

Using 3D Convolutional Neural Networks for Tactile Object Recognition with Robotic Palpation

Imagine2touch: Predictive Tactile Sensing for Robotic Manipulation using Efficient Low-Dimensional Signals

Evetac: An Event-Based Optical Tactile Sensor for Robotic Manipulation

Data-efficient Tactile Sensing with Electrical Impedance Tomography

Deep Visuo-Tactile Learning: Estimation of Tactile Properties from Images

DenseTact 2.0: Optical Tactile Sensor for Shape and Force Reconstruction

Towards vision-based robotic skins: a data-driven, multi-camera tactile sensor

CNN-based Methods for Object Recognition with High-Resolution Tactile Sensors

“Touching to See” and “Seeing to Feel”: Robotic Cross-modal Sensory Data Generation for Visual-Tactile Perception

A Vision-Based Tactile Sensing System for Multimodal Contact Information Perception via Neural Network

PseudoTouch: Efficiently Imaging the Surface Feel of Objects for Robotic Manipulation

Surface Recognition With a Tactile Finger Based on Automatic Features Transferred From Deep Learning

Sim-to-Real for High-Resolution Optical Tactile Sensing: From Images to Three-Dimensional Contact Force Distributions