Abstract:Tactile sensing is inherently contact based. To use tactile data, robots need to make contact with the surface of an object. This is inefficient in applications where an agent needs to make a decision between multiple alternatives that depend the physical properties of the contact location. We propose a method to get tactile data in a non-invasive manner. The proposed method estimates the output of a tactile sensor from the depth data of the surface of the object based on past experiences. An experience dataset is built by allowing the robot to interact with various objects, collecting tactile data and the corresponding object surface depth data. We use the experience dataset to train a neural network to estimate the tactile output from depth data alone. We use GelSight tactile sensors, an image-based sensor, to generate images that capture detailed surface features at the contact location. We train a network with a dataset containing 578 tactile-image to depthmap correspondences. Given a depth-map of the surface of an object, the network outputs an estimate of the response of the tactile sensor, should it make a contact with the object. We evaluate the method with structural similarity index matrix (SSIM), a similarity metric between two images commonly used in image processing community. We present experimental results that show the proposed method outperforms a baseline that uses random images with statistical significance getting an SSIM score of 0.84 +/- 0.0056 and 0.80 +/- 0.0036, respectively.

Compressed Learning for Tactile Object Classification

Compressed Sensing for Scalable Robotic Tactile Skins

Adaptive Subsampling and Learned Model Improve Spatiotemporal Resolution of Tactile Skin

Soft-bubble: A highly compliant dense geometry tactile sensor for robot manipulation

Inter-finger Small Object Manipulation With DenseTact Optical Tactile Sensor

DenseTact: Optical Tactile Sensor for Dense Shape Reconstruction

Tactile-GAT: tactile graph attention networks for robot tactile perception classification

A Handheld Device for the In Situ Acquisition of Multimodal Tactile Sensing Data

Imagine2touch: Predictive Tactile Sensing for Robotic Manipulation using Efficient Low-Dimensional Signals

Classification of rigid and deformable objects using a novel tactile sensor

A multisensory-feedback tactile glove with dense coverage of sensing arrays for object recognition

Recent progress on tactile object recognition

Integrating High-Resolution Tactile Sensing into Grasp Stability Prediction

Deep Tactile Experience: Estimating Tactile Sensor Output from Depth Sensor Data

Simulation, Learning, and Application of Vision-Based Tactile Sensing at Large Scale

Learning to Detect Slip with Barometric Tactile Sensors and a Temporal Convolutional Neural Network

High-resolution, High-Speed and Low-Cost Flexible Tactile Sensor Array System

Going In Blind: Object Motion Classification using Distributed Tactile Sensing for Safe Reaching in Clutter

Object Recognition Using Tactile Measurements: Kernel Sparse Coding Methods

DexTouch: Learning to Seek and Manipulate Objects with Tactile Dexterity

CNN-based Methods for Object Recognition with High-Resolution Tactile Sensors