Abstract:Tactile sensing for robotics is achieved through a variety of mechanisms, including magnetic, optical-tactile, and conductive fluid. Currently, the fluid-based sensors have struck the right balance of anthropomorphic sizes and shapes and accuracy of tactile response measurement. However, this design is plagued by a low Signal to Noise Ratio (SNR) due to the fluid based sensing mechanism “damping” the measurement values that are hard to model. To this end, we present a spatio-temporal gradient representation on the data obtained from fluid-based tactile sensors, which is inspired from neuromorphic principles of event based sensing. We present a novel algorithm (GradTac) that converts discrete data points from spatial tactile sensors into spatio-temporal surfaces and tracks tactile contours across these surfaces. Processing the tactile data using the proposed spatio-temporal domain is robust, makes it less susceptible to the inherent noise from the fluid based sensors, and allows accurate tracking of regions of touch as compared to using the raw data. We successfully evaluate and demonstrate the efficacy of GradTac on many real-world experiments performed using the Shadow Dexterous Hand, equipped with the BioTac SP sensors. Specifically, we use it for tracking tactile input across the sensor’s surface, measuring relative forces, detecting linear and rotational slip, and for edge tracking. We also release an accompanying task-agnostic dataset for the BioTac SP, which we hope will provide a resource to compare and quantify various novel approaches, and motivate further research.

Interpreting and Predicting Tactile Signals for the SynTouch BioTac

Dexterous Manoeuvre Through Touch in a Cluttered Scene

Optimizing BioTac Simulation for Realistic Tactile Perception

Robust Learning of Tactile Force Estimation through Robot Interaction

GradTac: Spatio-Temporal Gradient Based Tactile Sensing

Use of tactile feedback to control exploratory movements to characterize object compliance

Transferring Tactile Data Across Sensors

Embedding high-resolution touch across robotic hands enables adaptive human-like grasping

Progress on Flexible Tactile Sensors in Robotic Applications on Objects Properties Recognition, Manipulation and Human-Machine Interactions

FingerTac -- An Interchangeable and Wearable Tactile Sensor for the Fingertips of Human and Robot Hands

Organization and Understanding of a Tactile Information Dataset TacAct During Physical Human-Robot Interactions

DenseTact 2.0: Optical Tactile Sensor for Shape and Force Reconstruction

Deep Tactile Experience: Estimating Tactile Sensor Output from Depth Sensor Data

9DTact: A Compact Vision-Based Tactile Sensor for Accurate 3D Shape Reconstruction and Generalizable 6D Force Estimation

Acquisition and Prediction of High-Density Tactile Field Data for Rigid and Flexible Objects

Displaying Sensed Tactile Cues with a Fingertip Haptic Device

ACROSS: A Deformation-Based Cross-Modal Representation for Robotic Tactile Perception

Organization and Understanding of a Tactile Information Dataset TacAct For Physical Human-Robot Interaction

Simulation, Learning, and Application of Vision-Based Tactile Sensing at Large Scale

GTac: A Biomimetic Tactile Sensor With Skin-Like Heterogeneous Force Feedback for Robots

ConTac: Continuum-Emulated Soft Skinned Arm with Vision-based Shape Sensing and Contact-aware Manipulation