Abstract:Tactile sensing is an important perception mode for robots, but the existing tactile technologies have multiple limitations. What kind of tactile information robots need, and how to use the information, remain open questions. We believe a soft sensor surface and high-resolution sensing of geometry should be important components of a competent tactile sensor. In this paper, we discuss the development of a vision-based optical tactile sensor, GelSight. Unlike the traditional tactile sensors which measure contact force, GelSight basically measures geometry, with very high spatial resolution. The sensor has a contact surface of soft elastomer, and it directly measures its deformation, both vertical and lateral, which corresponds to the exact object shape and the tension on the contact surface. The contact force, and slip can be inferred from the sensor's deformation as well. Particularly, we focus on the hardware and software that support GelSight's application on robot hands. This paper reviews the development of GelSight, with the emphasis in the sensing principle and sensor design. We introduce the design of the sensor's optical system, the algorithm for shape, force and slip measurement, and the hardware designs and fabrication of different sensor versions. We also show the experimental evaluation on the GelSight's performance on geometry and force measurement. With the high-resolution measurement of shape and contact force, the sensor has successfully assisted multiple robotic tasks, including material perception or recognition and in-hand localization for robot manipulation.

Robot Tactile Sensing: Vision Based Tactile Sensor for Force Perception

Progress on Flexible Tactile Sensors in Robotic Applications on Objects Properties Recognition, Manipulation and Human-Machine Interactions

Development of Flexible Tactile Sensor for the Envelop of Curved Robotic Hand Finger in Grasping Force Sensing

A novel tactile sensor with multimodal vision and tactile units for multifunctional robot interaction

A Dual-Modal Vision-Based Tactile Sensor for Robotic Hand Grasping.

A Multifunctional Tactile Sensory System for Robotic Intelligent Identification and Manipulation Perception

Development of Robotic Hand Tactile Sensing System for Distributed Contact Force Sensing in Robotic Dexterous Multimodal Grasping

DelTact: A Vision-based Tactile Sensor Using Dense Color Pattern

Flexible Tactile Sensor Array for Distributed Tactile Sensing and Slip Detection in Robotic Hand Grasping

A soft thumb-sized vision-based sensor with accurate all-round force perception

Development of Soft Tactile Sensor for Force Measurement and Position Detection

9DTact: A Compact Vision-Based Tactile Sensor for Accurate 3D Shape Reconstruction and Generalizable 6D Force Estimation

A Cross-Modal Tactile Sensor Design for Measuring Robotic Grasping Forces

A High-Resolution, Ultrabroad-Range and Sensitive Capacitive Tactile Sensor Based on a CNT/PDMS Composite for Robotic Hands.

Finger‐Skin‐Inspired Flexible Optical Sensor for Force Sensing and Slip Detection in Robotic Grasping

Towards vision-based robotic skins: a data-driven, multi-camera tactile sensor

GelSight: High-Resolution Robot Tactile Sensors for Estimating Geometry and Force

DotView: A Low-Cost Compact Tactile Sensor for Pressure, Shear, and Torsion Estimation

Large-Area and Low-Cost Force/Tactile Capacitive Sensor for Soft Robotic Applications

Visual Tactile Sensor Based Force Estimation for Position-Force Teleoperation

Force/Tactile Sensors Based on Optoelectronic Technology for Manipulation and Physical Human–Robot Interaction