Abstract:Manipulating fragile objects in environments such as homes and factories requires stable and gentle grasping along with precise and safe placement. Compared to traditional rigid grippers, the use of soft grippers reduces the control complexity and the risk of damaging objects. However, it is challenging to integrate camera-based optical tactile sensing into a soft gripper without compromising the flexibility and adaptability of the fingers, while also ensuring that the precision of tactile perception remains unaffected by passive deformations of the soft structure during object contact. In this paper, we demonstrate a modular soft two-fingered gripper with a 3D-printed optical tactile sensor (the TacTip) integrated in the palm. We propose a soft-grasping strategy that includes three functions: light contact detection, grasp pose adjustment and loss-of-contact detection, so that objects of different shapes and sizes can be grasped stably and placed precisely, which we test with both artificial and household objects. By sequentially implementing these three functions, the grasp success rate progressively improves from 45% without any functions, to 59% with light contact detection, 90% with grasp pose adjustment, and 97% with loss-of-contact detection, achieving a sub-millimeter placement precision. Overall, this work demonstrates the feasibility and utility of integrating optical tactile sensors into the palm of a soft gripper, of applicability to various types of soft manipulators. The proposed grasping strategy has potential applications in areas such as fragile product processing and home assistance.

Soft Tactile Sensing for Object Classification and Fine Grasping Adjustment Using a Pneumatic Hand With an Inflatable Palm

Adaptive Grasping of the Soft Prosthetic Hand Via Tactile Feedback

Precise In-Hand Manipulation of Soft Objects using Soft Fingertips with Tactile Sensing and Active Deformation

TacPalm: A Soft Gripper with a Biomimetic Optical Tactile Palm for Stable Precise Grasping

Development of Flexible Tactile Sensor for the Envelop of Curved Robotic Hand Finger in Grasping Force Sensing

Sensor Embedded Soft Fingertip for Precise Manipulation and Softness Recognition

A novel tactile palm for robotic object manipulation

A Novel Design of Soft Robotic Hand with a Human-inspired Soft Palm for Dexterous Grasping

Development of Robotic Hand Tactile Sensing System for Distributed Contact Force Sensing in Robotic Dexterous Multimodal Grasping

A Pneumatic Soft Gripper with Configurable Workspace and Self-sensing

Multijointed Pneumatic Soft Hand with Flexible Thenar

A soft robot tactile fingertip for grasping surface posture detection

Soft Fingertips with Tactile Sensing and Active Deformation for Robust Grasping of Delicate Objects

Design and Gesture Optimization of a Soft-Rigid Robotic Hand for Adaptive Grasping

Design of a 3D-Printed Soft Robotic Hand With Integrated Distributed Tactile Sensing

Design of a Soft Gripper With Improved Microfluidic Tactile Sensors for Classification of Deformable Objects

A tactile sensing system capable of recognizing objects based on bioinspired self-sensing soft pneumatic actuator

Tactile-Driven Gentle Grasping for Human-Robot Collaborative Tasks

A Dual-Modal Vision-Based Tactile Sensor for Robotic Hand Grasping.

Development of a Visual-Tactile Fingertip Sensor and an Object Manipulation Method using a Multi-Fingered Robotic Hand

Design and Experimental Research of Pneumatic Soft Humanoid Robot Hand