Slip detection for grasp stabilisation with a multi-fingered tactile robot hand

Jasper W. James,Nathan F. Lepora
DOI: https://doi.org/10.48550/arXiv.2010.01928
2020-10-05
Abstract:Tactile sensing is used by humans when grasping to prevent us dropping objects. One key facet of tactile sensing is slip detection, which allows a gripper to know when a grasp is failing and take action to prevent an object being dropped. This study demonstrates the slip detection capabilities of the recently developed Tactile Model O (T-MO) by using support vector machines to detect slip and test multiple slip scenarios including responding to the onset of slip in real time with eleven different objects in various grasps. We demonstrate the benefits of slip detection in grasping by testing two real-world scenarios: adding weight to destabilise a grasp and using slip detection to lift up objects at the first attempt. The T-MO is able to detect when an object is slipping, react to stabilise the grasp and be deployed in real-world scenarios. This shows the T-MO is a suitable platform for autonomous grasping by using reliable slip detection to ensure a stable grasp in unstructured environments. Supplementary video: <a class="link-external link-https" href="https://youtu.be/wOwFHaiHuKY" rel="external noopener nofollow">this https URL</a>
Robotics
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to use multi - fingered tactile robot hands (especially Tactile Model O, T - MO) for slip detection during grasping stability. Specifically, the research aims to demonstrate the ability of T - MO to detect object slips in various slip scenarios and take actions to prevent the object from falling. Slip is detected by using methods such as Support Vector Machines (SVM), and multiple slip scenarios are tested, including real - time response to the occurrence of slip and various grasping methods for different objects. ### Main problems 1. **Slip detection**: How to effectively detect whether an object starts to slip during the grasping process. 2. **Real - time response**: How to take immediate measures to stabilize the grasp after detecting slip. 3. **Practical application**: How to apply slip detection technology to grasping tasks in the real world, such as increasing weight to disrupt grasping stability or slip detection when attempting to grasp an object for the first time. ### Research background When humans grasp objects, they use tactile perception to prevent the objects from falling. Slip detection is a crucial aspect of tactile perception, which allows the gripper to take timely action when the grasp fails. However, expanding a single sensor to a multi - fingered robot hand faces many challenges, such as how to combine the control of a multi - degree - of - freedom hand with sensor feedback. ### Research methods - **Hardware**: Use the Tactile Model O (T - MO) hand, which integrates three TacTip optical bionic tactile sensors. - **Software**: Adopt simple and interpretable methods, such as Support Vector Machines (SVM) based on pin displacement features and Logistic Regression (LogReg), for slip detection. - **Experimental design**: - Test the slip detection ability of a single sensor. - Conduct slip detection experiments using multiple natural objects. - Deploy slip detectors in two application scenarios: increasing weight to disrupt grasping stability and slip detection when attempting to grasp an object for the first time. ### Conclusions The research shows that T - MO can detect object slips and react when the grasp is unstable, thus ensuring stable grasping in unstructured environments. This proves that the slip detection ability is a useful and robust indicator for evaluating grasping stability in laboratory and real - world test scenarios. Through these studies, the author demonstrates the potential of T - MO in autonomous grasping and provides a valuable reference for future research.