Abstract:Incipient slip detection is important for manipulators to achieve stable grasping. In order to make manipulators adapted to unstructured environments better and realize a wider range of applications, it is necessary to achieve incipient slip detection with robustness to object surface properties. In this article, we propose a novel incipient slip detection method with the vision-based tactile sensor. The method only uses sensor deformation data and does not need any information about the grasped object. In addition, it has the advantages of intuitive principles and a wide range of applicable working conditions. In this article, the local deformation degree of the sensor is proved to be related to the stick/slip state at the corresponding location by kinematic aspects. Based on this, a method is proposed to select reference points in the stick region with local deformation degrees. These reference points are used to fit the rigid motion of the contacted object and the slip field. Furthermore, an iterative algorithm is proposed to delineate the stick/slip region based on the characteristic of the slip field. Afterward, complex contact conditions are constructed through finite-element simulation. Curved surfaces, discontinuous surfaces, and surfaces with multiple friction coefficients distribution are used to verify the correctness and superiority of the proposed method compared to other methods. Finally, the slip detection experimental bench is built, and our self-developed vision-based sensor is used to contact common objects with complex surface properties. Through the real slip detection experiments, the adaptability and good application prospects of this method are demonstrated.

Generalized Visual-Tactile Transformer Network for Slip Detection

Visuo-Tactile-Based Slip Detection Using A Multi-Scale Temporal Convolution Network

Slip Detection through Fusion of Visual-Tactile Data using Swin Transformer V2

Slip Detection with Combined Tactile and Visual Information

Robotic Slip Detection with Visual-Tactile Fusion Based on 3D Attention Mechanism

Learning to Detect Slip with Barometric Tactile Sensors and a Temporal Convolutional Neural Network

Vahagn: VisuAl Haptic Attention Gate Net for slip detection

Learning to Detect Slip through Tactile Estimation of the Contact Force Field and its Entropy

Incipient Slip Detection Method for Soft Objects with Vision-Based Tactile Sensor

Grasp State Assessment of Deformable Objects Using Visual-Tactile Fusion Perception

Learning to Predict Friction and Classify Contact States by Tactile Sensor

Slip Detection in Prosthetic Hand Grasping by Using the Discrete Wavelet Transform Analysis

Learning To Detect Slip For Stable Grasping

A Robust Incipient Slip Detection Method with Vision-Based Tactile Sensor Based on Local Deformation Degree

Flexible Tactile Sensor Array for Distributed Tactile Sensing and Slip Detection in Robotic Hand Grasping

Slip Detection: Analysis and Calibration of Univariate Tactile Signals

Robust Learning-Based Incipient Slip Detection using the PapillArray Optical Tactile Sensor for Improved Robotic Gripping

Under Pressure: Learning to Detect Slip with Barometric Tactile Sensors

Visual-tactile Fusion for Transparent Object Grasping in Complex Backgrounds

Deep Visuo-Tactile Learning: Estimation of Tactile Properties from Images

Learned Slip-Detection-Severity Framework using Tactile Deformation Field Feedback for Robotic Manipulation