Weight Imprinting Classification-Based Force Grasping with a Variable-Stiffness Robotic Gripper
Haiyue Zhu,Xiong Li,Wenjie Chen,Xiaocong Li,Jun Ma,Chek Sing Teo,Tat Joo Teo,Wei Lin
DOI: https://doi.org/10.1109/tase.2021.3054655
IF: 6.636
2022-01-01
IEEE Transactions on Automation Science and Engineering
Abstract:Universal grasping for a diverse range of objects is a challenging problem in robotics, especially in the presence of mixed properties with fragile/rigid and heavy/light. Toward universal grasping, this article presents a practical and systematic grasping control framework that enables a variable stiffness gripper to handle the objects with diverse properties using a category-aware force regulation approach, termed classification-based force grasping. Under this framework, a convolutional neural network (CNN) is employed to classify the category of the grasping object, and a grasping force is determined based on the classified category through a database that records a predefined force magnitude per category. Sequentially, the gripper can be adjusted to a force-optimized stiffness, which facilitates the achievement of an accurate grasping force regulation in a large range. Technically, two novel enabling modules are developed for grasping classification and execution, respectively. First, a novel weight imprinting technique based on center-guided feature embedding is proposed for object classification. It enables the CNN to efficiently handle novel object categories using only a few samples even without retraining/fine-tuning. Second, a vision-based grasping force sensing module is developed, which takes advantage of the specifically designed variable-stiffness gripper. Its grasping force can be estimated from the deflection angle of finger flexure by the vision so that the contact force can be sensed and regulated. Remarkably, only single-source vision information is needed for both of the above modules without any additional force sensor. Experiments are conducted extensively to evaluate the performance of the proposed force grasping approach. Note to Practitioners—Robotic grasping often needs to handle novel categories of objects. As a result, frequent retraining of the classification neural network is a pain point, which is tedious and prone to overfitting with only a few samples. In this work, metric learning is introduced for grasping classification where a novel kind of weight imprinting classification is proposed to handle the novel classes by better feature embedding and directly setting the classifier weights without retraining or fine-tuning. Together with the benefits from the variable stiffness feature of the gripper, the proposed vision-based force grasping approach can handle a wide range of objects from fragile to heavy, and the grasping force is controllable from 0.2 N onward to the motor limitation. The controllable grasping force resolution of the proposed vision grasping is better than 0.05 N, the accuracy of the grasping force is evaluated from 0.2 to 12 N, and the evaluated grasping objects are from extremely fragile potato chips and eggshell to heavy flange and metal block.