Abstract:Robotic grasping is one of the key functions for realizing industrial automation and human-machine interaction. However, current robotic grasping methods for unknown objects mainly focus on generating the 6D grasp poses, which cannot obtain rich object pose information and are not robust in challenging scenes. Based on this, we propose a robotic continuous grasping system that achieves end-to-end robotic grasping of intra-class unknown objects in 3D space by accurate category-level 6D object pose estimation. Specifically, to achieve object pose estimation, first, we propose a global shape extraction network (GSENet) based on ResNet1D to extract the global shape of an object category from the 3D models of intra-class known objects. Then, with the global shape as the prior feature, we propose a transformer-guided network to reconstruct the shape of intra-class unknown object. The proposed network can effectively introduce internal and mutual communication between the prior feature, current feature, and their difference feature. The internal communication is performed by self-attention. The mutual communication is performed by cross-attention to strengthen their correlation. To achieve robotic grasping for multiple objects, we propose a low-computation and effective grasping strategy based on the pre-defined vector orientation, and develop a GUI for monitoring and control. Experiments on two benchmark datasets demonstrate that our system achieves state-of-the-art (SOTA) 6D pose estimation accuracy. Moreover, the real-world experiments show that our system also achieves superior robotic grasping performance, with a grasping success rate of 81.6$\%$ for multiple objects. Code and trained models are released at https://github.com/CNJianLiu/6D-CLGrasp

Object Shape Recognition And Grasping By Five-Fingered Robotic Hand Based On E-Anfis Model

Unknown Objects Grasp Planning Using Force/Torque Measurements

Adaptive Grasping of the Soft Prosthetic Hand Via Tactile Feedback

A Robotic Semantic Grasping Method for Pick-and-place Tasks

Recognition of the Three-Dimensional Shape of Objects Grasped for Pesa Multi-Fingered Robot Hand

Grasping Unknown Objects Based on 3d Model Reconstruction

Learning to Grasp Familiar Objects Based on Experience

Sliding Touch-based Exploration for Modeling Unknown Object Shape with Multi-fingered Hands

Design and Evaluation of Anthropomorphic Robotic Hand for Object Grasping and Shape Recognition

Robotic Grasping With Multi-View Image Acquisition and Model-Based Pose Estimation

Vision-based Automatic Control of a 5-Fingered Assistive Robotic Manipulator for Activities of Daily Living.

Intelligent Grasping of an Underactuated Hand for Space Robots

Robotic Grasping Method with 6D Pose Estimation and Point Cloud Fusion

Design of a Tactile Sensing Robotic Gripper and Its Grasping Method

3-D Object Reconstruction Using Tactile Sensing for Multi-fingered Hand

Semi-Autonomous Grasping Control of Prosthetic Hand and Wrist Based on Motion Prior Field

Robotic Continuous Grasping System by Shape Transformer-Guided Multi-Object Category-Level 6D Pose Estimation

Multi-fingered Dynamic Grasping for Unknown Objects

Haptic Perception Of Unknown Object By Robot Hand: Exploration Strategy And Recognition Approach

Research on Adaptive Grasping with Object Pose Uncertainty by Multi-Fingered Robot Hand

Robotic Grasping Technology Integrating Large Kernel Convolution and Residual Connections