Abstract:Robotic grasping is one of the key functions for realizing industrial automation and human-machine interaction. However, current robotic grasping methods for unknown objects mainly focus on generating the 6D grasp poses, which cannot obtain rich object pose information and are not robust in challenging scenes. Based on this, we propose a robotic continuous grasping system that achieves end-to-end robotic grasping of intra-class unknown objects in 3D space by accurate category-level 6D object pose estimation. Specifically, to achieve object pose estimation, first, we propose a global shape extraction network (GSENet) based on ResNet1D to extract the global shape of an object category from the 3D models of intra-class known objects. Then, with the global shape as the prior feature, we propose a transformer-guided network to reconstruct the shape of intra-class unknown object. The proposed network can effectively introduce internal and mutual communication between the prior feature, current feature, and their difference feature. The internal communication is performed by self-attention. The mutual communication is performed by cross-attention to strengthen their correlation. To achieve robotic grasping for multiple objects, we propose a low-computation and effective grasping strategy based on the pre-defined vector orientation, and develop a GUI for monitoring and control. Experiments on two benchmark datasets demonstrate that our system achieves state-of-the-art (SOTA) 6D pose estimation accuracy. Moreover, the real-world experiments show that our system also achieves superior robotic grasping performance, with a grasping success rate of 81.6$\%$ for multiple objects. Code and trained models are released at https://github.com/CNJianLiu/6D-CLGrasp

6D Hybrid Pose Estimation in Cluttered Industrial Scenes for Robotic Grasping

6D Pose Estimation of Industrial Parts Based on Point Cloud Geometric Information Prediction for Robotic Grasping

6D Pose Estimation Method of Metal Parts for Robotic Grasping Based on Semantic-Level Line Matching

A Geometry-Enhanced 6D Pose Estimation Network with Incomplete Shape Recovery for Industrial Parts

Deep instance segmentation and 6D object pose estimation in cluttered scenes for robotic autonomous grasping

6D Pose Estimation for Texture-Less Industrial Parts in the Crowd

Instance segmentation based 6D pose estimation of industrial objects using point clouds for robotic bin-picking

A Practical Robotic Grasping Method by Using 6-D Pose Estimation With Protective Correction

A Depth Adaptive Feature Extraction and Dense Prediction Network for 6-D Pose Estimation in Robotic Grasping

6D Grasp Pose Detection in Cluttered Environment from a Single-view

Efficient Encoding and Aligning Viewpoints for 6D Pose Estimation of Unseen Industrial Parts

Robotic Grasp Detection with 6-D Pose Estimation Based on Graph Convolution and Refinement

Robotic Grasping Method with 6D Pose Estimation and Point Cloud Fusion

Robotic Continuous Grasping System by Shape Transformer-Guided Multi-Object Category-Level 6D Pose Estimation

A Novel Deep Learning-Based Pose Estimation Method for Robotic Grasping of Axisymmetric Bodies in Industrial Stacked Scenarios

Estimating 6D Object Poses with Temporal Motion Reasoning for Robot Grasping in Cluttered Scenes

Point Pair Feature Based 6D Pose Estimation for Robotic Grasping

Sparse Convolution Based 6D Pose Estimation for Robotic Bin-Picking with Point Clouds

Grasping Pose Estimation for Robots Based on Convolutional Neural Networks

High-Precision Pose Estimation Method of the 3C Parts by Combining 2D and 3D Vision for Robotic Grasping in Assembly Applications.

Detect in RGB, Optimize in Edge: Accurate 6D Pose Estimation for Texture-less Industrial Parts