Abstract:Robotic grasping is one of the key functions for realizing industrial automation and human-machine interaction. However, current robotic grasping methods for unknown objects mainly focus on generating the 6D grasp poses, which cannot obtain rich object pose information and are not robust in challenging scenes. Based on this, we propose a robotic continuous grasping system that achieves end-to-end robotic grasping of intra-class unknown objects in 3D space by accurate category-level 6D object pose estimation. Specifically, to achieve object pose estimation, first, we propose a global shape extraction network (GSENet) based on ResNet1D to extract the global shape of an object category from the 3D models of intra-class known objects. Then, with the global shape as the prior feature, we propose a transformer-guided network to reconstruct the shape of intra-class unknown object. The proposed network can effectively introduce internal and mutual communication between the prior feature, current feature, and their difference feature. The internal communication is performed by self-attention. The mutual communication is performed by cross-attention to strengthen their correlation. To achieve robotic grasping for multiple objects, we propose a low-computation and effective grasping strategy based on the pre-defined vector orientation, and develop a GUI for monitoring and control. Experiments on two benchmark datasets demonstrate that our system achieves state-of-the-art (SOTA) 6D pose estimation accuracy. Moreover, the real-world experiments show that our system also achieves superior robotic grasping performance, with a grasping success rate of 81.6$\%$ for multiple objects. Code and trained models are released at https://github.com/CNJianLiu/6D-CLGrasp

Grasping pose estimation for SCARA robot based on deep learning of point cloud

Simulation and Deep Learning on Point Clouds for Robot Grasping

A grasping posture estimation method based on 3D detection network

Object Pose Estimation with Point Cloud Data for Robot Grasping

6D Pose Estimation of Industrial Parts Based on Point Cloud Geometric Information Prediction for Robotic Grasping

A Practical Robotic Grasping Method by Using 6-D Pose Estimation With Protective Correction

A Robotic Semantic Grasping Method for Pick-and-place Tasks

Two-stage Grasp Detection Method for Robotics Using Point Clouds and Deep Hierarchical Feature Learning Network

6D Pose Estimation with Combined Deep Learning and 3D Vision Techniques for a Fast and Accurate Object Grasping

Robotic Grasping With Multi-View Image Acquisition and Model-Based Pose Estimation

3D Object Recognition Based on PointNet and Sparse Point Cloud

Efficient and Robust Robotic Grasping in Cluttered Scenes: A Point Cloud-Based Approach with Heuristic Evaluation.

Deep instance segmentation and 6D object pose estimation in cluttered scenes for robotic autonomous grasping

Instance segmentation based 6D pose estimation of industrial objects using point clouds for robotic bin-picking

Single-Camera Multi-View 6DoF pose estimation for robotic grasping

Research on Intelligent Robot Point Cloud Grasping in Internet of Things

REGNet V2: End-to-End REgion-based Grasp Detection Network for Grippers of Different Sizes in Point Clouds

Robotic Continuous Grasping System by Shape Transformer-Guided Multi-Object Category-Level 6D Pose Estimation

A Vision-based Robot Grasping System

Instance-level 6D pose estimation based on multi-task parameter sharing for robotic grasping

A Novel Deep Learning-Based Pose Estimation Method for Robotic Grasping of Axisymmetric Bodies in Industrial Stacked Scenarios