Abstract:Robotic grasping is one of the key functions for realizing industrial automation and human-machine interaction. However, current robotic grasping methods for unknown objects mainly focus on generating the 6D grasp poses, which cannot obtain rich object pose information and are not robust in challenging scenes. Based on this, we propose a robotic continuous grasping system that achieves end-to-end robotic grasping of intra-class unknown objects in 3D space by accurate category-level 6D object pose estimation. Specifically, to achieve object pose estimation, first, we propose a global shape extraction network (GSENet) based on ResNet1D to extract the global shape of an object category from the 3D models of intra-class known objects. Then, with the global shape as the prior feature, we propose a transformer-guided network to reconstruct the shape of intra-class unknown object. The proposed network can effectively introduce internal and mutual communication between the prior feature, current feature, and their difference feature. The internal communication is performed by self-attention. The mutual communication is performed by cross-attention to strengthen their correlation. To achieve robotic grasping for multiple objects, we propose a low-computation and effective grasping strategy based on the pre-defined vector orientation, and develop a GUI for monitoring and control. Experiments on two benchmark datasets demonstrate that our system achieves state-of-the-art (SOTA) 6D pose estimation accuracy. Moreover, the real-world experiments show that our system also achieves superior robotic grasping performance, with a grasping success rate of 81.6$\%$ for multiple objects. Code and trained models are released at https://github.com/CNJianLiu/6D-CLGrasp

MTGrasp: Multiscale 6-Dof Robotic Grasp Detection

Efficient Grasp Detection Network with Gaussian-Based Grasp Representation for Robotic Manipulation

Robotic Grasp Detection Network Based on Improved Deformable Convolution and Spatial Feature Center Mechanism

TransGrasp: A Multi-Scale Hierarchical Point Transformer for 7-Dof Grasp Detection

A Multi-Scale Grasp Detector Based on Fully Matching Model

High Precision 6-DoF Grasp Detection in Cluttered Scenes Based on Network Optimization and Pose Propagation

6-DoF Grasp Detection in Clutter with Enhanced Receptive Field and Graspable Balance Sampling

Rethinking 6-Dof Grasp Detection: A Flexible Framework for High-Quality Grasping

Residual Squeeze-and-Excitation Network with Multi-scale Spatial Pyramid Module for Fast Robotic Grasping Detection

Robotic Grasp Detection with 6-D Pose Estimation Based on Graph Convolution and Refinement

Hybrid Physical Metric for 6-Dof Grasp Pose Detection

Robotic Continuous Grasping System by Shape Transformer-Guided Multi-Object Category-Level 6D Pose Estimation

GoalGrasp: Grasping Goals in Partially Occluded Scenarios without Grasp Training

Real-Time Robotic Grasp Detection with Multi-Scale Feature Fusion

A Robot Grasping System With Single-Stage Anchor-Free Deep Grasp Detector

Interest Point Selection and Feature Extraction in Six-DoF Grasp Pose Detection

MonoGraspNet: 6-DoF Grasping with a Single RGB Image

A model-free 6-DOF grasp detection method based on point clouds of local sphere area

Robotic Grasp Detection Using Structure Prior Attention and Multiscale Features

A Multi-Scale Robotic Tool Grasping Method for Robot State Segmentation Masks

DSC-GraspNet: A Lightweight Convolutional Neural Network for Robotic Grasp Detection