Abstract:Robotic grasping is one of the key functions for realizing industrial automation and human-machine interaction. However, current robotic grasping methods for unknown objects mainly focus on generating the 6D grasp poses, which cannot obtain rich object pose information and are not robust in challenging scenes. Based on this, we propose a robotic continuous grasping system that achieves end-to-end robotic grasping of intra-class unknown objects in 3D space by accurate category-level 6D object pose estimation. Specifically, to achieve object pose estimation, first, we propose a global shape extraction network (GSENet) based on ResNet1D to extract the global shape of an object category from the 3D models of intra-class known objects. Then, with the global shape as the prior feature, we propose a transformer-guided network to reconstruct the shape of intra-class unknown object. The proposed network can effectively introduce internal and mutual communication between the prior feature, current feature, and their difference feature. The internal communication is performed by self-attention. The mutual communication is performed by cross-attention to strengthen their correlation. To achieve robotic grasping for multiple objects, we propose a low-computation and effective grasping strategy based on the pre-defined vector orientation, and develop a GUI for monitoring and control. Experiments on two benchmark datasets demonstrate that our system achieves state-of-the-art (SOTA) 6D pose estimation accuracy. Moreover, the real-world experiments show that our system also achieves superior robotic grasping performance, with a grasping success rate of 81.6$\%$ for multiple objects. Code and trained models are released at https://github.com/CNJianLiu/6D-CLGrasp

Single-Stage Grasping Algorithm for the Manipulator Based on Rotational Gaussian Encoding

Efficient Grasp Detection Network with Gaussian-Based Grasp Representation for Robotic Manipulation

A Robotic Semantic Grasping Method for Pick-and-place Tasks

Grasping Pose Estimation for Robots Based on Convolutional Neural Networks

A Practical Robotic Grasping Method by Using 6-D Pose Estimation With Protective Correction

Estimating Pose of Object and Manipulator Grasping Control

6D Pose Estimation with Combined Deep Learning and 3D Vision Techniques for a Fast and Accurate Object Grasping

Robotic Grasping With Multi-View Image Acquisition and Model-Based Pose Estimation

Robotic Continuous Grasping System by Shape Transformer-Guided Multi-Object Category-Level 6D Pose Estimation

Single-Camera Multi-View 6DoF pose estimation for robotic grasping

Robotic Continuous Grasping System by Shape Transformer-Guided Multiobject Category-Level 6-D Pose Estimation

A Robot Grasping System With Single-Stage Anchor-Free Deep Grasp Detector

EfficientGrasp: A Unified Data-Efficient Learning to Grasp Method for Multi-Fingered Robot Hands

A Real-Time Robotic Grasping Approach with Oriented Anchor Box

A Vision-based Robot Grasping System

Enhancement ofreal-timegrasp detection by cascaded deep convolutional neural networks

Grasp Detection Via Visual Rotation Object Detection and Point Cloud Spatial Feature Scoring

Robotic Arm Visual Grasping Algorithm and System Based on RGB-D Images

UPG: 3D Vision-Based Prediction Framework for Robotic Grasping in Multi-Object Scenes.

Robot Dynamic Object Positioning and Grasping Method Based on Two Stages

Robotic Grasping Technology Integrating Large Kernel Convolution and Residual Connections