Abstract:Robotic grasping is one of the key functions for realizing industrial automation and human-machine interaction. However, current robotic grasping methods for unknown objects mainly focus on generating the 6D grasp poses, which cannot obtain rich object pose information and are not robust in challenging scenes. Based on this, we propose a robotic continuous grasping system that achieves end-to-end robotic grasping of intra-class unknown objects in 3D space by accurate category-level 6D object pose estimation. Specifically, to achieve object pose estimation, first, we propose a global shape extraction network (GSENet) based on ResNet1D to extract the global shape of an object category from the 3D models of intra-class known objects. Then, with the global shape as the prior feature, we propose a transformer-guided network to reconstruct the shape of intra-class unknown object. The proposed network can effectively introduce internal and mutual communication between the prior feature, current feature, and their difference feature. The internal communication is performed by self-attention. The mutual communication is performed by cross-attention to strengthen their correlation. To achieve robotic grasping for multiple objects, we propose a low-computation and effective grasping strategy based on the pre-defined vector orientation, and develop a GUI for monitoring and control. Experiments on two benchmark datasets demonstrate that our system achieves state-of-the-art (SOTA) 6D pose estimation accuracy. Moreover, the real-world experiments show that our system also achieves superior robotic grasping performance, with a grasping success rate of 81.6$\%$ for multiple objects. Code and trained models are released at https://github.com/CNJianLiu/6D-CLGrasp

Robot Grasping Based on Stacked Object Classification Network and Grasping Order Planning

Robotic Grasping Method Based on 3D Vision for Stacked Rectangular Objects

A Cascaded Deep Learning Framework for Real-time and Robust Grasp Planning

A Multi-task Convolutional Neural Network for Autonomous Robotic Grasping in Object Stacking Scenes

A two-stage grasp detection method for sequential robotic grasping in stacking scenarios

A Semantic Robotic Grasping Framework Based on Multi-Task Learning in Stacking Scenes.

Gated Self Attention Network for Efficient Grasping of Target Objects in Stacked Scenarios

Grasping Pose Detection for Loose Stacked Object Based on Convolutional Neural Network with Multiple Self-Powered Sensors Information

Robotic Grasping in Multi-Object Stacking Scenes Based on Visual Reasoning

An Efficient and Stable Grasp Planning Method for Stacked Parts

Task-Oriented Grasping In Object Stacking Scenes With Crf-Based Semantic Model

Secure Grasping Detection of Objects in Stacked Scenes Based on Single-Frame RGB Images

Object Discovery and Grasp Detection with a Shared Convolutional Neural Network

Robotic Objects Detection and Grasping in Clutter Based on Cascaded Deep Convolutional Neural Network

Grasp for Stacking Via Deep Reinforcement Learning

A graph reasoning method for multi-object unordered stacking scenarios

A Robotic Semantic Grasping Method for Pick-and-place Tasks

Residual Squeeze-and-Excitation Network with Multi-scale Spatial Pyramid Module for Fast Robotic Grasping Detection

Robot Dynamic Object Positioning and Grasping Method Based on Two Stages

Prioritized Planning for Target-Oriented Manipulation via Hierarchical Stacking Relationship Prediction

Robotic Continuous Grasping System by Shape Transformer-Guided Multi-Object Category-Level 6D Pose Estimation