Abstract:Robotic grasping is one of the key functions for realizing industrial automation and human-machine interaction. However, current robotic grasping methods for unknown objects mainly focus on generating the 6D grasp poses, which cannot obtain rich object pose information and are not robust in challenging scenes. Based on this, we propose a robotic continuous grasping system that achieves end-to-end robotic grasping of intra-class unknown objects in 3D space by accurate category-level 6D object pose estimation. Specifically, to achieve object pose estimation, first, we propose a global shape extraction network (GSENet) based on ResNet1D to extract the global shape of an object category from the 3D models of intra-class known objects. Then, with the global shape as the prior feature, we propose a transformer-guided network to reconstruct the shape of intra-class unknown object. The proposed network can effectively introduce internal and mutual communication between the prior feature, current feature, and their difference feature. The internal communication is performed by self-attention. The mutual communication is performed by cross-attention to strengthen their correlation. To achieve robotic grasping for multiple objects, we propose a low-computation and effective grasping strategy based on the pre-defined vector orientation, and develop a GUI for monitoring and control. Experiments on two benchmark datasets demonstrate that our system achieves state-of-the-art (SOTA) 6D pose estimation accuracy. Moreover, the real-world experiments show that our system also achieves superior robotic grasping performance, with a grasping success rate of 81.6$\%$ for multiple objects. Code and trained models are released at https://github.com/CNJianLiu/6D-CLGrasp

Counting Objects in a Robotic Hand

Unknown Objects Grasp Planning Using Force/Torque Measurements

Grasp Multiple Objects With One Hand

A Robotic Semantic Grasping Method for Pick-and-place Tasks

Robotic Continuous Grasping System by Shape Transformer-Guided Multi-Object Category-Level 6D Pose Estimation

Deep Reinforcement Learning-Based Robotic Grasping in Clutter and Occlusion

Multifingered Grasping Based on Multimodal Reinforcement Learning

Exploiting Kinematic Redundancy for Robotic Grasping of Multiple Objects

Inter-finger Small Object Manipulation With DenseTact Optical Tactile Sensor

A Surprisingly Efficient Representation for Multi-Finger Grasping

Simple Kinesthetic Haptics for Object Recognition

Robotic Grasping Method Based on 3D Vision for Stacked Rectangular Objects

Object Classification and Grasp Planning Using Visual and Tactile Sensing

Grasping Pose Estimation for Robots Based on Convolutional Neural Networks

Predict Robot Grasp Outcomes Based On Multi-Modal Information

Multi-fingered Robotic Hand Grasping in Cluttered Environments through Hand-object Contact Semantic Mapping

Robust grasping across diverse sensor qualities: The GraspNet-1Billion dataset

Category-Association Based Similarity Matching for Novel Object Pick-and-Place Task

A Practical Robotic Grasping Method by Using 6-D Pose Estimation With Protective Correction

Robotic grasping using visual and tactile sensing

Single-Grasp Deformable Object Discrimination: The Effect of Gripper Morphology, Sensing Modalities, and Action Parameters