Abstract:Generating model-free grasps in complex scattered scenes remains a challenging task. Most current methods adopt PointNet++ as the backbone to extract structural features, while the relative associations of geometry are underexplored, leading to non-optimal grasp prediction results. In this work, a parallelized graph-based pipeline is developed to solve the 7-DoF grasp pose generation problem with point cloud as input. Using the non-textured information of the grasping scene, the proposed pipeline simultaneously performs feature embedding and grasping location focusing in two branches, avoiding the mutual influence of the two learning processes. In the feature learning branch, the geometric features of the whole scene will be fully learned. In the location focusing branch, the high-value grasping locations on the surface of objects will be strategically selected. Using the learned graph features at these locations, the pipeline will eventually output refined grasping directions and widths in conjunction with local spatial features. To strengthen the positional features in the grasping problem, a graph convolution operator based on the positional attention mechanism is designed, and a graph residual network based on this operator is applied in two branches. The above pipeline abstracts the grasping location selection task from the main process of grasp generation, which lowers the learning difficulty while avoiding the performance degradation problem of deep graph networks. The established pipeline is evaluated on the GraspNet-1Billion dataset, demonstrating much better performance and stronger generalization capabilities than the benchmark approach. In robotic bin-picking experiments, the proposed method can effectively understand scattered grasping scenarios and grasp multiple types of unknown objects with a high success rate.

A Parallel Graph Network for Generating 7-Dof Model-Free Grasps in Unstructured Scenes Using Point Cloud

GraNet: A Multi-Level Graph Network for 6-DoF Grasp Pose Generation in Cluttered Scenes

A Cascaded Deep Learning Framework for Real-time and Robust Grasp Planning

PointNet++ Grasping: Learning an End-to-end Spatial Grasp Generation Algorithm from Sparse Point Clouds

A model-free 6-DOF grasp detection method based on point clouds of local sphere area

Efficient Grasp Detection Network with Gaussian-Based Grasp Representation for Robotic Manipulation

Grasp Region Exploration for 7-Dof Robotic Grasping in Cluttered Scenes

Simulation and Deep Learning on Point Clouds for Robot Grasping

High Precision 6-DoF Grasp Detection in Cluttered Scenes Based on Network Optimization and Pose Propagation

Single-View Scene Point Cloud Human Grasp Generation

Learning an End-to-end Spatial Grasp Generation and Refinement Algorithm from Simulation

TransGrasp: A Multi-Scale Hierarchical Point Transformer for 7-Dof Grasp Detection

SUGrasping: a Semantic Grasping Framework Based on Multi-Head 3D U-Net

Efficient and Robust Robotic Grasping in Cluttered Scenes: A Point Cloud-Based Approach with Heuristic Evaluation.

PointNetGPD: Detecting Grasp Configurations from Point Sets

UPG: 3D Vision-Based Prediction Framework for Robotic Grasping in Multi-Object Scenes.

Grasp Proposal Networks: An End-to-End Solution for Visual Learning of Robotic Grasps

Efficient Heatmap-Guided 6-Dof Grasp Detection in Cluttered Scenes

Edge Grasp Network: A Graph-Based SE(3)-invariant Approach to Grasp Detection

Two-stage Grasp Detection Method for Robotics Using Point Clouds and Deep Hierarchical Feature Learning Network