Abstract:This paper addresses the challenge of robotic grasping of general objects. Similar to prior research, the task reads a single-view 3D observation (i.e., point clouds) captured by a depth camera as input. Crucially, the success of object grasping highly demands a comprehensive understanding of the shape of objects within the scene. However, single-view observations often suffer from occlusions (including both self and inter-object occlusions), which lead to gaps in the point clouds, especially in complex cluttered scenes. This renders incomplete perception of the object shape and frequently causes failures or inaccurate pose estimation during object grasping. In this paper, we tackle this issue with an effective albeit simple solution, namely completing grasping-related scene regions through local occupancy prediction. Following prior practice, the proposed model first runs by proposing a number of most likely grasp points in the scene. Around each grasp point, a module is designed to infer any voxel in its neighborhood to be either void or occupied by some object. Importantly, the occupancy map is inferred by fusing both local and global cues. We implement a multi-group tri-plane scheme for efficiently aggregating long-distance contextual information. The model further estimates 6-DoF grasp poses utilizing the local occupancy-enhanced object shape information and returns the top-ranked grasp proposal. Comprehensive experiments on both the large-scale GraspNet-1Billion benchmark and real robotic arm demonstrate that the proposed method can effectively complete the unobserved parts in cluttered and occluded scenes. Benefiting from the occupancy-enhanced feature, our model clearly outstrips other competing methods under various performance metrics such as grasping average precision.

6D Grasp Pose Detection in Cluttered Environment from a Single-view

S4G: Amodal Single-view Single-Shot SE(3) Grasp Detection in Cluttered Scenes

Point Pair Feature Based 6D Pose Estimation for Robotic Grasping

Robotic Grasping Method with 6D Pose Estimation and Point Cloud Fusion

High Precision 6-DoF Grasp Detection in Cluttered Scenes Based on Network Optimization and Pose Propagation

A model-free 6-DOF grasp detection method based on point clouds of local sphere area

Graspability-Aware Object Pose Estimation in Cluttered Scenes

Efficient and Robust Robotic Grasping in Cluttered Scenes: A Point Cloud-Based Approach with Heuristic Evaluation.

6D Hybrid Pose Estimation in Cluttered Industrial Scenes for Robotic Grasping

Grasp Region Exploration for 7-Dof Robotic Grasping in Cluttered Scenes

Single-Camera Multi-View 6DoF pose estimation for robotic grasping

6D Pose Estimation of Industrial Parts Based on Point Cloud Geometric Information Prediction for Robotic Grasping

A Robot Grasping System With Single-Stage Anchor-Free Deep Grasp Detector

RGB Matters: Learning 7-DoF Grasp Poses on Monocular RGBD Images

Local Occupancy-Enhanced Object Grasping with Multiple Triplanar Projection

6D Pose Estimation with Combined Deep Learning and 3D Vision Techniques for a Fast and Accurate Object Grasping

GPR: Grasp Pose Refinement Network for Cluttered Scenes

Simulating Complete Points Representations for Single-View 6-Dof Grasp Detection

A New Approach Based on Two-stream CNNs for Novel Objects Grasping in Clutter

A Practical Robotic Grasping Method by Using 6-D Pose Estimation With Protective Correction

Instance-Level Coarse-to-Fine High-Precision Grasping in Cluttered Environments