Abstract:Most supervised learning-based pose estimation methods for stacked scenes are trained on massive synthetic datasets. In most cases, the challenge is that the learned network on the training dataset is no longer optimal on the testing dataset. To address this problem, we propose a pose regression network PPR-Net++. It transforms each scene point into a point in the centroid space, followed by a clustering process and a voting process. In the training phase, a mapping function between the network's critical parameter (i.e., the bandwidth of the clustering algorithm) and the compactness of the centroid distributions is obtained. This function is used to adapt the bandwidth between centroid distributions of two different domains. In addition, to further improve the pose estimation accuracy, the network also predicts the confidence of each point, based on its visibility and pose error. Only the points with high confidence have the right to vote for the final object pose. In experiments, our method is trained on the IPA synthetic dataset and compared with the state-of-the-art algorithm. When tested with the public synthetic Siléane dataset, our method is better in all eight objects, where five of them are improved by more than 5% in average precision (AP). On IPA real dataset, our method outperforms a large margin by 20%. This lays a solid foundation for robot grasping in industrial scenarios. Note to Practitioners—Our work is motivated by industrial product assembly based on robot grasping. The industrial parts are usually manufactured by numerical machines and piled in bins. Our method can estimate the poses of visible parts accurately. A pose of a part includes its centroid and spatial orientations. Combined with a depth camera, this algorithm allows an industrial robot to understand complex stacked scenes. We improve the pose estimation-accuracy in order to assemble parts with robot grasping, without an additional pose adjuster. Our network can learn from a synthetic dataset and apply it to real-world data, without a significant accuracy drop. The synthetic dataset can be obtained easily by computer simulation programs, so the training data are sufficient. Experiments demonstrate that our method outperforms the state-of-the-art pose estimation approaches.

A graph reasoning method for multi-object unordered stacking scenarios

A two-stage grasp detection method for sequential robotic grasping in stacking scenarios

A Multi-task Convolutional Neural Network for Autonomous Robotic Grasping in Object Stacking Scenes

Secure Grasping Detection of Objects in Stacked Scenes Based on Single-Frame RGB Images

Prioritized Planning for Target-Oriented Manipulation via Hierarchical Stacking Relationship Prediction

Object Discovery and Grasp Detection with a Shared Convolutional Neural Network

NG-Net: No-Grasp annotation grasp detection network for stacked scenes

Learning to Infer Unseen Single-/ Multi-Attribute-Object Compositions with Graph Networks.

Towards One Shot & Pick All: 3D-OAS, an end-to-end framework for vision guided top-down parcel bin-picking using 3D-overlapping-aware instance segmentation and GNN

A stacked graph neural network with self-exciting process for robotic cognitive strategy reasoning in proactive human-robot collaborative assembly

Hierarchical Reasoning Network for Human-Object Interaction Detection

Probabilistic Graph Based Spatial Assembly Relation Inference for Programming of Assembly Task by Demonstration.

A Graph-Based Deep Reinforcement Learning Approach to Grasping Fully Occluded Objects

Instance-Level Relative Saliency Ranking with Graph Reasoning

GraNet: A Multi-Level Graph Network for 6-DoF Grasp Pose Generation in Cluttered Scenes

Antipodal-Points-aware Dual-decoding Network for Robotic Visual Grasp Detection Oriented to Multi-object Clutter Scenes

PPR-Net++: Accurate 6-D Pose Estimation in Stacked Scenarios

Learning Class-Based Graph Representation for Object Detection.

A grasping posture estimation method based on 3D detection network

A neural learning approach for simultaneous object detection and grasp detection in cluttered scenes

LiDAR-based 3D Video Object Detection with Foreground Context Modeling and Spatiotemporal Graph Reasoning