Abstract:Most supervised learning-based pose estimation methods for stacked scenes are trained on massive synthetic datasets. In most cases, the challenge is that the learned network on the training dataset is no longer optimal on the testing dataset. To address this problem, we propose a pose regression network PPR-Net++. It transforms each scene point into a point in the centroid space, followed by a clustering process and a voting process. In the training phase, a mapping function between the network's critical parameter (i.e., the bandwidth of the clustering algorithm) and the compactness of the centroid distributions is obtained. This function is used to adapt the bandwidth between centroid distributions of two different domains. In addition, to further improve the pose estimation accuracy, the network also predicts the confidence of each point, based on its visibility and pose error. Only the points with high confidence have the right to vote for the final object pose. In experiments, our method is trained on the IPA synthetic dataset and compared with the state-of-the-art algorithm. When tested with the public synthetic Siléane dataset, our method is better in all eight objects, where five of them are improved by more than 5% in average precision (AP). On IPA real dataset, our method outperforms a large margin by 20%. This lays a solid foundation for robot grasping in industrial scenarios. Note to Practitioners—Our work is motivated by industrial product assembly based on robot grasping. The industrial parts are usually manufactured by numerical machines and piled in bins. Our method can estimate the poses of visible parts accurately. A pose of a part includes its centroid and spatial orientations. Combined with a depth camera, this algorithm allows an industrial robot to understand complex stacked scenes. We improve the pose estimation-accuracy in order to assemble parts with robot grasping, without an additional pose adjuster. Our network can learn from a synthetic dataset and apply it to real-world data, without a significant accuracy drop. The synthetic dataset can be obtained easily by computer simulation programs, so the training data are sufficient. Experiments demonstrate that our method outperforms the state-of-the-art pose estimation approaches.

PPR-Net: Point-wise Pose Regression Network for Instance Segmentation and 6D Pose Estimation in Bin-picking Scenarios.

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

PPR-Net++: Accurate 6-D Pose Estimation in Stacked Scenarios

Context-Guided Adaptive Network for Efficient Human Pose Estimation.

Sparse Convolution Based 6D Pose Estimation for Robotic Bin-Picking with Point Clouds

AttentionVote: A Coarse-to-fine Voting Network of Anchor-Free 6D Pose Estimation on Point Cloud for Robotic Bin-Picking Application

6D Pose Estimation for Bin-Picking based on Improved Mask R-CNN and DenseFusion

Instance segmentation based 6D pose estimation of industrial objects using point clouds for robotic bin-picking

Deep Learning Based 6D Pose Estimation for Bin-Picking Using 3D Point Clouds

Prior-information-guided corresponding point regression network for 6D pose estimation

SLPRNet: A 6D Object Pose Regression Network by Sample Learning

PAV-Net: Point-wise Attention Keypoints Voting Network for Real-time 6D Object Pose Estimation

Real-Time and Efficient 6-D Pose Estimation from a Single RGB Image

Semantic Part Segmentation Method Based 3D Object Pose Estimation with RGB-D Images for Bin-Picking

MFPN-6D: Real-time One-stage Pose Estimation of Objects on RGB Images

Object Pose Estimation Based on Multi-precision Vectors and Seg-Driven PnP

REG-Net: Improving 6DoF Object Pose Estimation with 2D Keypoint Long-Short-Range-Aware Registration

A Pose Estimation Approach Based on Keypoints Detection for Robotic Bin-picking Application

PVNet: Pixel-Wise Voting Network for 6dof Object Pose Estimation.

A 6D Pose Estimation for Robotic Bin-Picking Using Point-Pair Features with Curvature (Cur-Ppf).

A Segmentation-Driven Approach for 6D Object Pose Estimation in the Crowd