Abstract:Most supervised learning-based pose estimation methods for stacked scenes are trained on massive synthetic datasets. In most cases, the challenge is that the learned network on the training dataset is no longer optimal on the testing dataset. To address this problem, we propose a pose regression network PPR-Net++. It transforms each scene point into a point in the centroid space, followed by a clustering process and a voting process. In the training phase, a mapping function between the network's critical parameter (i.e., the bandwidth of the clustering algorithm) and the compactness of the centroid distributions is obtained. This function is used to adapt the bandwidth between centroid distributions of two different domains. In addition, to further improve the pose estimation accuracy, the network also predicts the confidence of each point, based on its visibility and pose error. Only the points with high confidence have the right to vote for the final object pose. In experiments, our method is trained on the IPA synthetic dataset and compared with the state-of-the-art algorithm. When tested with the public synthetic Siléane dataset, our method is better in all eight objects, where five of them are improved by more than 5% in average precision (AP). On IPA real dataset, our method outperforms a large margin by 20%. This lays a solid foundation for robot grasping in industrial scenarios. Note to Practitioners—Our work is motivated by industrial product assembly based on robot grasping. The industrial parts are usually manufactured by numerical machines and piled in bins. Our method can estimate the poses of visible parts accurately. A pose of a part includes its centroid and spatial orientations. Combined with a depth camera, this algorithm allows an industrial robot to understand complex stacked scenes. We improve the pose estimation-accuracy in order to assemble parts with robot grasping, without an additional pose adjuster. Our network can learn from a synthetic dataset and apply it to real-world data, without a significant accuracy drop. The synthetic dataset can be obtained easily by computer simulation programs, so the training data are sufficient. Experiments demonstrate that our method outperforms the state-of-the-art pose estimation approaches.

Latent Representation Self-Supervised Pose Network for Accurate Monocular Pipe Pose Estimation

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

Pipe pose estimation based on machine vision

Occlusion-Aware Self-Supervised Monocular 6D Object Pose Estimation.

Region Deformer Networks for Unsupervised Depth Estimation from Unconstrained Monocular Videos

Geometry-Driven Self-Supervised Method for 3D Human Pose Estimation

Self-Supervised Learning of Depth and Pose Using Cycle Generative Adversarial Network

Attention Guided 6D Object Pose Estimation with Multi-constraints Voting Network

Robust self-supervised monocular visual odometry based on prediction-update pose estimation network.

Self-supervised Monocular Depth and Pose Estimation for Endoscopy with Generative Latent Priors

Domain Adaptation of Networks for Camera Pose Estimation: Learning Camera Pose Estimation Without Pose Labels

Learning to Estimate Object Poses Without Real Image Annotations

Unsupervised Monocular Estimation of Depth and Visual Odometry uUsing Attention and Depth-Pose Consistency Loss

CPS++: Improving Class-level 6D Pose and Shape Estimation From Monocular Images With Self-Supervised Learning

MLFNet: Monocular lifting fusion network for 6DoF texture-less object pose estimation

Pseudo Flow Consistency for Self-Supervised 6D Object Pose Estimation

RNNPose: 6-DoF Object Pose Estimation Via Recurrent Correspondence Field Estimation and Pose Optimization

Temporal-Aware Self-Supervised Learning for 3D Hand Pose and Mesh Estimation in Videos

DL-PoseNet: A Differential Lightweight Network for Pose Regression over SE(3)

Pose ResNet: 3D Human Pose Estimation Based on Self-Supervision

PPR-Net++: Accurate 6-D Pose Estimation in Stacked Scenarios