Abstract:6-D pose estimation is an important branch in the field of vision measurement and is widely used in the fields of robotics, autonomous driving, and reality augmentation. The latest research trend in 6-D pose estimation is to train a deep neural network to directly predict the 2-D projection position of the 3-D keypoint from the image, establish the corresponding relationship, and, finally, use the perspective-n-point (PnP) algorithm to perform pose estimation. The current challenge of pose estimation is that, when objects are textureless, occluded, or scene-cluttered, the detection accuracy is reduced, and most of the existing algorithm models are large and cannot accommodate real-time requirements. In this article, we introduce a densely connected feature pyramid network (DFPN) that can efficiently integrate and utilize features. We combine the cross-stage partial network (CSPNet) with DFPN to design a new network for 6-D pose estimation, DFPN-6-D, a new approach for 6-D object pose estimation. DFPN-6-D can efficiently and accurately handle objects with textureless, occluded, and scene clutter and estimate their full 6-D poses in a single shot. Furthermore, we propose a new confidence calculation method and loss function for object pose estimation, which can fully consider spatial information. Finally, we propose a novel augmentation method for direct 6-D pose estimation approaches to improve performance and generalization ability in the case of occlusion, which is called 6-D augmentation. Our approach achieves a new state-of-the-art accuracy of 98.06 and 87.09 in terms of the ADD(-S) metric on the Linemod dataset and the Occluded-Linemod dataset, and our method also achieves the best result in terms of the different metric on the MULT-I dataset, the BIN-P dataset, and the T-LESS dataset, respectively, while still running end-to-end at over 65 frames/s. The experimental results demonstrate that our algorithm is robust to textureless materials and occlusion while running more efficiently than other methods. We also deploy our proposed method to a real robot to grasp and manipulate objects based on the estimated pose.

AttentionVote: A Coarse-to-fine Voting Network of Anchor-Free 6D Pose Estimation on Point Cloud for Robotic Bin-Picking Application

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

Attention Guided 6D Object Pose Estimation with Multi-constraints Voting Network

Sparse Convolution Based 6D Pose Estimation for Robotic Bin-Picking with Point Clouds

6D Pose Estimation for Bin-Picking based on Improved Mask R-CNN and DenseFusion

PAV-Net: Point-wise Attention Keypoints Voting Network for Real-time 6D Object Pose Estimation

Instance segmentation based 6D pose estimation of industrial objects using point clouds for robotic bin-picking

3DPVNet: Patch-level 3D Hough Voting Network for 6D Pose Estimation

PPR-Net: Point-wise Pose Regression Network for Instance Segmentation and 6D Pose Estimation in Bin-picking Scenarios.

PVN3D: A Deep Point-wise 3D Keypoints Voting Network for 6DoF Pose Estimation

Efficient Encoding and Aligning Viewpoints for 6D Pose Estimation of Unseen Industrial Parts

A Geometry-Enhanced 6D Pose Estimation Network with Incomplete Shape Recovery for Industrial Parts

PVNet: Pixel-Wise Voting Network for 6dof Object Pose Estimation.

Deep Learning Based 6D Pose Estimation for Bin-Picking Using 3D Point Clouds

Real-Time and Efficient 6-D Pose Estimation from a Single RGB Image

Attention Voting Network with Prior Distance Augmented Loss for 6dof Pose Estimation

Semantic Part Segmentation Method Based 3D Object Pose Estimation with RGB-D Images for Bin-Picking

Object Pose Estimation Based on Multi-precision Vectors and Seg-Driven PnP

Efficient Center Voting for Object Detection and 6D Pose Estimation in 3D Point Cloud

PANet: A Pixel-Level Attention Network for 6D Pose Estimation With Embedding Vector Features

A 3D Keypoints Voting Network for 6DoF Pose Estimation in Indoor Scene