Abstract:6-D pose estimation is an important branch in the field of vision measurement and is widely used in the fields of robotics, autonomous driving, and reality augmentation. The latest research trend in 6-D pose estimation is to train a deep neural network to directly predict the 2-D projection position of the 3-D keypoint from the image, establish the corresponding relationship, and, finally, use the perspective-n-point (PnP) algorithm to perform pose estimation. The current challenge of pose estimation is that, when objects are textureless, occluded, or scene-cluttered, the detection accuracy is reduced, and most of the existing algorithm models are large and cannot accommodate real-time requirements. In this article, we introduce a densely connected feature pyramid network (DFPN) that can efficiently integrate and utilize features. We combine the cross-stage partial network (CSPNet) with DFPN to design a new network for 6-D pose estimation, DFPN-6-D, a new approach for 6-D object pose estimation. DFPN-6-D can efficiently and accurately handle objects with textureless, occluded, and scene clutter and estimate their full 6-D poses in a single shot. Furthermore, we propose a new confidence calculation method and loss function for object pose estimation, which can fully consider spatial information. Finally, we propose a novel augmentation method for direct 6-D pose estimation approaches to improve performance and generalization ability in the case of occlusion, which is called 6-D augmentation. Our approach achieves a new state-of-the-art accuracy of 98.06 and 87.09 in terms of the ADD(-S) metric on the Linemod dataset and the Occluded-Linemod dataset, and our method also achieves the best result in terms of the different metric on the MULT-I dataset, the BIN-P dataset, and the T-LESS dataset, respectively, while still running end-to-end at over 65 frames/s. The experimental results demonstrate that our algorithm is robust to textureless materials and occlusion while running more efficiently than other methods. We also deploy our proposed method to a real robot to grasp and manipulate objects based on the estimated pose.

Depth-Based Lightweight Feature Fusion Network for Category-Level 6D Pose Estimation

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

A Lightweight Two-End Feature Fusion Network for Object 6D Pose Estimation

Recurrent Volume-based 3D Feature Fusion for Real-time Multi-view Object Pose Estimation

An Iterative Attention Fusion Network for 6D Object Pose Estimation

A Novel Depth and Color Feature Fusion Framework for 6D Object Pose Estimation.

SaMfENet: Self-Attention Based Multi-Scale Feature Fusion Coding and Edge Information Constraint Network for 6D Pose Estimation

FEIF: Feature Excitation and Interactive Fusion for 6D Object Pose Estimation.

A modal fusion network with dual attention mechanism for 6D pose estimation

HFE-Net: Hierarchical Feature Extraction and Coordinate Conversion of Point Cloud for Object 6D Pose Estimation

ACF-Net: Attention Context Fusion Network for 6D Pose Estimation

An Efficient Color and Geometric Feature Fusion Module for 6D Object Pose Estiamtion

A Lightweight Color and Geometry Feature Extraction and Fusion Module for End-to-end 6D Pose Estimation

RFF-PoseNet: A 6D Object Pose Estimation Network Based on Robust Feature Fusion in Complex Scenes

RFFCE: Residual Feature Fusion and Confidence Evaluation Network for 6dof Pose Estimation.

A Transformer-based multi-modal fusion network for 6D pose estimation

Real-Time and Efficient 6-D Pose Estimation from a Single RGB Image

Zero-Shot 3d Pose Estimation of Unseen Object by Two-Step Rgb-D Fusion

MixedFusion: 6D Object Pose Estimation from Decoupled RGB-Depth Features.

A Depth Adaptive Feature Extraction and Dense Prediction Network for 6-D Pose Estimation in Robotic Grasping

MFPN-6D: Real-time One-stage Pose Estimation of Objects on RGB Images