Abstract:Monocular object 6D pose estimation is a fundamental yet challenging task in computer vision. Recently, deep learning has been proven to be capable of predicting remarkable results in this task. Existing works often adopt a two-stage pipeline with establishing 2D-3D correspondences and utilizing a PnP/RANSAC or differentiable PnP algorithm to recover 6 degrees-of-freedom (6DoF) pose parameters. However, most of them hardly consider the geometric features in 3D space, and ignore the topological cues when performing differentiable PnP algorithms. To this end, we present an improved end-to-end monocular 6D pose estimation method (DGECN++) that incorporates depth estimation and a geometric-aware learnable PnP network. Our method is based on keypoints. First we detect the 2D keypoints that correspond to the 3D model. We then integrate differentiable PnP/RANSAC algorithm to create an end-to-end pipeline for 6D pose estimation. We focuses on the following three key aspects: 1) We utilize the estimated depth information to guide the process of extracting 2D-3D correspondences and refine the results using a cascaded differentiable PnP/RANSAC algorithm that incorporates geometric information. 2) We leverage the uncertainty of the estimated depth map to enhance the accuracy and robustness of the predicted 6D pose. 3) We propose a differentiable Perspective-n-Point (PnP) algorithm based on edge convolution and self-attention to explore the topological relationships between 2D-3D correspondences. Experimental results demonstrate that our proposed network surpasses existing methods in terms of both effectiveness and efficiency.

BiCo-Net: Regress Globally, Match Locally for Robust 6D Pose Estimation

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

DCNet: Dense Correspondence Neural Network for 6DoF Object Pose Estimation in Occluded Scenes

Prior-information-guided corresponding point regression network for 6D pose estimation

C2FNet: Coarse-to-Fine Keypoint Localization Network for Monocular 6D Object Pose Estimation

REG-Net: Improving 6DoF Object Pose Estimation with 2D Keypoint Long-Short-Range-Aware Registration

A Robust CoS-PVNet Pose Estimation Network in Complex Scenarios

GDR-Net: Geometry-Guided Direct Regression Network for Monocular 6D Object Pose Estimation

Exploiting Point-Wise Attention in 6D Object Pose Estimation Based on Bidirectional Prediction

RDPN6D: Residual-based Dense Point-wise Network for 6Dof Object Pose Estimation Based on RGB-D Images

SilhoNet: An RGB Method for 6D Object Pose Estimation

Homologous multimodal fusion network with geometric constraint keypoints selection for 6D pose estimation

GeoPose: Dense Reconstruction Guided 6D Object Pose Estimation with Geometric Consistency

DGECN++: A Depth-Guided Edge Convolutional Network for End-to-End 6D Pose Estimation via Attention Mechanism

HFE-Net: Hierarchical Feature Extraction and Coordinate Conversion of Point Cloud for Object 6D Pose Estimation

Geometric-aware Dense Matching Network for 6D Pose Estimation of Objects from RGB-D Images

Attention Guided 6D Object Pose Estimation with Multi-constraints Voting Network

6D Object Pose Regression Via Supervised Learning on Point Clouds.

ACF-Net: Attention Context Fusion Network for 6D Pose Estimation

SaMfENet: Self-Attention Based Multi-Scale Feature Fusion Coding and Edge Information Constraint Network for 6D Pose Estimation

A Lightweight Two-End Feature Fusion Network for Object 6D Pose Estimation