Abstract:Monocular object 6D pose estimation is a fundamental yet challenging task in computer vision. Recently, deep learning has been proven to be capable of predicting remarkable results in this task. Existing works often adopt a two-stage pipeline with establishing 2D-3D correspondences and utilizing a PnP/RANSAC or differentiable PnP algorithm to recover 6 degrees-of-freedom (6DoF) pose parameters. However, most of them hardly consider the geometric features in 3D space, and ignore the topological cues when performing differentiable PnP algorithms. To this end, we present an improved end-to-end monocular 6D pose estimation method (DGECN++) that incorporates depth estimation and a geometric-aware learnable PnP network. Our method is based on keypoints. First we detect the 2D keypoints that correspond to the 3D model. We then integrate differentiable PnP/RANSAC algorithm to create an end-to-end pipeline for 6D pose estimation. We focuses on the following three key aspects: 1) We utilize the estimated depth information to guide the process of extracting 2D-3D correspondences and refine the results using a cascaded differentiable PnP/RANSAC algorithm that incorporates geometric information. 2) We leverage the uncertainty of the estimated depth map to enhance the accuracy and robustness of the predicted 6D pose. 3) We propose a differentiable Perspective-n-Point (PnP) algorithm based on edge convolution and self-attention to explore the topological relationships between 2D-3D correspondences. Experimental results demonstrate that our proposed network surpasses existing methods in terms of both effectiveness and efficiency.

HFE-Net: Hierarchical Feature Extraction and Coordinate Conversion of Point Cloud for Object 6D Pose Estimation

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

RFFCE: Residual Feature Fusion and Confidence Evaluation Network for 6dof Pose Estimation.

PA-Pose: Partial Point Cloud Fusion Based on Reliable Alignment for 6D Pose Tracking

FEIF: Feature Excitation and Interactive Fusion for 6D Object Pose Estimation.

Depth-Based Lightweight Feature Fusion Network for Category-Level 6D Pose Estimation

An Efficient Color and Geometric Feature Fusion Module for 6D Object Pose Estiamtion

An Iterative Attention Fusion Network for 6D Object Pose Estimation

ACF-Net: Attention Context Fusion Network for 6D Pose Estimation

LHFF-Net: Local heterogeneous feature fusion network for 6DoF pose estimation

Homologous multimodal fusion network with geometric constraint keypoints selection for 6D pose estimation

A Novel Depth and Color Feature Fusion Framework for 6D Object Pose Estimation.

DGECN: A Depth-Guided Edge Convolutional Network for End-to-End 6D Pose Estimation

A Transformer-based multi-modal fusion network for 6D pose estimation

Cross-modal Attention and Geometric Contextual Aggregation Network for 6dof Object Pose Estimation

Triangulate Geometric Constraint Combined with Visual-Flow Fusion Network for Accurate 6dof Pose Estimation.

A Lightweight Two-End Feature Fusion Network for Object 6D Pose Estimation

Six-Degree-of-Freedom Pose Estimation Method for Multi-Source Feature Points Based on Fully Convolutional Neural Network

DGECN++: A Depth-Guided Edge Convolutional Network for End-to-End 6D Pose Estimation via Attention Mechanism

Semi-Decoupled 6D Pose Estimation Via Multi-Modal Feature Fusion

RFF-PoseNet: A 6D Object Pose Estimation Network Based on Robust Feature Fusion in Complex Scenes