Abstract:Compared to 2D object bounding-box labeling, it is very difficult for humans to annotate 3D object poses, especially when depth images of scenes are unavailable. This paper investigates whether we can estimate the object poses effectively when only RGB images and 2D object annotations are given. To this end, we present a two-step pose estimation framework to attain 6DoF object poses from 2D object bounding-boxes. In the first step, the framework learns to segment objects from real and synthetic data in a weakly-supervised fashion, and the segmentation masks will act as a prior for pose estimation. In the second step, we design a dual-scale pose estimation network, namely DSC-PoseNet, to predict object poses by employing a differential renderer. To be specific, our DSC-PoseNet firstly predicts object poses in the original image scale by comparing the segmentation masks and the rendered visible object masks. Then, we resize object regions to a fixed scale to estimate poses once again. In this fashion, we eliminate large scale variations and focus on rotation estimation, thus facilitating pose estimation. Moreover, we exploit the initial pose estimation to generate pseudo ground-truth to train our DSC-PoseNet in a self-supervised manner. The estimation results in these two scales are ensembled as our final pose estimation. Extensive experiments on widely-used benchmarks demonstrate that our method outperforms state-of-the-art models trained on synthetic data by a large margin and even is on par with several fully-supervised methods.

WS-OPE: Weakly Supervised 6D Object Pose Regression using Relative Multi-Camera Pose Constraints

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

Learning Stereopsis from Geometric Synthesis for 6D Object Pose Estimation

Weak6D: Weakly Supervised 6D Pose Estimation With Iterative Annotation Resolver

NeRF-Pose: A First-Reconstruct-Then-Regress Approach for Weakly-supervised 6D Object Pose Estimation

6D Pose Estimation for Textureless Objects on RGB Frames using Multi-View Optimization

Robust RGB-based 6-DoF Pose Estimation without Real Pose Annotations

SO-Pose: Exploiting Self-Occlusion for Direct 6D Pose Estimation

6D Object Pose Regression Via Supervised Learning on Point Clouds.

Occlusion-Aware Self-Supervised Monocular 6D Object Pose Estimation.

Rigidity-Aware Detection for 6D Object Pose Estimation

SRPose: Two-view Relative Pose Estimation with Sparse Keypoints

Weakly-Supervised 3D Human Pose Learning via Multi-view Images in the Wild

Leveraging Positional Encoding for Robust Multi-Reference-Based Object 6D Pose Estimation

RNNPose: 6-DoF Object Pose Estimation Via Recurrent Correspondence Field Estimation and Pose Optimization

End-to-End Differentiable 6DoF Object Pose Estimation with Local and Global Constraints

DSC-PoseNet: Learning 6DoF Object Pose Estimation via Dual-scale Consistency

Robust Estimation of 3D Human Poses from a Single Image

Robust 3D Human Pose Estimation from Single Images or Video Sequences

Spatial and temporal consistency learning for monocular 6D pose estimation

CPS++: Improving Class-level 6D Pose and Shape Estimation From Monocular Images With Self-Supervised Learning