Abstract:3D Object pose estimation is a critical task in many real-world applications, e.g., robotic manipulation and augmented reality. Most existing methods focus on estimating the object instances or categories which have been seen in the training phase. However, it is imperative to estimate the pose of unseen objects without re-training the network in real world. Therefore, we proposed a 3D pose estimation method for unseen objects without re-training. Specifically, given the CAD model of the unseen object, a set of template RGB-D images (RGB images and depth images) is rendered at different viewpoints. Then a feature embedding network, named PoseFusion, is designed to extract the scene feature. In this network, RGB-D images are utilized to extract the texture feature and geometric feature, respectively. Afterwards, a cross-modality alignment module is proposed to eliminate the noise in single modality. The aligned texture feature and aligned geometric feature are fused through a geometry guided fusion module. Thus, by PoseFusion, the template RGB-D images generated from the CAD model are abstracted into a set of template scene features, and the query scene features are also embedded from the captured RGB-D images from the unseen object. Finally, the query scene features are matched with the template scene features by calculating the masked local similarity. Then the identity and pose of unseen object are determined by the most similar template. Experiments on LINEMOD and T-LESS datasets demonstrate that our method outperforms other methods and generalizes better to unseen objects. Extensive ablation studies are performed to verify the effectiveness of the PoseFusion.

Pose Estimation of Uncooperative Unknown Space Objects from a Single Image

Pose Estimation and Neural Implicit Reconstruction Towards Non-Cooperative Spacecraft Without Offline Prior Information

Learning Stereopsis from Geometric Synthesis for 6D Object Pose Estimation

Unseen Object Pose Estimation via Registration

Pose Estimation for Non-cooperative Spacecraft Based on Deep Learning

Pose Estimation of Space Objects Based on Hybrid Feature Matching of Contour Points.

Robust Estimation of 3D Human Poses from a Single Image

Zero-Shot 3d Pose Estimation of Unseen Object by Two-Step Rgb-D Fusion

Relative Pose Estimation of Uncooperative Spacecraft Using 2D-3D Line Correspondences.

Unsupervised Universal Hierarchical Multi-Person 3D Pose Estimation for Natural Scenes

Vision-Based Pose Estimation for Textureless Space Objects by Contour Points Matching

An Isomap-Eigenanalysis-Regression Pose Estimation Algorithm of Three-Dimentional Object

Uncooperative Spacecraft Pose Estimation Based on Intensity and Range Images Fusion

Vision-based pose estimation for cooperative space objects

Pose Estimation Based on Human Detection and Segmentation

Learning-Based Pose Estimation of Non-Cooperative Spacecrafts with Uncertainty Prediction

6D Object Pose Estimation from Approximate 3D Models for Orbital Robotics

Pose Estimation of Large Non-Cooperative Spacecraft Based on Extended PnP Model

Joint Representation of Multiple Geometric Priors via a Shape Decomposition Model for Single Monocular 3D Pose Estimation.

Pose measurement method for non-cooperative space vehicle using multiple non-overlapping cameras

UNOPose: Unseen Object Pose Estimation with an Unposed RGB-D Reference Image