Abstract:3D Object pose estimation is a critical task in many real-world applications, e.g., robotic manipulation and augmented reality. Most existing methods focus on estimating the object instances or categories which have been seen in the training phase. However, it is imperative to estimate the pose of unseen objects without re-training the network in real world. Therefore, we proposed a 3D pose estimation method for unseen objects without re-training. Specifically, given the CAD model of the unseen object, a set of template RGB-D images (RGB images and depth images) is rendered at different viewpoints. Then a feature embedding network, named PoseFusion, is designed to extract the scene feature. In this network, RGB-D images are utilized to extract the texture feature and geometric feature, respectively. Afterwards, a cross-modality alignment module is proposed to eliminate the noise in single modality. The aligned texture feature and aligned geometric feature are fused through a geometry guided fusion module. Thus, by PoseFusion, the template RGB-D images generated from the CAD model are abstracted into a set of template scene features, and the query scene features are also embedded from the captured RGB-D images from the unseen object. Finally, the query scene features are matched with the template scene features by calculating the masked local similarity. Then the identity and pose of unseen object are determined by the most similar template. Experiments on LINEMOD and T-LESS datasets demonstrate that our method outperforms other methods and generalizes better to unseen objects. Extensive ablation studies are performed to verify the effectiveness of the PoseFusion.

Efficient Object Localization for Unseen Object 6D Pose Estimation

Unseen Object Pose Estimation via Registration

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

Zero-Shot 3d Pose Estimation of Unseen Object by Two-Step Rgb-D Fusion

A Method for Unseen Object Six Degrees of Freedom Pose Estimation Based on Segment Anything Model and Hybrid Distance Optimization

Object 6D Pose Estimation with Non-local Attention

Efficient Encoding and Aligning Viewpoints for 6D Pose Estimation of Unseen Industrial Parts

Holistic and local patch framework for 6D object pose estimation in RGB-D images

Combined Holistic and Local Patches for Recovering 6D Object Pose.

PA-Pose: Partial Point Cloud Fusion Based on Reliable Alignment for 6D Pose Tracking

Center-Based Decoupled Point-cloud Registration for 6D Object Pose Estimation

Efficient 6D Object Pose Estimation Based on Attentive Multi‐scale Contextual Information

Efficient Center Voting for Object Detection and 6D Pose Estimation in 3D Point Cloud

6D object pose estimation based on dense convolutional object center voting with improved accuracy and efficiency

6D Object Pose Estimation with Location-and-Channel Attention

Attention Guided 6D Object Pose Estimation with Multi-constraints Voting Network

Leaping from 2D Detection to Efficient 6DoF Object Pose Estimation.

Homologous multimodal fusion network with geometric constraint keypoints selection for 6D pose estimation

An Iterative Attention Fusion Network for 6D Object Pose Estimation

Marker-Less 3d Object Recognition and 6d Pose Estimation for Homogeneous Textureless Objects: An RGB-D Approach

PAM:Point-wise Attention Module for 6D Object Pose Estimation