Abstract:Six-degree-of-freedom (6DoF) object pose estimation is a critical task for robot manipulation, autonomous vehicles, and augmented reality. Category-level 6DoF object pose estimation is trending because it can generalize to same-category unknown objects. However, existing mean shape based methods do not consider that predicting adjustment must model shape differences, which makes these methods still suffer from shape variations among same-category objects, limiting their accuracy. Also, existing methods overlook the importance of object segmentation to 6DoF pose estimation and use an RGB-based object segmentation method with low accuracy. To address these problems, we propose difference-aware shape adjustment and RGB-D feature fusion-based object segmentation for category-level 6DoF object pose estimation. The proposed method encodes shape differences, improving mean shape adjustment and alleviating same-category shape variations. Specifically, a difference-aware shape adjustment network (DASAN) is proposed to model shape differences between the object instance and mean shape by feature subtraction with an attention mechanism. We also propose an RGB-D feature fusion-based object segmentation method that uses a coarse-to-fine framework: a 2D detector and a novel RGB-D feature fusion-based binary classification network for coarse and fine segmentation. Experiments on two well-known datasets demonstrate the proposed method’s state-of-the-art (SOTA) pose estimation accuracy. In addition, we construct comparative experiments on the latest dataset (Wild6D) and a self-collected dataset (OBJECTS) and achieve high accuracies, demonstrating the strong generalizability of the proposed method. Also, we apply the proposed method to unknown object grasping, thus demonstrating the practicability of the proposed method.

Two-Phase Approach for Monocular Object Detection and 6-DoF Pose Estimation

Learning Stereopsis from Geometric Synthesis for 6D Object Pose Estimation

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

Leveraging Front and Side Cues for Occlusion Handling in Monocular 3D Object Detection

One Point, One Object: Simultaneous 3D Object Segmentation and 6-DOF Pose Estimation

6D pose estimation of 3D objects in scenes with mutual similarities and occlusions

Leaping from 2D Detection to Efficient 6DoF Object Pose Estimation.

Zero-Shot 3d Pose Estimation of Unseen Object by Two-Step Rgb-D Fusion

A Two-Stage Monocular Vision Detection Method for 6D Pose Estimation in Multi-Heterogeneous Robot Systems

Efficient Center Voting for Object Detection and 6D Pose Estimation in 3D Point Cloud

Fine segmentation and difference-aware shape adjustment for category-level 6DoF object pose estimation

Monocular 3D Object Detection Leveraging Accurate Proposals and Shape Reconstruction

2D-to-3D Projection for Monocular and Multi-View 3D Multi-class Object Detection in Indoor Scenes

Monocular 3D Object Detection with Decoupled Structured Polygon Estimation and Height-Guided Depth Estimation

Monocular 3D object detection via estimation of paired keypoints for autonomous driving

Simultaneous Multiple Object Detection and Pose Estimation using 3D Model Infusion with Monocular Vision

BB8: A Scalable, Accurate, Robust to Partial Occlusion Method for Predicting the 3D Poses of Challenging Objects without Using Depth

6D object pose estimation based on dense convolutional object center voting with improved accuracy and efficiency

Object aspect classification and 6DoF pose estimation

A Method for Unseen Object Six Degrees of Freedom Pose Estimation Based on Segment Anything Model and Hybrid Distance Optimization

DSC-PoseNet: Learning 6DoF Object Pose Estimation via Dual-scale Consistency