Abstract:Six-degree-of-freedom (6DoF) object pose estimation is a critical task for robot manipulation, autonomous vehicles, and augmented reality. Category-level 6DoF object pose estimation is trending because it can generalize to same-category unknown objects. However, existing mean shape based methods do not consider that predicting adjustment must model shape differences, which makes these methods still suffer from shape variations among same-category objects, limiting their accuracy. Also, existing methods overlook the importance of object segmentation to 6DoF pose estimation and use an RGB-based object segmentation method with low accuracy. To address these problems, we propose difference-aware shape adjustment and RGB-D feature fusion-based object segmentation for category-level 6DoF object pose estimation. The proposed method encodes shape differences, improving mean shape adjustment and alleviating same-category shape variations. Specifically, a difference-aware shape adjustment network (DASAN) is proposed to model shape differences between the object instance and mean shape by feature subtraction with an attention mechanism. We also propose an RGB-D feature fusion-based object segmentation method that uses a coarse-to-fine framework: a 2D detector and a novel RGB-D feature fusion-based binary classification network for coarse and fine segmentation. Experiments on two well-known datasets demonstrate the proposed method’s state-of-the-art (SOTA) pose estimation accuracy. In addition, we construct comparative experiments on the latest dataset (Wild6D) and a self-collected dataset (OBJECTS) and achieve high accuracies, demonstrating the strong generalizability of the proposed method. Also, we apply the proposed method to unknown object grasping, thus demonstrating the practicability of the proposed method.

FEIF: Feature Excitation and Interactive Fusion for 6D Object Pose Estimation.

MoreFusion: Multi-object Reasoning for 6D Pose Estimation from Volumetric Fusion

RFFCE: Residual Feature Fusion and Confidence Evaluation Network for 6dof Pose Estimation.

Recurrent Volume-based 3D Feature Fusion for Real-time Multi-view Object Pose Estimation

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

Recurrent Volume-Based 3-D Feature Fusion for Real-Time Multiview Object Pose Estimation.

DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusion

MixedFusion: 6D Object Pose Estimation from Decoupled RGB-Depth Features.

Zero-Shot 3d Pose Estimation of Unseen Object by Two-Step Rgb-D Fusion

A Lightweight Color and Geometry Feature Extraction and Fusion Module for End-to-end 6D Pose Estimation

A Transformer-based multi-modal fusion network for 6D pose estimation

LHFF-Net: Local heterogeneous feature fusion network for 6DoF pose estimation

A modal fusion network with dual attention mechanism for 6D pose estimation

PA-Pose: Partial Point Cloud Fusion Based on Reliable Alignment for 6D Pose Tracking

Towards Two-view 6D Object Pose Estimation: A Comparative Study on Fusion Strategy

Leaping from 2D Detection to Efficient 6DoF Object Pose Estimation.

6-DoF grasp estimation method that fuses RGB-D data based on external attention

6D pose estimation of 3D objects in scenes with mutual similarities and occlusions

Fine segmentation and difference-aware shape adjustment for category-level 6DoF object pose estimation

A 3D Keypoints Voting Network for 6DoF Pose Estimation in Indoor Scene

Robust Classification and 6D Pose Estimation by Sensor Dual Fusion of Image and Point Cloud Data