Abstract:Six-degree-of-freedom (6DoF) object pose estimation is a critical task for robot manipulation, autonomous vehicles, and augmented reality. Category-level 6DoF object pose estimation is trending because it can generalize to same-category unknown objects. However, existing mean shape based methods do not consider that predicting adjustment must model shape differences, which makes these methods still suffer from shape variations among same-category objects, limiting their accuracy. Also, existing methods overlook the importance of object segmentation to 6DoF pose estimation and use an RGB-based object segmentation method with low accuracy. To address these problems, we propose difference-aware shape adjustment and RGB-D feature fusion-based object segmentation for category-level 6DoF object pose estimation. The proposed method encodes shape differences, improving mean shape adjustment and alleviating same-category shape variations. Specifically, a difference-aware shape adjustment network (DASAN) is proposed to model shape differences between the object instance and mean shape by feature subtraction with an attention mechanism. We also propose an RGB-D feature fusion-based object segmentation method that uses a coarse-to-fine framework: a 2D detector and a novel RGB-D feature fusion-based binary classification network for coarse and fine segmentation. Experiments on two well-known datasets demonstrate the proposed method’s state-of-the-art (SOTA) pose estimation accuracy. In addition, we construct comparative experiments on the latest dataset (Wild6D) and a self-collected dataset (OBJECTS) and achieve high accuracies, demonstrating the strong generalizability of the proposed method. Also, we apply the proposed method to unknown object grasping, thus demonstrating the practicability of the proposed method.

6Dof Pose Estimation for Intricately-Shaped Object with Prior Knowledge for Robotic Picking

Fast and Accurate Pose Estimation for Industrial Workpieces Robotic Picking

6D Pose Estimation Method of Metal Parts for Robotic Grasping Based on Semantic-Level Line Matching

A Robotic Semantic Grasping Method for Pick-and-place Tasks

Reconstruction-based 6D Pose Estimation for Robotic Assembly.

Sparse Convolution Based 6D Pose Estimation for Robotic Bin-Picking with Point Clouds

PS6D: Point Cloud Based Symmetry-Aware 6D Object Pose Estimation in Robot Bin-Picking

6D Pose Estimation Based on 3D Edge Binocular Reprojection Optimization for Robotic Assembly

6D Pose Estimation of Industrial Parts Based on Point Cloud Geometric Information Prediction for Robotic Grasping

Detect in RGB, Optimize in Edge: Accurate 6D Pose Estimation for Texture-less Industrial Parts

Deep Learning Based 6D Pose Estimation for Bin-Picking Using 3D Point Clouds

6D Pose Estimation with Combined Deep Learning and 3D Vision Techniques for a Fast and Accurate Object Grasping

Fine segmentation and difference-aware shape adjustment for category-level 6DoF object pose estimation

6D Assembly Pose Estimation by Point Cloud Registration for Robot Manipulation

Domain-Generalized Robotic Picking Via Contrastive Learning-Based 6-D Pose Estimation

6D Hybrid Pose Estimation in Cluttered Industrial Scenes for Robotic Grasping

6D pose estimation of 3D objects in scenes with mutual similarities and occlusions

6D Pose Estimation for Bin-Picking based on Improved Mask R-CNN and DenseFusion

6-D Object Pose Estimation Based on Point Pair Matching for Robotic Grasp Detection

A RGB-D Based 6D Object Pose Estimation and Its Application in Robotic Grasping

A Pose Estimation Approach Based on Keypoints Detection for Robotic Bin-picking Application