Abstract:Category-level 6-D object pose estimation plays a crucial role in achieving reliable robotic grasp detection. However, the disparity between synthetic and real datasets hinders the direct transfer of models trained on synthetic data to real-world scenarios, leading to ineffective results. Additionally, creating large-scale real datasets is a time-consuming and labor-intensive task. To overcome these challenges, we propose CatDeform, a novel category-level object pose estimation network trained on synthetic data but capable of delivering good performance on real datasets. In our approach, we introduce a transformer-based fusion module that enables the network to leverage multiple sources of information and enhance prediction accuracy through feature fusion. To ensure proper deformation of the prior point cloud to align with scene objects, we propose a transformer-based attention module that deforms the prior point cloud from both geometric and feature perspectives. Building upon CatDeform, we design a two-branch network for supervised learning, bridging the gap between synthetic and real datasets and achieving high-precision pose estimation in real-world scenes using predominantly synthetic data supplemented with a small amount of real data. To minimize reliance on large-scale real datasets, we train the network in a self-supervised manner by estimating object poses in real scenes based on the synthetic dataset without manual annotation. We conduct training and testing on CAMERA25 and REAL275 datasets, and our experimental results demonstrate that the proposed method outperforms state-of-the-art (SOTA) techniques in both self-supervised and supervised training paradigms. Finally, we apply CatDeform to object pose estimation and robotic grasp experiments in real-world scenarios, showcasing a higher grasp success rate.

Synthetic Depth Image-based Category-Level Object Pose Estimation with Effective Pose Decoupling and Shape Optimization

Unseen Object Pose Estimation via Registration

GS-Pose: Category-Level Object Pose Estimation via Geometric and Semantic Correspondence

Leveraging SE(3) Equivariance for Self-Supervised Category-Level Object Pose Estimation

Zero-Shot 3d Pose Estimation of Unseen Object by Two-Step Rgb-D Fusion

SD-Pose: facilitating space-decoupled human pose estimation via adaptive pose perception guidance

An Efficient Network for Category-Level 6D Object Pose Estimation

Instance-Adaptive and Geometric-Aware Keypoint Learning for Category-Level 6D Object Pose Estimation

HS-Pose: Hybrid Scope Feature Extraction for Category-level Object Pose Estimation

Category-Level 6-D Object Pose Estimation With Shape Deformation for Robotic Grasp Detection

DR-Pose: A Two-stage Deformation-and-Registration Pipeline for Category-level 6D Object Pose Estimation

TG-Pose: Delving Into Topology and Geometry for Category-Level Object Pose Estimation

Category-level Pose Estimation and Iterative Refinement for Monocular RGB-D Image

Self-Supervised Category-Level Articulated Object Pose Estimation with Part-Level SE(3) Equivariance

Generative Category-Level Shape and Pose Estimation with Semantic Primitives

ShapeICP: Iterative Category-level Object Pose and Shape Estimation from Depth

A Method for Unseen Object Six Degrees of Freedom Pose Estimation Based on Segment Anything Model and Hybrid Distance Optimization

Fine segmentation and difference-aware shape adjustment for category-level 6DoF object pose estimation

Depth-Based Lightweight Feature Fusion Network for Category-Level 6D Pose Estimation

DualPoseNet: Category-level 6D Object Pose and Size Estimation Using Dual Pose Network with Refined Learning of Pose Consistency