Abstract:Category-level object pose estimation aims to predict the 6D pose and 3D metric size of objects from given categories. Due to significant intra-class shape variations among different instances, existing methods have mainly focused on estimating dense correspondences between observed point clouds and their canonical representations, i.e., normalized object coordinate space (NOCS). Subsequently, a similarity transformation is applied to recover the object pose and size. Despite these efforts, current approaches still cannot fully exploit the intrinsic geometric features to individual instances, thus limiting their ability to handle objects with complex structures (i.e., cameras). To overcome this issue, this paper introduces GPT-COPE, which leverages a graph-guided point transformer to explore distinctive geometric features from the observed point cloud. Specifically, our GPT-COPE employs a Graph-Guided Attention Encoder to extract multiscale geometric features in a local-to-global manner and utilizes an Iterative Non-Parametric Decoder to aggregate the multiscale geometric features from finer scales to coarser scales without learnable parameters. After obtaining the aggregated geometric features, the object NOCS coordinates and shape are regressed through the shape prior adaptation mechanism, and the object pose and size are obtained using the Umeyama algorithm. The multiscale network design enables perceiving the overall shape and structural information of the object, which is beneficial to handle objects with complex structures. Experimental results on the NOCS-REAL and NOCS-CAMERA datasets demonstrate that our GPT-COPE achieves state-of-the-art performance and significantly outperforms existing methods. Furthermore, our GPT-COPE shows superior generalization ability compared to existing methods on the large-scale in-the-wild dataset Wild6D and achieves better performance on the REDWOOD75 dataset, which involves objects with unconstrained orientations.

Category Level Object Pose Estimation via Global High-Order Pooling

Context-Guided Adaptive Network for Efficient Human Pose Estimation.

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

Unseen Object Pose Estimation via Registration

Instance-Adaptive and Geometric-Aware Keypoint Learning for Category-Level 6D Object Pose Estimation

HS-Pose: Hybrid Scope Feature Extraction for Category-level Object Pose Estimation

Category-Level Object Pose Estimation with Statistic Attention

KGNet: Knowledge-Guided Networks for Category-Level 6D Object Pose and Size Estimation.

LA-Net: An End-to-End Category-Level Object Attitude Estimation Network Based on Multi-Scale Feature Fusion and an Attention Mechanism

Attention Guided 6D Object Pose Estimation with Multi-constraints Voting Network

Pose Estimation for Swimmers in Video Surveillance

GPV-Pose: Category-level Object Pose Estimation Via Geometry-guided Point-wise Voting

GS-Pose: Category-Level Object Pose Estimation via Geometric and Semantic Correspondence

Object Level Depth Reconstruction for Category Level 6D Object Pose Estimation from Monocular RGB Image

DualPoseNet: Category-level 6D Object Pose and Size Estimation Using Dual Pose Network with Refined Learning of Pose Consistency

GPT-COPE: A Graph-Guided Point Transformer for Category-Level Object Pose Estimation

A Robust CoS-PVNet Pose Estimation Network in Complex Scenarios

RBP-Pose: Residual Bounding Box Projection for Category-Level Pose Estimation

DR-Pose: A Two-stage Deformation-and-Registration Pipeline for Category-level 6D Object Pose Estimation

APP: Adaptive Pose Pooling for 3D Human Pose Estimation from Videos