Abstract:In this work, we tackle the problem of category-level online pose tracking of objects from point cloud sequences. For the first time, we propose a unified framework that can handle 9DoF pose tracking for novel rigid object instances as well as per-part pose tracking for articulated objects from known categories. Here the 9DoF pose, comprising 6D pose and 3D size, is equivalent to a 3D amodal bounding box representation with free 6D pose. Given the depth point cloud at the current frame and the estimated pose from the last frame, our novel end-to-end pipeline learns to accurately update the pose. Our pipeline is composed of three modules: 1) a pose canonicalization module that normalizes the pose of the input depth point cloud; 2) RotationNet, a module that directly regresses small interframe delta rotations; and 3) CoordinateNet, a module that predicts the normalized coordinates and segmentation, enabling analytical computation of the 3D size and translation. Leveraging the small pose regime in the pose-canonicalized point clouds, our method integrates the best of both worlds by combining dense coordinate prediction and direct rotation regression, thus yielding an end-to-end differentiable pipeline optimized for 9DoF pose accuracy (without using non-differentiable RANSAC). Our extensive experiments demonstrate that our method achieves new state-of-the-art performance on category-level rigid object pose (NOCS-REAL275 [29]) and articulated object pose benchmarks (SAPIEN [34], BMVC [18]) at the fastest FPS similar to 12.

6-PACK: Category-level 6D Pose Tracker with Anchor-Based Keypoints.

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

PA-Pose: Partial Point Cloud Fusion Based on Reliable Alignment for 6D Pose Tracking

KGNet: Knowledge-Guided Networks for Category-Level 6D Object Pose and Size Estimation.

Germination and morphology of zygospores in two Cochlonema and one Acaulopage species

DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusion

RDPN6D: Residual-based Dense Point-wise Network for 6Dof Object Pose Estimation Based on RGB-D Images

Towards Real-World Aerial Vision Guidance with Categorical 6D Pose Tracker

Deep Active Contours for Real-time 6-Dof Object Tracking

KDFNet: Learning Keypoint Distance Field for 6D Object Pose Estimation

Instance-Adaptive and Geometric-Aware Keypoint Learning for Category-Level 6D Object Pose Estimation

Scene-level Pose Estimation for Multiple Instances of Densely Packed Objects

CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Clouds

OmniPose6D: Towards Short-Term Object Pose Tracking in Dynamic Scenes from Monocular RGB

BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objects

Diet and nutrition in polycystic ovary syndrome (PCOS): Pointers for nutritional management

DR-Pose: A Two-stage Deformation-and-Registration Pipeline for Category-level 6D Object Pose Estimation

6D Assembly Pose Estimation by Point Cloud Registration for Robot Manipulation

PVN3D: A Deep Point-wise 3D Keypoints Voting Network for 6DoF Pose Estimation

PAM:Point-wise Attention Module for 6D Object Pose Estimation

Omni6DPose: A Benchmark and Model for Universal 6D Object Pose Estimation and Tracking