Abstract:Tracking an object's 6D pose is significant in various real-world applications, such as robotic grasping, virtual reality, and self-driving. Still the existing methods suffer from following challenges: i) geometric shapes, such as rotational symmetry shapes, and ii) complex scenes, for instance, cluttered backgrounds and occluded scenes. To tackle these problems, we propose FCR-TrackNet, a novel tracking network that utilizes a residual iterative framework with low-and high-level feature fusion and joint classification-regression. FCR-TrackNet inputs the rendered RGB-D image from the previous frame pose and the current RGB-D image to extract low-level features. Then, high-level features are also obtained by the convolutional network and fused with low-level one to capture subtle variations in target object features across adjacent frames. To reduce computational complexity and ensure high tracking speed, we adopt decoupled branches to estimate the translation and rotation of the pose independently. At last, a joint classification-regression is designed to address the boundary problem of the rotation angle. We introduce a smooth classification label that effectively enhances the accuracy of rotation vector classification. We evaluate the performance of FCR-TrackNet on two well-known datasets, YCB-Video and YCBInEOAT. FCR-TrackNet achieves state-of-the-art ADD values of 94.5% and 93.2%, and ADD-S values of 96.7% and 96.0%, respectively, with a tracking speed of 89.6 Hz. It also outperforms competing algorithms in target pose tracking in occlusion and rotational symmetry shapes. The quantitative and qualitative results validate the high performance of FCR-TrackNet on 6D pose tracking.

ICK-Track: A Category-Level 6-Dof Pose Tracker Using Inter-Frame Consistent Keypoints for Aerial Manipulation.

Towards Real-World Aerial Vision Guidance with Categorical 6D Pose Tracker

Beyond Traditional Driving Scenes: A Robotic-Centric Paradigm for 2D+3D Human Tracking Using Siamese Transformer Network

Multi-modal 3D Human Tracking for Robots in Complex Environment with Siamese Point-Video Transformer

PA-Pose: Partial Point Cloud Fusion Based on Reliable Alignment for 6D Pose Tracking

6-PACK: Category-level 6D Pose Tracker with Anchor-Based Keypoints.

A Robust 6-D Pose Tracking Approach by Fusing a Multi-Camera Tracking Device and an AHRS Module

CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Clouds

A Wide-Area, Low-Latency, and Power-Efficient 6-DoF Pose Tracking System for Rigid Objects

CatTrack: Single-Stage Category-Level 6D Object Pose Tracking Via Convolution and Vision Transformer

Enhancing Generalizable 6D Pose Tracking of an In-Hand Object with Tactile Sensing

6N-DoF Pose Tracking for Tensegrity Robots

Pose-Assisted Multi-Camera Collaboration for Active Object Tracking.

Deep Active Contours for Real-time 6-Dof Object Tracking

VoCAPTER: Voting-based Pose Tracking for Category-level Articulated Object Via Inter-frame Priors

Corr-Track: Category-Level 6D Pose Tracking with Soft-Correspondence Matrix Estimation

FCR-TrackNet: Towards High-Performance 6D Pose Tracking with Multi-Level Features Fusion and Joint Classification-Regression.

Articulated Object Manipulation using Online Axis Estimation with SAM2-Based Tracking

Visually Guided Model Predictive Robot Control via 6D Object Pose Localization and Tracking

Robust monocular 3D object pose tracking for large visual range variation in robotic manipulation via scale-adaptive region-based method

Tracking 3-D Motion of Dynamic Objects Using Monocular Visual-Inertial Sensing