Abstract:Tracking an object's 6D pose is significant in various real-world applications, such as robotic grasping, virtual reality, and self-driving. Still the existing methods suffer from following challenges: i) geometric shapes, such as rotational symmetry shapes, and ii) complex scenes, for instance, cluttered backgrounds and occluded scenes. To tackle these problems, we propose FCR-TrackNet, a novel tracking network that utilizes a residual iterative framework with low-and high-level feature fusion and joint classification-regression. FCR-TrackNet inputs the rendered RGB-D image from the previous frame pose and the current RGB-D image to extract low-level features. Then, high-level features are also obtained by the convolutional network and fused with low-level one to capture subtle variations in target object features across adjacent frames. To reduce computational complexity and ensure high tracking speed, we adopt decoupled branches to estimate the translation and rotation of the pose independently. At last, a joint classification-regression is designed to address the boundary problem of the rotation angle. We introduce a smooth classification label that effectively enhances the accuracy of rotation vector classification. We evaluate the performance of FCR-TrackNet on two well-known datasets, YCB-Video and YCBInEOAT. FCR-TrackNet achieves state-of-the-art ADD values of 94.5% and 93.2%, and ADD-S values of 96.7% and 96.0%, respectively, with a tracking speed of 89.6 Hz. It also outperforms competing algorithms in target pose tracking in occlusion and rotational symmetry shapes. The quantitative and qualitative results validate the high performance of FCR-TrackNet on 6D pose tracking.

PixTrack: Precise 6DoF Object Pose Tracking using NeRF Templates and Feature-metric Alignment

TrackNeRF: Bundle Adjusting NeRF from Sparse and Noisy Views via Feature Tracks

Beyond Local Search: Tracking Objects Everywhere with Instance-Specific Proposals

BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objects

InterTrack: Interaction Transformer for 3D Multi-Object Tracking

A Region-based Gauss-Newton Approach to Real-Time Monocular Multiple Object Tracking

OmniPose6D: Towards Short-Term Object Pose Tracking in Dynamic Scenes from Monocular RGB

CRSOT: Cross-Resolution Object Tracking using Unaligned Frame and Event Cameras

RockTrack: A 3D Robust Multi-Camera-Ken Multi-Object Tracking Framework

MFITrack: Multi-Frame Integration Strategy for Enhanced Motion-Centric Single Object Tracking

Robust Object Pose Tracking for Augmented Reality Guidance and Teleoperation

FCR-TrackNet: Towards High-Performance 6D Pose Tracking with Multi-Level Features Fusion and Joint Classification-Regression.

A Framework for Evaluating 6-DOF Object Trackers

Standing Between Past and Future: Spatio-Temporal Modeling for Multi-Camera 3D Multi-Object Tracking

A Direct 3D Object Tracking Method Based on Dynamic Textured Model Rendering and Extended Dense Feature Fields

A Wide-Area, Low-Latency, and Power-Efficient 6-DoF Pose Tracking System for Rigid Objects

Visual Object Tracking With Mutual Affinity Aligned to Human Intuition

Accurate 3D Single Object Tracker With Local-to-Global Feature Refinement

GSGTrack: Gaussian Splatting-Guided Object Pose Tracking from RGB Videos

Tracking Objects as Points

Simultaneous Multi-View Camera Pose Estimation and Object Tracking with Square Planar Markers