Abstract:Learning robust feature matching between the template and search area is crucial for 3-D Siamese tracking. The core of Siamese feature matching is how to assign high feature similarity to the corresponding points between the template and the search area for precise object localization. In this article, we propose a novel point cloud registration-driven Siamese tracking framework, with the intuition that spatially aligned corresponding points (via 3-D registration) tend to achieve consistent feature representations. Specifically, our method consists of two modules, including a tracking-specific nonlocal registration (TSNR) module and a registration-aided Sinkhorn template-feature aggregation module. The registration module targets the precise spatial alignment between the template and the search area. The tracking-specific spatial distance constraint is proposed to refine the cross-attention weights in the nonlocal module for discriminative feature learning. Then, we use the weighted singular value decomposition (SVD) to compute the rigid transformation between the template and the search area and align them to achieve the desired spatially aligned corresponding points. For the feature aggregation model, we formulate the feature matching between the transformed template and the search area as an optimal transport problem and utilize the Sinkhorn optimization to search for the outlier-robust matching solution. Also, a registration-aided spatial distance map is built to improve the matching robustness in indistinguishable regions (e.g., smooth surfaces). Finally, guided by the obtained feature matching map, we aggregate the target information from the template into the search area to construct the target-specific feature, which is then fed into a CenterPoint-like detection head for object localization. Extensive experiments on KITTI, NuScenes, and Waymo datasets verify the effectiveness of our proposed method.

OS-DS tracker: Orientation-variant Siamese 3D tracking with Detection based Sampling

PointSiamRCNN: Target-aware Voxel-based Siamese Tracker for Point Clouds

Object tracking with 3D LIDAR via multi-task sparse learning

Multi-modal 3D Human Tracking for Robots in Complex Environment with Siamese Point-Video Transformer

Beyond 3D Siamese Tracking: A Motion-Centric Paradigm for 3D Single Object Tracking in Point Clouds

An Effective Motion-Centric Paradigm for 3D Single Object Tracking in Point Clouds

OSP2B: One-Stage Point-to-Box Network for 3D Siamese Tracking

Point Cloud Registration-Driven Robust Feature Matching for 3-D Siamese Object Tracking

3D-SiamRPN: An End-to-End Learning Method for Real-Time 3D Single Object Tracking Using Raw Point Cloud

Point Cloud Registration-Driven Robust Feature Matching for 3D Siamese Object Tracking

3D Siamese Voxel-to-BEV Tracker for Sparse Point Clouds

Efficient Bird Eye View Proposals for 3D Siamese Tracking

Object Preserving Siamese Network for Single Object Tracking on Point Clouds

F-Siamese Tracker: A Frustum-based Double Siamese Network for 3D Single Object Tracking

Multi-Correlation Siamese Transformer Network with Dense Connection for 3D Single Object Tracking

Monocular Quasi-Dense 3D Object Tracking

CDTracker: Coarse-to-Fine Feature Matching and Point Densification for 3D Single-Object Tracking

SeqTrack3D: Exploring Sequence Information for Robust 3D Point Cloud Tracking

3D Siamese Voxel-to-BEV Tracker for Sparse Point Clouds.

OST: Efficient One-stream Network for 3D Single Object Tracking in Point Clouds