Abstract:Learning robust feature matching between the template and search area is crucial for 3-D Siamese tracking. The core of Siamese feature matching is how to assign high feature similarity to the corresponding points between the template and the search area for precise object localization. In this article, we propose a novel point cloud registration-driven Siamese tracking framework, with the intuition that spatially aligned corresponding points (via 3-D registration) tend to achieve consistent feature representations. Specifically, our method consists of two modules, including a tracking-specific nonlocal registration (TSNR) module and a registration-aided Sinkhorn template-feature aggregation module. The registration module targets the precise spatial alignment between the template and the search area. The tracking-specific spatial distance constraint is proposed to refine the cross-attention weights in the nonlocal module for discriminative feature learning. Then, we use the weighted singular value decomposition (SVD) to compute the rigid transformation between the template and the search area and align them to achieve the desired spatially aligned corresponding points. For the feature aggregation model, we formulate the feature matching between the transformed template and the search area as an optimal transport problem and utilize the Sinkhorn optimization to search for the outlier-robust matching solution. Also, a registration-aided spatial distance map is built to improve the matching robustness in indistinguishable regions (e.g., smooth surfaces). Finally, guided by the obtained feature matching map, we aggregate the target information from the template into the search area to construct the target-specific feature, which is then fed into a CenterPoint-like detection head for object localization. Extensive experiments on KITTI, NuScenes, and Waymo datasets verify the effectiveness of our proposed method.

PointSiamRCNN: Target-aware Voxel-based Siamese Tracker for Point Clouds

3D Siamese Voxel-to-BEV Tracker for Sparse Point Clouds

3D Siamese Voxel-to-BEV Tracker for Sparse Point Clouds.

Exploit Spatiotemporal Contextual Information for 3D Single Object Tracking Via Memory Networks

Multi-modal 3D Human Tracking for Robots in Complex Environment with Siamese Point-Video Transformer

Siamese Refine Polar Mask Prediction Network for Visual Tracking

VoxelTrack: Exploring Voxel Representation for 3D Point Cloud Object Tracking

3D-SiamRPN: An End-to-End Learning Method for Real-Time 3D Single Object Tracking Using Raw Point Cloud

OS-DS tracker: Orientation-variant Siamese 3D tracking with Detection based Sampling

Point Cloud Registration-Driven Robust Feature Matching for 3-D Siamese Object Tracking

Point Cloud Registration-Driven Robust Feature Matching for 3D Siamese Object Tracking

P2V-RCNN: Point to Voxel Feature Learning for 3D Object Detection From Point Clouds

Siamese Attentional Cascade Keypoints Network for Visual Object Tracking

Siamese Centerness Prediction Network for Real-Time Visual Object Tracking

OSP2B: One-Stage Point-to-Box Network for 3D Siamese Tracking

Object Preserving Siamese Network for Single Object Tracking on Point Clouds

SiamRCSC: Robust siamese network with channel and spatial constraints for visual object tracking

Beyond 3D Siamese Tracking: A Motion-Centric Paradigm for 3D Single Object Tracking in Point Clouds

SiamBAN: Target-Aware Tracking With Siamese Box Adaptive Network

OST: Efficient One-stream Network for 3D Single Object Tracking in Point Clouds

Object Tracking Algorithm Based on Channel-interconnection-spatial Attention Mechanism and Siamese Region Proposal Network