Abstract:Learning robust feature matching between the template and search area is crucial for 3-D Siamese tracking. The core of Siamese feature matching is how to assign high feature similarity to the corresponding points between the template and the search area for precise object localization. In this article, we propose a novel point cloud registration-driven Siamese tracking framework, with the intuition that spatially aligned corresponding points (via 3-D registration) tend to achieve consistent feature representations. Specifically, our method consists of two modules, including a tracking-specific nonlocal registration (TSNR) module and a registration-aided Sinkhorn template-feature aggregation module. The registration module targets the precise spatial alignment between the template and the search area. The tracking-specific spatial distance constraint is proposed to refine the cross-attention weights in the nonlocal module for discriminative feature learning. Then, we use the weighted singular value decomposition (SVD) to compute the rigid transformation between the template and the search area and align them to achieve the desired spatially aligned corresponding points. For the feature aggregation model, we formulate the feature matching between the transformed template and the search area as an optimal transport problem and utilize the Sinkhorn optimization to search for the outlier-robust matching solution. Also, a registration-aided spatial distance map is built to improve the matching robustness in indistinguishable regions (e.g., smooth surfaces). Finally, guided by the obtained feature matching map, we aggregate the target information from the template into the search area to construct the target-specific feature, which is then fed into a CenterPoint-like detection head for object localization. Extensive experiments on KITTI, NuScenes, and Waymo datasets verify the effectiveness of our proposed method.

Learning to Match Using Siamese Network for Object Tracking.

Multitarget Tracking Using Siamese Neural Networks

Online Visual Tracking Via Cross-Similarity-based Siamese Network.

Learning Motion-Perceive Siamese network for robust visual object tracking

Multiple Convolutional Features in Siamese Networks for Object Tracking

IMSiam: IoU-aware Matching-adaptive Siamese Network for Object Tracking

Learning Dynamic Siamese Network For Visual Object Tracking

Siamese-Based Attention Learning Networks for Robust Visual Object Tracking

NCSiam: Reliable Matching Via Neighborhood Consensus for Siamese-Based Object Tracking.

A Time Sequence Images Matching Method Based on the Siamese Network

Deep Feature Based Siamese Network for Visual Object Tracking

Visual Object Tracking Via Non-Local Correlation Attention Learning

Visual Tracking Based on Siamese Network of Fused Score Map

Learning Complementary Siamese Networks for Real-Time High-Performance Visual Tracking.

Triplet Loss in Siamese Network for Object Tracking

SiamCMN: Jointing Cycle Memory and Correlation Network for Siamese Object Tracking

Point Cloud Registration-Driven Robust Feature Matching for 3D Siamese Object Tracking

Point Cloud Registration-Driven Robust Feature Matching for 3-D Siamese Object Tracking

Learning Bi-Grained Cross-Correlation Siamese Networks for Visual Tracking

Learning Deep Lucas-Kanade Siamese Network for Visual Tracking

Learning Geometry Information of Target for Visual Object Tracking with Siamese Networks