Abstract:Although recent Siamese network-based trackers have achieved impressive perceptual accuracy for single object tracking in LiDAR point clouds, they usually utilized heavy correlation operations to capture category-level characteristics only, and overlook the inherent merit of arbitrariness in contrast to multiple object tracking. In this work, we propose a radically novel one-stream network with the strength of the instance-level encoding, which avoids the correlation operations occurring in previous Siamese network, thus considerably reducing the computational effort. In particular, the proposed method mainly consists of a Template-aware Transformer Module (TTM) and a Multi-scale Feature Aggregation (MFA) module capable of fusing spatial and semantic information. The TTM stitches the specified template and the search region together and leverages an attention mechanism to establish the information flow, breaking the previous pattern of independent extraction-and-correlation. As a result, this module makes it possible to directly generate template-aware features that are suitable for the arbitrary and continuously changing nature of the target, enabling the model to deal with unseen categories. In addition, the MFA is proposed to make spatial and semantic information complementary to each other, which is characterized by reverse directional feature propagation that aggregates information from shallow to deep layers. Extensive experiments on KITTI and nuScenes demonstrate that our method has achieved considerable performance not only for class-specific tracking but also for class-agnostic tracking with less computation and higher efficiency.

Structure Aware 3D Single Object Tracking of Point Cloud

Multi-Level Structure-Enhanced Network for 3D Single Object Tracking in Sparse Point Clouds

Exploit Spatiotemporal Contextual Information for 3D Single Object Tracking Via Memory Networks

PointSiamRCNN: Target-aware Voxel-based Siamese Tracker for Point Clouds

OST: Efficient One-stream Network for 3D Single Object Tracking in Point Clouds

Exploiting More Information in Sparse Point Cloud for 3D Single Object Tracking

Centralized Motion-Aware Enhancement for Single Object Tracking on Point Clouds

Integrating Scaling Strategy and Central Guided Voting for 3D Point Cloud Object Tracking

Structure Aware Single-Stage 3D Object Detection From Point Cloud

VoxelTrack: Exploring Multi-level Voxel Representation for 3D Point Cloud Object Tracking

CDTracker: Coarse-to-Fine Feature Matching and Point Densification for 3D Single-Object Tracking

VoxelTrack: Exploring Voxel Representation for 3D Point Cloud Object Tracking

DeepPCT: Single Object Tracking in Dynamic Point Cloud Sequences

Object Preserving Siamese Network for Single Object Tracking on Point Clouds

Spatio-Temporal Contextual Learning for Single Object Tracking on Point Clouds

M3SOT: Multi-frame, Multi-field, Multi-space 3D Single Object Tracking

Object-Preserving Siamese Network for Single-Object Tracking on Point Clouds

EasyTrack: Efficient and Compact One-stream 3D Point Clouds Tracker

Structure-aware multi-object discovery for weakly supervised tracking

Implicit and Efficient Point Cloud Completion for 3D Single Object Tracking