Abstract:3D single object tracking in LiDAR point clouds (LiDAR SOT) plays a crucial role in autonomous driving. Current approaches all follow the Siamese paradigm based on appearance matching. However, LiDAR point clouds are usually textureless and incomplete, which hinders effective appearance matching. Besides, previous methods greatly overlook the critical motion clues among targets. In this work, beyond 3D Siamese tracking, we introduce a motion-centric paradigm to handle LiDAR SOT from a new perspective. Following this paradigm, we propose a matching-free two-stage tracker M 2-Track. At the 1st-stage, M2-Track localizes the target within successive frames via motion transformation. Then it refines the target box through motion-assisted shape completion at the 2nd-stage. Due to the motion-centric nature, our method shows its impressive generalizability with limited training labels and provides good differentiability for end-to-end cycle training. This inspires us to explore semi-supervised LiDAR SOT by incorporating a pseudo-label-based motion augmentation and a self-supervised loss term. Under the fully-supervised setting, extensive experiments confirm that M2-Track significantly outperforms previous state-of-the-arts on three large-scale datasets while running at 57FPS ( ∼ 3%, ∼ 11% and ∼ 22% precision gains on KITTI, NuScenes, and Waymo Open Dataset respectively). While under the semi-supervised setting, our method performs on par with or even surpasses its fully-supervised counterpart using fewer than half labels from KITTI. Further analysis verifies each component's effectiveness and shows the motion-centric paradigm's promising potential for auto-labeling and unsupervised domain adaptation.

Learning the Incremental Warp for 3D Vehicle Tracking in LiDAR Point Clouds

Object tracking with 3D LIDAR via multi-task sparse learning

Exploit Spatiotemporal Contextual Information for 3D Single Object Tracking Via Memory Networks

Weighted Incremental Subspace Learning Algorithm Suitable for Object Tracking

Beyond Traditional Driving Scenes: A Robotic-Centric Paradigm for 2D+3D Human Tracking Using Siamese Transformer Network

Integrating Scaling Strategy and Central Guided Voting for 3D Point Cloud Object Tracking

Tracking from Patterns: Learning Corresponding Patterns in Point Clouds for 3D Object Tracking

OS-DS tracker: Orientation-variant Siamese 3D tracking with Detection based Sampling

Small Object Tracking in LiDAR Point Cloud: Learning the Target-awareness Prototype and Fine-grained Search Region

An Effective Motion-Centric Paradigm for 3D Single Object Tracking in Point Clouds

Spatio-Temporal Bi-directional Cross-frame Memory for Distractor Filtering Point Cloud Single Object Tracking

Toward Class-Agnostic Tracking Using Feature Decorrelation in Point Clouds

TRLO: An Efficient LiDAR Odometry with 3D Dynamic Object Tracking and Removal

3D Object Tracking with Transformer

VoxelTrack: Exploring Voxel Representation for 3D Point Cloud Object Tracking

Receding Moving Object Segmentation in 3D LiDAR Data Using Sparse 4D Convolutions

Future Does Matter: Boosting 3D Object Detection with Temporal Motion Estimation in Point Cloud Sequences

3D Multi-object Detection and Tracking with Sparse Stationary LiDAR

Learning Moving-Object Tracking with FMCW LiDAR

PWCLO-Net: Deep LiDAR Odometry in 3D Point Clouds Using Hierarchical Embedding Mask Optimization

Beyond 3D Siamese Tracking: A Motion-Centric Paradigm for 3D Single Object Tracking in Point Clouds