Abstract:3D single object tracking in LiDAR point clouds (LiDAR SOT) plays a crucial role in autonomous driving. Current approaches all follow the Siamese paradigm based on appearance matching. However, LiDAR point clouds are usually textureless and incomplete, which hinders effective appearance matching. Besides, previous methods greatly overlook the critical motion clues among targets. In this work, beyond 3D Siamese tracking, we introduce a motion-centric paradigm to handle LiDAR SOT from a new perspective. Following this paradigm, we propose a matching-free two-stage tracker M 2-Track. At the 1st-stage, M2-Track localizes the target within successive frames via motion transformation. Then it refines the target box through motion-assisted shape completion at the 2nd-stage. Due to the motion-centric nature, our method shows its impressive generalizability with limited training labels and provides good differentiability for end-to-end cycle training. This inspires us to explore semi-supervised LiDAR SOT by incorporating a pseudo-label-based motion augmentation and a self-supervised loss term. Under the fully-supervised setting, extensive experiments confirm that M2-Track significantly outperforms previous state-of-the-arts on three large-scale datasets while running at 57FPS ( ∼ 3%, ∼ 11% and ∼ 22% precision gains on KITTI, NuScenes, and Waymo Open Dataset respectively). While under the semi-supervised setting, our method performs on par with or even surpasses its fully-supervised counterpart using fewer than half labels from KITTI. Further analysis verifies each component's effectiveness and shows the motion-centric paradigm's promising potential for auto-labeling and unsupervised domain adaptation.

Integrating Scaling Strategy and Central Guided Voting for 3D Point Cloud Object Tracking

Exploit Spatiotemporal Contextual Information for 3D Single Object Tracking Via Memory Networks

PointSiamRCNN: Target-aware Voxel-based Siamese Tracker for Point Clouds

Object tracking with 3D LIDAR via multi-task sparse learning

Multi-Level Structure-Enhanced Network for 3D Single Object Tracking in Sparse Point Clouds

An Effective Motion-Centric Paradigm for 3D Single Object Tracking in Point Clouds

VoxelTrack: Exploring Voxel Representation for 3D Point Cloud Object Tracking

OST: Efficient One-stream Network for 3D Single Object Tracking in Point Clouds

Exploiting More Information in Sparse Point Cloud for 3D Single Object Tracking

Beyond 3D Siamese Tracking: A Motion-Centric Paradigm for 3D Single Object Tracking in Point Clouds

EasyTrack: Efficient and Compact One-stream 3D Point Clouds Tracker

Accurate 3D Single Object Tracker With Local-to-Global Feature Refinement

PillarTrack: Redesigning Pillar-based Transformer Network for Single Object Tracking on Point Clouds

Facilitating 3D Object Tracking in Point Clouds with Image Semantics and Geometry.

Spatio-Temporal Bi-directional Cross-frame Memory for Distractor Filtering Point Cloud Single Object Tracking

GLT-T: Global-Local Transformer Voting for 3D Single Object Tracking in Point Clouds

DeepPCT: Single Object Tracking in Dynamic Point Cloud Sequences

Beyond Traditional Driving Scenes: A Robotic-Centric Paradigm for 2D+3D Human Tracking Using Siamese Transformer Network

MFITrack: Multi-Frame Integration Strategy for Enhanced Motion-Centric Single Object Tracking

CDTracker: Coarse-to-Fine Feature Matching and Point Densification for 3D Single-Object Tracking