Abstract:3D single object tracking in LiDAR point clouds (LiDAR SOT) plays a crucial role in autonomous driving. Current approaches all follow the Siamese paradigm based on appearance matching. However, LiDAR point clouds are usually textureless and incomplete, which hinders effective appearance matching. Besides, previous methods greatly overlook the critical motion clues among targets. In this work, beyond 3D Siamese tracking, we introduce a motion-centric paradigm to handle LiDAR SOT from a new perspective. Following this paradigm, we propose a matching-free two-stage tracker M 2-Track. At the 1st-stage, M2-Track localizes the target within successive frames via motion transformation. Then it refines the target box through motion-assisted shape completion at the 2nd-stage. Due to the motion-centric nature, our method shows its impressive generalizability with limited training labels and provides good differentiability for end-to-end cycle training. This inspires us to explore semi-supervised LiDAR SOT by incorporating a pseudo-label-based motion augmentation and a self-supervised loss term. Under the fully-supervised setting, extensive experiments confirm that M2-Track significantly outperforms previous state-of-the-arts on three large-scale datasets while running at 57FPS ( ∼ 3%, ∼ 11% and ∼ 22% precision gains on KITTI, NuScenes, and Waymo Open Dataset respectively). While under the semi-supervised setting, our method performs on par with or even surpasses its fully-supervised counterpart using fewer than half labels from KITTI. Further analysis verifies each component's effectiveness and shows the motion-centric paradigm's promising potential for auto-labeling and unsupervised domain adaptation.

Fast Segmentation-Based Object Tracking Model for Autonomous Vehicles

LiDAR Video Object Segmentation with Dynamic Kernel Refinement

YolTrack: Multitask Learning Based Real-Time Multiobject Tracking and Segmentation for Autonomous Vehicles

Towards Real-Time Multi-Object Tracking

Dynamic Object Tracking for Self-Driving Cars Using Monocular Camera and LIDAR.

A Tracking-By-Detection Based 3D Multiple Object Tracking for Autonomous Driving

LIFTS: Lidar and Monocular Image Fusion for Multi-Object Tracking and Segmentation

DFR-FastMOT: Detection Failure Resistant Tracker for Fast Multi-Object Tracking Based on Sensor Fusion

Multiple Moving Vehicles Tracking Algorithm with Attention Mechanism and Motion Model

An Efficient Real-Time Object Detection and Tracking Framework Based on Lidar and Ins

Multiple-Kernel Based Vehicle Tracking Using 3D Deformable Model and Camera Self-Calibration

Online Multiple Object Tracking Using a Novel Discriminative Module for Autonomous Driving

An IMM-Enabled Adaptive 3D Multi-Object Tracker for Autonomous Driving

Multiple Object Tracking Using a Dual‐attention Network for Autonomous Driving

Spatial-Semantic and Temporal Attention Mechanism-Based Online Multi-Object Tracking

Design of a Robust System Architecture for Tracking Vehicle on Highway Based on Monocular Camera

Semantically Enhanced Multi-Object Detection and Tracking for Autonomous Vehicles.

Multi-object Tracking for Autonomous Driving with a Monocular Camera Subject to Missing Data

An Effective Motion-Centric Paradigm for 3D Single Object Tracking in Point Clouds

Multi-Stream Siamese and Faster Region-Based Neural Network for Real-Time Object Tracking

HybridTrack: A Hybrid Approach for Robust Multi-Object Tracking