Abstract:3D single object tracking within LIDAR point clouds is a pivotal task in computer vision, with profound implications for autonomous driving and robotics. However, existing methods, which depend solely on appearance matching via Siamese networks or utilize motion information from successive frames, encounter significant challenges. Issues such as similar objects nearby or occlusions can result in tracker drift. To mitigate these challenges, we design an innovative spatio-temporal bi-directional cross-frame distractor filtering tracker, named STMD-Tracker. Our first step involves the creation of a 4D multi-frame spatio-temporal graph convolution backbone. This design separates KNN graph spatial embedding and incorporates 1D temporal convolution, effectively capturing temporal fluctuations and spatio-temporal information. Subsequently, we devise a novel bi-directional cross-frame memory procedure. This integrates future and synthetic past frame memory to enhance the current memory, thereby improving the accuracy of iteration-based tracking. This iterative memory update mechanism allows our tracker to dynamically compensate for information in the current frame, effectively reducing tracker drift. Lastly, we construct spatially reliable Gaussian masks on the fused features to eliminate distractor points. This is further supplemented by an object-aware sampling strategy, which bolsters the efficiency and precision of object localization, thereby reducing tracking errors caused by distractors. Our extensive experiments on KITTI, NuScenes and Waymo datasets demonstrate that our approach significantly surpasses the current state-of-the-art methods.

Object tracking with 3D LIDAR via multi-task sparse learning

Exploit Spatiotemporal Contextual Information for 3D Single Object Tracking Via Memory Networks

Real-time dynamic obstacle detection and tracking using 3D Lidar

LiDAR Video Object Segmentation with Dynamic Kernel Refinement

Robust vehicle detection using 3D Lidar under complex urban environment

3D Multi-object Detection and Tracking with Sparse Stationary LiDAR

Learning the Incremental Warp for 3D Vehicle Tracking in LiDAR Point Clouds

Exploiting More Information in Sparse Point Cloud for 3D Single Object Tracking

Object-Level Pseudo-3D Lifting for Distance-Aware Tracking

Spatio-Temporal Bi-directional Cross-frame Memory for Distractor Filtering Point Cloud Single Object Tracking

Tracking in Multimedia Data Via Robust Reweighted Local Multi-Task Sparse Representation for Transportation Surveillance

Small Object Tracking in LiDAR Point Cloud: Learning the Target-awareness Prototype and Fine-grained Search Region

Tracking from Patterns: Learning Corresponding Patterns in Point Clouds for 3D Object Tracking

Probabilistic 3D Multi-Modal, Multi-Object Tracking for Autonomous Driving

Real-Time Motion Tracking for Indoor Moving Sphere Objects with a LiDAR Sensor

Dynamic Object Tracking for Self-Driving Cars Using Monocular Camera and LIDAR.

Monocular Quasi-Dense 3D Object Tracking

Roadside LiDAR Vehicle Detection and Tracking Using Range and Intensity Background Subtraction

TRLO: An Efficient LiDAR Odometry with 3D Dynamic Object Tracking and Removal

Real-Time Three-Dimensional Tracking of Distant Moving Objects Using Non-Imaging Single-Pixel LiDAR

VoxelTrack: Exploring Voxel Representation for 3D Point Cloud Object Tracking