Abstract:LiDAR-based 3D single object tracking is a challenging issue in robotics and autonomous driving. Currently, existing approaches usually suffer from the problem that objects at long distance often have very sparse or partially-occluded point clouds, which makes the features extracted by the model ambiguous. Ambiguous features will make it hard to locate the target object and finally lead to bad tracking results. To solve this problem, we utilize the powerful Transformer architecture and propose a Point-Track-Transformer (PTT) module for point cloud-based 3D single object tracking task. Specifically, PTT module generates fine-tuned attention features by computing attention weights, which guides the tracker focusing on the important features of the target and improves the tracking ability in complex scenarios. To evaluate our PTT module, we embed PTT into the dominant method and construct a novel 3D SOT tracker named PTT-Net. In PTT-Net, we embed PTT into the voting stage and proposal generation stage, respectively. PTT module in the voting stage could model the interactions among point patches, which learns context-dependent features. Meanwhile, PTT module in the proposal generation stage could capture the contextual information between object and background. We evaluate our PTT-Net on KITTI and NuScenes datasets. Experimental results demonstrate the effectiveness of PTT module and the superiority of PTT-Net, which surpasses the baseline by a noticeable margin, $\sim$10% in the Car category. Meanwhile, our method also has a significant performance improvement in sparse scenarios. In general, the combination of transformer and tracking pipeline enables our PTT-Net to achieve state-of-the-art performance on both two datasets. Additionally, PTT-Net could run in real-time at 40FPS on NVIDIA 1080Ti GPU. Our code is open-sourced for the research community at https://github.com/shanjiayao/PTT.

Multi-modal 3D Human Tracking for Robots in Complex Environment with Siamese Point-Video Transformer

Beyond Traditional Driving Scenes: A Robotic-Centric Paradigm for 2D+3D Human Tracking Using Siamese Transformer Network

Accurate and Real-Time 3-D Tracking for the Following Robots by Fusing Vision and Ultrasonar Information

Multi-features Guided Robust Visual Tracking.

Real-time 3D Human Tracking for Mobile Robots with Multisensors

Tracking by segmentation with future motion estimation applied to person-following robots

CatTrack: Single-Stage Category-Level 6D Object Pose Tracking Via Convolution and Vision Transformer

Real-Time 3D Single Object Tracking With Transformer

VoxelTrack: Multi-Person 3D Human Pose Estimation and Tracking in the Wild

A multi-camera approach to tracking and localization of people with coexisting robots

Point Siamese Network for Person Tracking Using 3D Point Clouds.

Probabilistic 3D Multi-Modal, Multi-Object Tracking for Autonomous Driving

A Fast Tracking Network for Pedestrian Following of Mobile Robot in Unknown Complex Scenes

Robot Person Following in Uniform Crowd Environment

Multi features fragment-based human tracking for mobile robot

A Person-Following Method Based on Monocular Camera for Quadruped Robots

Audio-Visual Variational Fusion for Multi-Person Tracking with Robots

RPformer: A Robust Parallel Transformer for Visual Tracking in Complex Scenes

A Dynamic 3D Multi-Object Tracking Method Based on Spatiotemporal Features

Human Tracking System Based on Adaptive Multi-Feature Mean-Shift for Robot under the Double-Layer Locating Mechanism

Siamese Transformer Network: Building an Autonomous Real-Time Target Tracking System for UAV