Abstract:The pedestrian-following robot aims to robustly maintain a standard distance from a specific pedestrian in an unknown complex environment, which is challenging when facing the limited field of view (FOV) and the computing resource constraints. However, the pedestrian-following robot commonly utilizes the long range dependence of targets to construct tracking models via the transformer tracking method, which is often insufficient to achieve real-time following. To address this important issue, we propose a new fast tracking network for the following robot, including a lightweight target detector, a target state prediction decoder, and an adaptive visual servo controller. First, in the lightweight target detector, a dense feature extraction process is designed by stacking depthwise group-separable convolutions. A context encoder is also developed, and is coupled with the proposed person re-identification (Re-ID) branch to detect multiple targets with high precision and speed. Second, in the target state prediction decoder, we introduce a flexible multiattention mechanism to obtain target Re-ID features from the previous frame for predicting the target's position in the current frame. Third, in the adaptive visual servo controller, we design a six-parameter dynamic model for the proportional integral derivative (PID) controller to stably follow the pedestrian under the limited FOV. Extensive experimental results demonstrate that the proposed method is efficient and accurate. Moreover, it also exhibits strong robustness and high real-time performance in unknown complex environments.

Target Tracking For Mobile Robot Based On Spatio-Temporal Context Model

Exploit Spatiotemporal Contextual Information for 3D Single Object Tracking Via Memory Networks

Beyond Traditional Driving Scenes: A Robotic-Centric Paradigm for 2D+3D Human Tracking Using Siamese Transformer Network

Improved Target Tracking Based On Spatio-Temporal Learning

Robust Spatio-Temporal Context for Infrared Target Tracking

An Improved Target Tracking Algorithm Based on Spatio-Temporal Context under Occlusions

Moving Target Detection and Tracking Algorithm Based on Context Information.

The Moving Target Recognition and Tracking Using RGB-D Data with the Mobile Robot

Binocular Based Moving Target Tracking for Mobile Robot

Real-time Target Tracking System for Person-Following Robot

Adaptive Spatio-Temporal Context Learning for Visual Tracking

Target tracking based on heterogeneous sensor information fusion in intelligent space

Adaptive Visual Tracking Based on Discriminative Feature Selection for Mobile Robot

Continuous Robotic Tracking of Dynamic Targets in Complex Environments Based on Detectability

Robust Visual Tracking Integrating Spatio-Temporal Model

Visual Tracking Via Spatio-temporal Context Learning Using Multi-Templates

An Efficient And Robust Visual Tracking Via Color-Based Context Prior Model

A Fast Tracking Network for Pedestrian Following of Mobile Robot in Unknown Complex Scenes

VisuaI Tracking Using Adaptive Structure ModeI Based on Spatio-TemporaI Context

Human Tracking Based on Multi-Feature for Intelligent Robot Under the CTF Locating Strategy

A Real-time Moving Target Following Mobile Robot System with Depth Camera