Human Following in Mobile Platforms with Person Re-Identification

Mario Srouji,Yao-Hung Hubert Tsai,Hugues Thomas,Jian Zhang
2023-09-22
Abstract:Human following is a crucial feature of human-robot interaction, yet it poses numerous challenges to mobile agents in real-world scenarios. Some major hurdles are that the target person may be in a crowd, obstructed by others, or facing away from the agent. To tackle these challenges, we present a novel person re-identification module composed of three parts: a 360-degree visual registration, a neural-based person re-identification using human faces and torsos, and a motion tracker that records and predicts the target person's future position. Our human-following system also addresses other challenges, including identifying fast-moving targets with low latency, searching for targets that move out of the camera's sight, collision avoidance, and adaptively choosing different following mechanisms based on the distance between the target person and the mobile agent. Extensive experiments show that our proposed person re-identification module significantly enhances the human-following feature compared to other baseline variants.
Robotics
What problem does this paper attempt to address?
The paper attempts to address the problem of implementing reliable "person-following" functionality on mobile platforms. Specifically, the paper focuses on how to enable mobile robots to effectively and accurately follow a designated target person in various complex real-world scenarios. These complex scenarios include situations where the target person may be in a crowd, obscured by others, or facing away from the robot. To tackle these challenges, the paper proposes a new person re-identification module, which consists of three parts: 360-degree visual registration, neural network-based human re-identification (using facial and torso features), and a motion tracker to record and predict the future position of the target person. The main goal of the paper is to design a person-following system that meets the following requirements: 1. The robot can follow the target person even if the person moves quickly or faces away from the robot. 2. The robot can search for and find the target when the target person leaves the camera's field of view. 3. The robot can avoid obstacles while following the target. 4. The robot can recognize and follow the target even if the target person is in a crowd. Through these improvements, the paper aims to enhance the performance of mobile robots in practical applications, particularly in scenarios involving human-robot interaction such as autonomous delivery, hospital care, household cleaning, and remote communication.