FollowMe: a Robust Person Following Framework Based on Re-Identification and Gestures

Federico Rollo,Andrea Zunino,Gennaro Raiola,Fabio Amadio,Arash Ajoudani,Nikolaos Tsagarakis

DOI: https://doi.org/10.1109/ARSO56563.2023.10187536

2023-11-22

Abstract:Human-robot interaction (HRI) has become a crucial enabler in houses and industries for facilitating operational flexibility. When it comes to mobile collaborative robots, this flexibility can be further increased due to the autonomous mobility and navigation capacity of the robotic agents, expanding their workspace and consequently, the personalizable assistance they can provide to the human operators. This however requires that the robot is capable of detecting and identifying the human counterpart in all stages of the collaborative task, and in particular while following a human in crowded workplaces. To respond to this need, we developed a unified perception and navigation framework, which enables the robot to identify and follow a target person using a combination of visual Re-Identification (Re-ID), hand gestures detection, and collision-free navigation. The Re-ID module can autonomously learn the features of a target person and use the acquired knowledge to visually re-identify the target. The navigation stack is used to follow the target avoiding obstacles and other individuals in the environment. Experiments are conducted with few subjects in a laboratory setting where some unknown dynamic obstacles are introduced.

Robotics,Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to implement a robust human - following system in mobile robots. Specifically, the paper focuses on how to enable the robot to identify and follow a specific target person through visual re - identification (Re - ID) and gesture detection techniques in complex working environments, such as crowded situations. This system aims to improve the safety, robustness and reliability of human - robot interaction, especially in application scenarios where robots are required to provide personalized assistance, such as carrying heavy objects, moving between different workstations to perform tasks, collaborating to complete tasks, and providing help for people in need of care. The FollowMe framework in the paper realizes efficient tracking of the target person by combining visual re - identification, gesture detection and obstacle - avoidance navigation modules, and can maintain high accuracy even when the target person is dressed similarly to other individuals or the environmental lighting conditions are poor.