Abstract:Human-robot interaction (HRI) is a rapidly growing field that encompasses social and industrial applications. Machine learning plays a vital role in industrial HRI by enhancing the adaptability and autonomy of robots in complex environments. However, data privacy is a crucial concern in the interaction between humans and robots, as companies need to protect sensitive data while machine learning algorithms require access to large datasets. Federated Learning (FL) offers a solution by enabling the distributed training of models without sharing raw data. Despite extensive research on Federated learning (FL) for tasks such as natural language processing (NLP) and image classification, the question of how to use FL for HRI remains an open research problem. The traditional FL approach involves transmitting large neural network parameter matrices between the server and clients, which can lead to high communication costs and often becomes a bottleneck in FL. This paper proposes a communication-efficient FL framework for human-robot interaction (CEFHRI) to address the challenges of data heterogeneity and communication costs. The framework leverages pre-trained models and introduces a trainable spatiotemporal adapter for video understanding tasks in HRI. Experimental results on three human-robot interaction benchmark datasets: HRI30, InHARD, and COIN demonstrate the superiority of CEFHRI over full fine-tuning in terms of communication costs. The proposed methodology provides a secure and efficient approach to HRI federated learning, particularly in industrial environments with data privacy concerns and limited communication bandwidth. Our code is available at <a class="link-external link-https" href="https://github.com/umarkhalidAI/CEFHRI-Efficient-Federated-Learning" rel="external noopener nofollow">this https URL</a>.

Integration of Tracking, Re-Identification, and Gesture Recognition for Facilitating Human-Robot Interaction

An IoT-Enabled Telerobotic-Assisted Healthcare System Based on Inertial Motion Capture.

A Gait Recognition System for Interaction with a Homecare Mobile Robot

Design of Kinect-Based Human Robot Interaction Systems for A Robocup Middle Size League Soccer Robot

A Facial Expression Emotion Recognition Based Human-robot Interaction System

Study of Human–Robot Interactions for Assistive Robots Using Machine Learning and Sensor Fusion Technologies

A Novel Gesture Recognition System for Intelligent Interaction with a Nursing-Care Assistant Robot

FollowMe: a Robust Person Following Framework Based on Re-Identification and Gestures

Implementation of Engagement Detection for Human–Robot Interaction in Complex Environments

Enhancing Human–Robot Collaboration through a Multi-Module Interaction Framework with Sensor Fusion: Object Recognition, Verbal Communication, User of Interest Detection, Gesture and Gaze Recognition

A Universal Self-Adaption Workspace Mapping Method for Human–Robot Interaction Using Kinect Sensor Data

HSMR: A Head-Shoulder Mask Aided ResNet to Guide Focus of Re-Identification Implemented on Tour-Guide Robot.

Online Recognition of Incomplete Gesture Data to Interface Collaborative Robots

Multimodal information fusion for human-robot interaction

Real-Time Multi-modal Human-Robot Collaboration Using Gestures and Speech

Human-robot interactions in autonomous hospital transports

Multimodal fusion and human-robot interaction control of an intelligent robot

Continuous Hand Gestures Detection and Recognition in Emergency Human-Robot Interaction Based on the Inertial Measurement Unit

CEFHRI: A Communication Efficient Federated Learning Framework for Recognizing Industrial Human-Robot Interaction

Human-to-Robot Handover Based on Reinforcement Learning

Hands-On Robotics: Enabling Communication Through Direct Gesture Control