Abstract:Collaborative manipulation task often requires negotiation using explicit or implicit communication. An important example is determining where to move when the goal destination is not uniquely specified, and who should lead the motion. This work is motivated by the ability of humans to communicate the desired destination of motion through back-and-forth force exchanges. Inherent to these exchanges is also the ability to dynamically assign a role to each participant, either taking the initiative or deferring to the partner's lead. In this paper, we propose a hierarchical robot control framework that emulates human behavior in communicating a motion destination to a human collaborator and in responding to their actions. At the top level, the controller consists of a set of finite-state machines corresponding to different levels of commitment of the robot to its desired goal configuration. The control architecture is loosely based on the human strategy observed in the human-human experiments, and the key component is a real-time intent recognizer that helps the robot respond to human actions. We describe the details of the control framework, and feature engineering and training process of the intent recognition. The proposed controller was implemented on a UR10e robot (Universal Robots) and evaluated through human studies. The experiments show that the robot correctly recognizes and responds to human input, communicates its intent clearly, and resolves conflict. We report success rates and draw comparisons with human-human experiments to demonstrate the effectiveness of the approach.

Knowledge-Based Autonomous Behavior Control of Robots in A Symbiotic Human-Robot System

Knowledge Model-Based Adaptive Intelligent Control Of Robots For A Symbiotic Human-Robot System

Platform-Based Teleoperation Control of Symbiotic Human-Robot System.

Knowledge model-based heterogeneous multi-robot system implemented by a software platform

Human-robot Interaction Control for Industrial Robot Arm Through Software Platform for Agents and Knowledge Management.

A Knowledge Model-Based Coordinator Robot for Symbiotic Autonomous Human-Robot System

Construction of Heterogeneous Multi-Robot System Based on Knowledge Model

The 18 th Annual Conference of the Japanese Society for Artificial Intelligence , 2004 Cooperative Operation of Symbiotic Human-Robot System Through SPAK 3 G 203

Knowledge-based multiple robots coordinative operation using software platform

A Frame-Based Knowledge Model for Heterogeneous Multi-Robot System

Proactive Robot Control for Collaborative Manipulation Using Human Intent

A Universal Self-Adaption Workspace Mapping Method for Human–Robot Interaction Using Kinect Sensor Data

Knowledge-based Person-Centric Human-Robot Interaction Using Facial and Hand Gestures

A Dynamic Behavior Control Framework for Physical Human-Robot Interaction

Human Intention-Aware Motion Planning and Adaptive Fuzzy Control for a Collaborative Robot With Flexible Joints

An Experimental Autonomous Articulated Robot that can Learn

A Behavior Control Scheme for Multi-Robot Systems under Human Intervention

Complex Task Oriented Cooperation Between A Human Operator And Multiple Mobile Robots

“Follower” to “Collaborator”: A robot proactive collaborative controller based on human multimodal information for 3D handling/assembly scenarios

Bidirectional Communication Control for Human-Robot Collaboration

A Human-Robot Co-Manipulation Approach Based on Human Sensorimotor Information