Abstract:Collaborative manipulation task often requires negotiation using explicit or implicit communication. An important example is determining where to move when the goal destination is not uniquely specified, and who should lead the motion. This work is motivated by the ability of humans to communicate the desired destination of motion through back-and-forth force exchanges. Inherent to these exchanges is also the ability to dynamically assign a role to each participant, either taking the initiative or deferring to the partner's lead. In this paper, we propose a hierarchical robot control framework that emulates human behavior in communicating a motion destination to a human collaborator and in responding to their actions. At the top level, the controller consists of a set of finite-state machines corresponding to different levels of commitment of the robot to its desired goal configuration. The control architecture is loosely based on the human strategy observed in the human-human experiments, and the key component is a real-time intent recognizer that helps the robot respond to human actions. We describe the details of the control framework, and feature engineering and training process of the intent recognition. The proposed controller was implemented on a UR10e robot (Universal Robots) and evaluated through human studies. The experiments show that the robot correctly recognizes and responds to human input, communicates its intent clearly, and resolves conflict. We report success rates and draw comparisons with human-human experiments to demonstrate the effectiveness of the approach.

Knowledge Model-Based Adaptive Intelligent Control Of Robots For A Symbiotic Human-Robot System

Knowledge-Based Autonomous Behavior Control of Robots in A Symbiotic Human-Robot System

Knowledge model-based heterogeneous multi-robot system implemented by a software platform

A Knowledge Model-Based Coordinator Robot for Symbiotic Autonomous Human-Robot System

Platform-Based Teleoperation Control of Symbiotic Human-Robot System.

Construction of Heterogeneous Multi-Robot System Based on Knowledge Model

Human-robot Interaction Control for Industrial Robot Arm Through Software Platform for Agents and Knowledge Management.

The 18 th Annual Conference of the Japanese Society for Artificial Intelligence , 2004 Cooperative Operation of Symbiotic Human-Robot System Through SPAK 3 G 203

A Frame-Based Knowledge Model for Heterogeneous Multi-Robot System

Knowledge-based multiple robots coordinative operation using software platform

A Universal Self-Adaption Workspace Mapping Method for Human–Robot Interaction Using Kinect Sensor Data

Human Intention-Aware Motion Planning and Adaptive Fuzzy Control for a Collaborative Robot With Flexible Joints

A human-aware control paradigm for human-robot interactions, a simulation study

Adaptive Visual Gesture Recognition for Human-Robot Interaction

Toward Open Knowledge Enabling for Human-Robot Interaction

Proactive Robot Control for Collaborative Manipulation Using Human Intent

Knowledge Sharing enabled Multi-Robot Collaboration for Preventive Maintenance in Mixed Model Assembly

An Experimental Autonomous Articulated Robot that can Learn

“Follower” to “Collaborator”: A robot proactive collaborative controller based on human multimodal information for 3D handling/assembly scenarios

Learning-model-based Control for Robot Manipulators Sensorless Kinesthetic Teaching Using Sparse Feature Dynamics

An Innovative Human-Robot Cognitive Coupling in Industrial Robot Control and Manufacturing