Abstract:The objective was to investigate the impacts of the robot's dynamic affective expressions in task-related scenarios on human–robot collaboration (HRC) and performance in human–robot collaborative assembly tasks in flexible manufacturing. A human–robot hybrid cell was developed to facilitate a human co-worker and a robot to collaborate to assemble a few parts into a final product. The collaborative robot was a humanoid manufacturing robot with the ability to display its affective states due to changes in task scenarios on its face. The assembly task was divided into several subtasks, and based on an optimization strategy, the subtasks were optimally allocated to the human and the robot. A computational model of the robot's affective states was derived inspired by that of humans following the biomimetic approach, and an affect-based motion planning strategy for the robot was proposed to enable the robot to adjust its motions and behaviors with task situations and communicate (inform) the situations to the human co-worker through affective expressions. The HRC and the assembly performance for the affect-based motion planning were experimentally evaluated based on a comprehensive evaluation scheme and were compared with two alternative conditions: (i) motion planning that did not display affective states, and (ii) motion planning that displayed text messages instead of displaying affective states to communicate the situations to the human co-worker. The results clearly showed that the dynamic affect-based motion planning produced significantly better HRC and assembly performance than that produced by motion planning associated with the display of no affective states or text messages. The results encouraged employing manufacturing robots with dynamic affective expressions to collaborate with humans in flexible assembly in manufacturing to improve HRC and assembly performance.

What problem does this paper attempt to address?

This paper discusses the impact of dynamic emotional expression of humanoid robots on collaboration and performance in human-robot collaborative assembly tasks in the manufacturing industry. The study establishes a human-robot mixed work unit in which the robot can display its emotional state through facial expressions. The paper proposes an emotion-based motion planning strategy that allows the robot to adjust its actions and behaviors according to the task context and communicate with human counterparts through emotional expressions. The experiment compares the effects of dynamic emotional expression, displaying text information, and no emotional expression on collaboration and assembly performance in motion planning. The results show that dynamic emotional expression significantly improves collaboration and performance. Specifically, the paper attempts to address the following questions: 1. How to utilize the robot's emotional expression to enhance the naturalness and efficiency of human-robot collaboration (HRC)? 2. How to design a comprehensive evaluation framework to measure the interaction and assembly performance in the human-robot collaboration unit? 3. How does the robot's emotional expression affect collaboration and performance compared to displaying text information or no emotional expression? The research found that the robot's emotional expression can enhance transparency, serve as non-verbal visual guidance, influence human cognition, and can be combined with other communication methods. However, there is currently a lack of research on the effectiveness of these combinations. The paper also proposes an approach to divide tasks into subtasks and optimize the allocation to humans and robots to achieve parallel work and improve overall assembly performance. Finally, the paper evaluates the contribution of robot emotional expression to human-robot interaction and assembly performance through experiments and compares it with other communication methods.

Dynamic Affect-Based Motion Planning of a Humanoid Robot for Human-Robot Collaborative Assembly in Manufacturing

Proactive Human-Robot Co-Assembly: Leveraging Human Intention Prediction and Robust Safe Control

Human-in-the-loop Robotic Manipulation Planning for Collaborative Assembly

“Follower” to “Collaborator”: A robot proactive collaborative controller based on human multimodal information for 3D handling/assembly scenarios

An Attention-Based Deep Learning Approach for Inertial Motion Recognition and Estimation in Human-Robot Collaboration

Human Intention-Aware Motion Planning and Adaptive Fuzzy Control for a Collaborative Robot With Flexible Joints

A Hybrid Task-Constrained Motion Planning for Collaborative Robots in Intelligent Remanufacturing

A Cooperative Shared Control Scheme Based on Intention Recognition for Flexible Assembly Manufacturing

An approach for task and action planning in Human–Robot Collaborative cells using AI

Enhancing the Mobile Humanoid Robot's Emotional Expression with Affective Vertical-Oscillations

Applications of affective computing in human-robot interaction: State-of-art and challenges for manufacturing

An intelligent manufacturing cell based on human–robot collaboration of frequent task learning for flexible manufacturing

Computational ergonomics for task delegation in Human-Robot Collaboration: spatiotemporal adaptation of the robot to the human through contactless gesture recognition

Proactive Robot Control for Collaborative Manipulation Using Human Intent

Human-robot collaborative assembly task planning for mobile cobots based on deep reinforcement learning

A human digital twin approach for fatigue-aware task planning in human-robot collaborative assembly

Affect-Driven Learning of Robot Behaviour for Collaborative Human-Robot Interactions

Robust Task Planning for Assembly Lines with Human-Robot Collaboration

Toward Proactive Human–Robot Collaborative Assembly: A Multimodal Transfer-Learning-Enabled Action Prediction Approach

A Vision-based Human Digital Twin Modelling Approach for Adaptive Human-Robot Collaboration

Communicating Robot Arm Motion Intent Through Mixed Reality Head-Mounted Displays