Abstract:Human Factors, Ahead of Print. BackgroundIn Physical Human–Robot Interaction (pHRI), the need to learn the robot's motor-control dynamics is associated with increased cognitive load. Eye-tracking metrics can help understand the dynamics of fluctuating mental workload over the course of learning.ObjectiveThe aim of this study was to test eye-tracking measures' sensitivity and reliability to variations in task difficulty, as well as their performance-prediction capability, in physical human–robot collaboration tasks involving an industrial robot for object comanipulation.MethodsParticipants (9M, 9F) learned to coperform a virtual pick-and-place task with a bimanual robot over multiple trials. Joint stiffness of the robot was manipulated to increase motor-coordination demands. The psychometric properties of eye-tracking measures and their ability to predict performance was investigated.ResultsStationary Gaze Entropy and pupil diameter were the most reliable and sensitive measures of workload associated with changes in task difficulty and learning. Increased task difficulty was more likely to result in a robot-monitoring strategy. Eye-tracking measures were able to predict the occurrence of success or failure in each trial with 70% sensitivity and 71% accuracy.ConclusionThe sensitivity and reliability of eye-tracking measures was acceptable, although values were lower than those observed in cognitive domains. Measures of gaze behaviors indicative of visual monitoring strategies were most sensitive to task difficulty manipulations, and should be explored further for the pHRI domain where motor-control and internal-model formation will likely be strong contributors to workload.ApplicationFuture collaborative robots can adapt to human cognitive state and skill-level measured using eye-tracking measures of workload and visual attention.

Towards Mixed-Initiative Human–Robot Interaction: Assessment of Discriminative Physiological and Behavioral Features for Performance Prediction

An adaptive human sensor framework for human–robot collaboration

Inspiring Real-Time Evaluation and Optimization of Human–Robot Interaction with Psychological Findings from Human–Human Interaction

Eye-Tracking in Physical Human–Robot Interaction: Mental Workload and Performance Prediction

Exploiting Inherent Human Motor Behaviour in the Online Personalisation of Human-Prosthetic Interfaces

Optimizing Human–Robot Teaming Performance through Q-Learning-Based Task Load Adjustment and Physiological Data Analysis

Coping with the variability in humans reward during simulated human-robot interactions through the coordination of multiple learning strategies

Intrinsically Motivated Autonomy in Human-Robot Interaction: Human Perception of Predictive Information in Robots

Coordinating human-robot collaboration by EEG-based human intention prediction and vigilance control

Is It Me or the Robot? A Critical Evaluation of Human Affective State Recognition in a Cognitive Task

An Affective Approach for Behavioral Performance Estimation and Induction

Continuous ErrP detections during multimodal human-robot interaction

Drivers' Manoeuvre Modelling and Prediction for Safe HRI

Human in the collaborative loop: a strategy for integrating human activity recognition and non-invasive brain-machine interfaces to control collaborative robots

EEG-Based Analysis of Brain Responses in Multi-Modal Human-Robot Interaction: Modulating Engagement

A Human-Robot Co-Manipulation Approach Based on Human Sensorimotor Information

An Analysis of Human-Robot Information Streams to Inform Dynamic Autonomy Allocation

Experimental Assessment of Human-Robot Teaming for Multi-Step Remote Manipulation with Expert Operators

Analyzing Human Perceptions of a MEDEVAC Robot in a Simulated Evacuation Scenario

The Critical Robot: Impact of Performance Feedback on Intrinsic Motivation, Self-Esteem and Psychophysiology in Human–Robot Interaction

Mixed-Initiative Human-Robot Teaming under Suboptimality with Online Bayesian Adaptation