Abstract:We conducted a user study for which we purposefully programmed faulty behavior into a robot’s routine. It was our aim to explore if participants rate the faulty robot different from an error-free robot and which reactions people show in interaction with a faulty robot. The study was based on our previous research on robot errors where we detected typical error situations and the resulting social signals of our participants during social human–robot interaction. In contrast to our previous work, where we studied video material in which robot errors occurred unintentionally, in the herein reported user study, we purposefully elicited robot errors to further explore the human interaction partners’ social signals following a robot error. Our participants interacted with a human-like NAO, and the robot either performed faulty or free from error. First, the robot asked the participants a set of predefined questions and then it asked them to complete a couple of LEGO building tasks. After the interaction, we asked the participants to rate the robot’s anthropomorphism, likability, and perceived intelligence. We also interviewed the participants on their opinion about the interaction. Additionally, we video-coded the social signals the participants showed during their interaction with the robot as well as the answers they provided the robot with. Our results show that participants liked the faulty robot significantly better than the robot that interacted flawlessly. We did not find significant differences in people’s ratings of the robot’s anthropomorphism and perceived intelligence. The qualitative data confirmed the questionnaire results in showing that although the participants recognized the robot’s mistakes, they did not necessarily reject the erroneous robot. The annotations of the video data further showed that gaze shifts (e.g., from an object to the robot or vice versa) and laughter are typical reactions to unexpected robot behavior. In contrast to existing research, we assess dimensions of user experience that have not been considered so far and we analyze the reactions users express when a robot makes a mistake. Our results show that decoding a human’s social signals can help the robot understand that there is an error and subsequently react accordingly.

How Do Users Interact with an Error-Prone In-Air Gesture Recognizer?

To Err Is Robot: How Humans Assess and Act toward an Erroneous Social Robot

3D Intuitive Gesture Interaction via Motion Sensing

User-Defined Gestures for Gestural Interaction: Extending from Hands to Other Body Parts

Which One to Go: Security and Usability Evaluation of Mid-Air Gestures.

Pilot Error and Error Recovery

Human-in-the-loop error detection in an object organization task with a social robot

Pilot Intention Recognition under Risk Environment Based on Eye-movement Data

High Five: Improving Gesture Recognition by Embracing Uncertainty

Evaluating User-Elicited Gestures for Physical Peripheral Interaction with Smart Devices.

Online Recognition of Incomplete Gesture Data to Interface Collaborative Robots

Continuous ErrP detections during multimodal human-robot interaction

User Training with Error Augmentation for Electromyogram-based Gesture Classification

Learning End-User Customized Mid-Air Hand Gestures Using a Depth Image Sensor

Research on Error Handling Techniques for Speech Interaction

Modeling Human Response to Robot Errors for Timely Error Detection

An empirical evaluation for defining a mid-air gesture dictionary for web-based interaction

Evaluating Data-Driven Co-Speech Gestures of Embodied Conversational Agents through Real-Time Interaction

XR Input Error Mediation for Hand-Based Input: Task and Context Influences a User's Preference

A pilot study of comparison gesture analysis in motion driven video games

User Training With Error Augmentation for sEMG-Based Gesture Classification