Brain Responses During Robot-Error Observation

Dominik Welke,Joos Behncke,Marina Hader,Robin Tibor Schirrmeister,Andreas Schönau,Boris Eßmann,Oliver Müller,Wolfram Burgard,Tonio Ball

DOI: https://doi.org/10.17185/duepublico/44533

2017-08-16

Abstract:Brain-controlled robots are a promising new type of assistive device for severely impaired persons. Little is however known about how to optimize the interaction of humans and brain-controlled robots. Information about the human's perceived correctness of robot performance might provide a useful teaching signal for adaptive control algorithms and thus help enhancing robot control. Here, we studied whether watching robots perform erroneous vs. correct action elicits differential brain responses that can be decoded from single trials of electroencephalographic (EEG) recordings, and whether brain activity during human-robot interaction is modulated by the robot's visual similarity to a human. To address these topics, we designed two experiments. In experiment I, participants watched a robot arm pour liquid into a cup. The robot performed the action either erroneously or correctly, i.e. it either spilled some liquid or not. In experiment II, participants observed two different types of robots, humanoid and non-humanoid, grabbing a ball. The robots either managed to grab the ball or not. We recorded high-resolution EEG during the observation tasks in both experiments to train a Filter Bank Common Spatial Pattern (FBCSP) pipeline on the multivariate EEG signal and decode for the correctness of the observed action, and for the type of the observed robot. Our findings show that it was possible to decode both correctness and robot type for the majority of participants significantly, although often just slightly, above chance level. Our findings suggest that non-invasive recordings of brain responses elicited when observing robots indeed contain decodable information about the correctness of the robot's action and the type of observed robot.

Human-Computer Interaction,Machine Learning,Robotics

What problem does this paper attempt to address?

The problems that this paper attempts to solve mainly focus on two aspects:

1. **Human Brain Reactions to Robots' Erroneous Behaviors**: Researchers hope to understand whether differential reactions can be detected from human brain activities when humans observe robots making mistakes during task execution compared to when they perform tasks correctly. If such differential reactions can be effectively decoded, they can serve as useful signals for machine - learning algorithms and help optimize robot control in human - robot interactions.

2. **The Influence of Robot Appearance on Human Brain Activities**: In addition, the research also explores whether the anthropomorphism of robot appearance (i.e., how much the robot looks like a human) will affect the pattern of human brain activities when observing robots performing tasks. Specifically, researchers designed experiments to observe the electroencephalogram (EEG) changes of participants when two different types of robots (anthropomorphic and non - anthropomorphic) perform the same task, in order to evaluate the influence of the robots' visual similarity on human brain activities.

Through research in these two aspects, the paper aims to explore how to optimize human - robot interactions from the perspective of neuroscience, especially for brain - controlled robot systems that require highly adaptive control. This not only helps improve the performance of robots in assisting disabled people, etc., but also provides important theoretical foundations and technical support for more complex human - robot collaboration scenarios in the future.