Abstract:To overcome novel challenges in complex domestic environments, humanoid robots can learn from human teachers. We propose that the capability for social interaction should be a key factor in this teaching process and benefits both the subjective experience of the human user and the learning process itself. To support our hypothesis, we present a Human-Robot Interaction study on human-assisted visuomotor learning with the robot NICO, the Neuro-Inspired COmpanion, a child-sized humanoid. NICO is a flexible, social platform with sensing and manipulation abilities. We give a detailed description of NICO's design and a comprehensive overview of studies that use or evaluate NICO. To engage in social interaction, NICO can express stylized facial expressions and utter speech via an Embodied Dialogue System. NICO is characterized in particular by combining these social interaction capabilities with the abilities for human-like object manipulation and crossmodal perception. In the presented study, NICO acquires visuomotor grasping skills by interacting with its environment. In contrast to methods like motor babbling, the learning process is, in part, supported by a human teacher. To begin the learning process, an object is placed into NICO's hand, and if this object is accidentally dropped, the human assistant has to recover it. The study is conducted with 24 participants with little or no prior experience with robots. In the robot-guided experimental condition, assistance is actively requested by NICO via the Embodied Dialogue System. In the human-guided condition, instructions are given by a human experimenter, while NICO remains silent. Evaluation using established questionnaires like Godspeed, Mind Perception, and Uncanny Valley Indices, along with a structured interview and video analysis of the interaction, show that the robot's active requests for assistance foster the participant's engagement and benefit the learning process. This result supports the hypothesis that the ability for social interaction is a key factor for companion robots that learn with the help of non-expert teachers, as these robots become capable of communicating active requests or questions that are vital to their learning process. We also show how the design of NICO both enables and is driven by this approach.

NAO Robot Learns to Interact with Humans through Imitation Learning from Video Observation

Motion Imitation of a Humanoid Robot Via Pose Estimation

Learning Human Body Motions from Skeleton-Based Observations for Robot-Assisted Therapy

Imitation of human motion achieves natural head movements for humanoid robots in an active-speaker detection task

OKAMI: Teaching Humanoid Robots Manipulation Skills through Single Video Imitation

Algorithm of Human Posture Action Recognition and Imitation for Robots

AIR-Act2Act: Human-human interaction dataset for teaching non-verbal social behaviors to robots

Human Posture Recognition and Gesture Imitation with a Humanoid Robot

Teaching NICO How to Grasp: An Empirical Study on Crossmodal Social Interaction as a Key Factor for Robots Learning From Humans

Improving Human-Robot Interaction by Enhancing NAO Robot Awareness of Human Facial Expression

A Human–Robot Collaboration Method Using a Pose Estimation Network for Robot Learning of Assembly Manipulation Trajectories From Demonstration Videos

Humanoid Robot Imitation with Pose Similarity Metric Learning

Robot See Robot Do: Imitating Articulated Object Manipulation with Monocular 4D Reconstruction

One-Shot Imitation from Observing Humans via Domain-Adaptive Meta-Learning

3D perception from binocular vision for a low cost humanoid robot NAO

Robotic Imitation of Human Actions

Visual Imitation Made Easy

Learning dexterity from human hand motion in internet videos

Imitating by Generating: Deep Generative Models for Imitation of Interactive Tasks

Unsupervised Motion Retargeting for Human-Robot Imitation

MimicPlay: Long-Horizon Imitation Learning by Watching Human Play