Abstract:This work describes the design of real-time dance-based interaction with a humanoid robot, where the robot seeks to promote physical activity in children by taking on multiple roles as a dance partner. It acts as a leader by initiating dances but can also act as a follower by mimicking a child's dance movements. Dances in the leader role are produced by a sequence-to-sequence (S2S) Long Short-Term Memory (LSTM) network trained on children's music videos taken from YouTube. On the other hand, a music orchestration platform is implemented to generate background music in the follower mode as the robot mimics the child's poses. In doing so, we also incorporated the largely unexplored paradigm of learning-by-teaching by including multiple robot roles that allow the child to both learn from and teach to the robot. Our work is among the first to implement a largely autonomous, real-time full-body dance interaction with a bipedal humanoid robot that also explores the impact of the robot roles on child engagement. Importantly, we also incorporated in our design formal constructs taken from autism therapy, such as the least-to-most prompting hierarchy, reinforcements for positive behaviors, and a time delay to make behavioral observations. We implemented a multimodal child engagement model that encompasses both affective engagement (displayed through eye gaze focus and facial expressions) as well as task engagement (determined by the level of physical activity) to determine child engagement states. We then conducted a virtual exploratory user study to evaluate the impact of mixed robot roles on user engagement and found no statistically significant difference in the children's engagement in single-role and multiple-role interactions. While the children were observed to respond positively to both robot behaviors, they preferred the music-driven leader role over the movement-driven follower role, a result that can partly be attributed to the virtual nature of the study. Our findings support the utility of such a platform in practicing physical activity but indicate that further research is necessary to fully explore the impact of each robot role.

Character Synthesis of Ballet Archetypes on Robots Using Laban Movement Analysis: Comparison Between a Humanoid and an Aerial Robot Platform with Lay and Expert Observation

Choreographic and Somatic Approaches for the Development of Expressive Robotic Systems

Influence of Human–Computer Interaction-Based Intelligent Dancing Robot and Psychological Construct on Choreography

Robotic Choreography Inspired by the Method of Human Dance Creation

Residual Force Control for Agile Human Behavior Imitation and Extended Motion Synthesis

Learning Embodied Sound-Motion Mappings: Evaluating AI-Generated Dance Improvisation

Whole-body humanoid robot imitation with pose similarity evaluation

An automatic system for humanoid dance creation

Learning Responsive Humanoid Motion Skills from Graph-Powered Motion Matching

Observation scheme for interaction with embodied intelligent agents based on Laban notation

Designing Human-like Behaviors for Anthropomorphic Arm in Humanoid Robot NAO.

Anthropomorphic Reaching Movement Generating Method for Human-Like Upper Limb Robot

Humanoid Robot Imitation with Pose Similarity Metric Learning

Control Architecture for Human-Like Motion With Applications to Articulated Soft Robots

Animation Techniques in Human-Robot Interaction User Studies: a Systematic Literature Review

Recognizing Emotional Body Language Displayed by a Human-like Social Robot

NAO Robot Learns to Interact with Humans through Imitation Learning from Video Observation

Robot Dancing: Adapting Robot Dance to Human Preferences

An Information Theoretic Measure for Robot Expressivity

Promoting Social Engagement With a Multi-Role Dancing Robot for In-Home Autism Care