Abstract:This work describes the design of real-time dance-based interaction with a humanoid robot, where the robot seeks to promote physical activity in children by taking on multiple roles as a dance partner. It acts as a leader by initiating dances but can also act as a follower by mimicking a child's dance movements. Dances in the leader role are produced by a sequence-to-sequence (S2S) Long Short-Term Memory (LSTM) network trained on children's music videos taken from YouTube. On the other hand, a music orchestration platform is implemented to generate background music in the follower mode as the robot mimics the child's poses. In doing so, we also incorporated the largely unexplored paradigm of learning-by-teaching by including multiple robot roles that allow the child to both learn from and teach to the robot. Our work is among the first to implement a largely autonomous, real-time full-body dance interaction with a bipedal humanoid robot that also explores the impact of the robot roles on child engagement. Importantly, we also incorporated in our design formal constructs taken from autism therapy, such as the least-to-most prompting hierarchy, reinforcements for positive behaviors, and a time delay to make behavioral observations. We implemented a multimodal child engagement model that encompasses both affective engagement (displayed through eye gaze focus and facial expressions) as well as task engagement (determined by the level of physical activity) to determine child engagement states. We then conducted a virtual exploratory user study to evaluate the impact of mixed robot roles on user engagement and found no statistically significant difference in the children's engagement in single-role and multiple-role interactions. While the children were observed to respond positively to both robot behaviors, they preferred the music-driven leader role over the movement-driven follower role, a result that can partly be attributed to the virtual nature of the study. Our findings support the utility of such a platform in practicing physical activity but indicate that further research is necessary to fully explore the impact of each robot role.

Structure Design of a Passive Type Dance Partner Robot

Development of a Passive Type Dance Partner Robot

A passive dance robot with active coordination capability

A new control algorithm for a passive type dance partner robot

Study and Design of Active Dancing Partner Robot Based on Kinect

Motion control of a passive robot for dancing with a male dancer

Control Algorithm of a Passive Dance Partner Robot

Evaluation by Expert Dancers of a Robot That Performs Partnered Stepping via Haptic Interaction

Development and Experimental Study of Multi-Motion Model Robot with Wheel-Track Compound Structure

A Wheel-legged Robot with Active Waist Joint: Design, Analysis, and Experimental Results

Structure Design of Active Power-Assist Lower Limb Exoskeleton APAL Robot

Legged walking robot design applying the adaptive behavior of passive dynamic walking and interconnections among the different dynamics

System Overview and Walking Dynamics of a Passive Dynamic Walking Robot with Flat Feet

Development of Dual-Arm Human Companion Robots That Can Dance

Dance Teaching by a Robot: Combining Cognitive and Physical Human-Robot Interaction for Supporting the Skill Learning Process

Exploiting Physical Human-Robot Interaction to Provide a Unique Rolling Experience with a Riding Ballbot

Design of a Humanoid Bipedal Robot Based on Kinematics and Dynamics Analysis of Human Lower Limbs.

Promoting Social Engagement With a Multi-Role Dancing Robot for In-Home Autism Care

A Safe and Compliant Noncontact Interactive Approach for Wheeled Walking Aid Robot.

Body Design and Gait Generation of Chair-Type Asymmetrical Tripedal Low-rigidity Robot

Study of Human Walking Patterns Based on the Parameter Optimization of a Passive Dynamic Walking Robot