Abstract:This paper presents a framework for real-time high-fidelity upper limb motion transfer from a human to a humanoid robot, intending to provide robust support for robots to learn manipulation skills. Robot imitation of human motion is modeled as a simultaneous wrist and elbow tracking problem, where the coordination between multiple imitation objectives and physical constraints receives special attention. First, for the vision-based motion capture system, an efficient preprocessing method is introduced to map the raw human skeletal points analogously or reflectively to the robot’s workspace. Then, the generation of velocity-level imitation motion commands is formalized as a constrained hierarchical quadratic programing (HQP) problem, in which multiple objectives for achieving imitation are organized into a hierarchy. The wrist tracking task is set as the highest priority, followed by the adjustment of the elbow and the minimization of the joint velocity. Physical limits of the robot joints, as well as strict kinematic constraints regarding self-motion, are considered as constraints for the optimization problem. Finally, a hierarchical recurrent neural network (RNN) is designed to solve this HQP problem through its unique neural dynamics. The performance of this network is theoretically guaranteed with high computational efficiency. Quantitative results show that the proposed motion imitation control scheme offers excellent integrated tracking accuracy of [Formula: see text] m and is robust to different arm length ratios. Using this method, the humanoid robot can imitate the upper body motions of a human as accurately as possible under physical constraints, without significant delays.

Skill Learning for Human-Robot Interaction Using Wearable Device

Robotic Skills Learning Based on Dynamical Movement Primitives Using a Wearable Device.

An IoT-Enabled Telerobotic-Assisted Healthcare System Based on Inertial Motion Capture.

Enable Intuitive and Immersive Teleoperation: Design, Modeling and Control of a Novel Wearable Exoskeleton

Learning to Collaborate from Simulation for Robot-Assisted Dressing

A Sensor Glove Based on Inertial Measurement Unit for Robot Teleoperetion.

The Design and Implementation of Natural Human-Robot Interaction System Based on Kinect Sensor

Development of a Synchronized Human-Robot-Virtuality Interaction System Using Cooperative Robot and Motion Capture Device

Skill Learning Framework for Human-Robot Interaction and Manipulation Tasks

Robotic Teleoperation Systems Using a Wearable Multimodal Fusion Device

Human-Robot Variable Impedance Skills Transfer Learning Based on Dynamic Movement Primitives

Human–Robot Interaction Using Learning from Demonstrations and a Wearable Glove with Multiple Sensors

A Method Based on Wearable Devices for Controlling Teaching of Robots for Human-robot Collaboration

Enhancing Human-to-Robot Skill Transfer: A Framework Integrating Movement and Variable Impedance Based on EMG

Innovative multi-dimensional learning algorithm and experiment design for human-robot cooperation

An Ergo-Interactive Framework for Human-Robot Collaboration Via Learning from Demonstration

Learning Physical Collaborative Robot Behaviors From Human Demonstrations

Human-Agent Joint Learning for Efficient Robot Manipulation Skill Acquisition

Robust Real-Time Upper Limb Motion Transfer from Human to Humanoid for Manipulation Skill Teaching

Learning Pose Dynamical System for Contact Tasks under Human Interaction

A Human-Like Learning Framework of Robot Interaction Skills Based on Environmental Dynamics