Abstract:The goal of human-robot motion retargeting is to let a robot follow the movements performed by a human subject. Typically in previous approaches, the human poses are precomputed from a human pose tracking system, after which the explicit joint mapping strategies are specified to apply the estimated poses to a target robot. However, there is not any generic mapping strategy that we can use to map the human joint to robots with different kinds of configurations. In this paper, we present a novel motion retargeting approach that combines the human pose estimation and the motion retargeting procedure in a unified generative framework without relying on any explicit mapping. First, a 3D parametric human-robot (HUMROB) model is proposed which has the specific joint and stability configurations as the target robot while its shape conforms the source human subject. The robot configurations, including its skeleton proportions, joint limitations, and DoFs are enforced in the HUMROB model and get preserved during the tracking procedure. Using a single RGBD camera to monitor human pose, we use the raw RGB and depth sequence as input. The HUMROB model is deformed to fit the input point cloud, from which the joint angle of the model is calculated and applied to the target robots for retargeting. In this way, instead of fitted individually for each joint, we will get the joint angle of the robot fitted globally so that the surface of the deformed model is as consistent as possible to the input point cloud. In the end, no explicit or pre-defined joint mapping strategies are needed. To demonstrate its effectiveness for human-robot motion retargeting, the approach is tested under both simulations and on real robots which have a quite different skeleton configurations and joint degree of freedoms (DoFs) as compared with the source human subjects.

Dynamic Movement Primitive Based Motion Retargeting for Dual-Arm Sign Language Motions

Human-Robot Sign Language Motion Retargeting from Videos

Frame-by-frame Motion Retargeting with Self-Collision Avoidance from Diverse Human Demonstrations

COMBINATION OF AFFINE DEFORMATION AND DYNAMIC MOVEMENT PRIMITIVE IN LEARNING HUMAN MOTION FOR REDUNDANT MANIPULATOR

Robust Real-Time Motion Retargeting Via Neural Latent Prediction

Human Demonstration Trajectory Refinement for Redundant Manipulators.

Kinematic Motion Retargeting via Neural Latent Optimization for Learning Sign Language

Learning Arm Movements Of Target Reaching For Humanoid Robot

The Arm Planning with Dynamic Movement Primitive for Humanoid Service Robot

Human-Like Motion of Robotic Arm Based on Dynamic Movement Primitives and Deep Neural Network

Cooperative Manipulation for a Mobile Dual-Arm Robot Using Sequences of Dynamic Movement Primitives

Cooperative Control for Dual-Arm Robots Based on Improved Dynamic Movement Primitives

A Generative Human-Robot Motion Retargeting Approach Using a Single RGBD Sensor.

Moving Personal Robots in Real-Time Using Primitive Motions

Human-Robot Skill Transfer with Enhanced Compliance via Dynamic Movement Primitives

An Anthropomorphic Motion Retargeting Method Based on an Adaptive Genetic Algorithm

Learning, Generalization, And Obstacle Avoidance With Dynamic Movement Primitives And Dynamic Potential Fields

Autonomous Grasp Motion Planning for an Anthropomorphic Robot Arm Based on Human Likeness

Learning Motion Primitives from Demonstration

A New Method for Motion Retargeting for the Hand Gesture