Abstract:This paper presents a framework for real-time high-fidelity upper limb motion transfer from a human to a humanoid robot, intending to provide robust support for robots to learn manipulation skills. Robot imitation of human motion is modeled as a simultaneous wrist and elbow tracking problem, where the coordination between multiple imitation objectives and physical constraints receives special attention. First, for the vision-based motion capture system, an efficient preprocessing method is introduced to map the raw human skeletal points analogously or reflectively to the robot’s workspace. Then, the generation of velocity-level imitation motion commands is formalized as a constrained hierarchical quadratic programing (HQP) problem, in which multiple objectives for achieving imitation are organized into a hierarchy. The wrist tracking task is set as the highest priority, followed by the adjustment of the elbow and the minimization of the joint velocity. Physical limits of the robot joints, as well as strict kinematic constraints regarding self-motion, are considered as constraints for the optimization problem. Finally, a hierarchical recurrent neural network (RNN) is designed to solve this HQP problem through its unique neural dynamics. The performance of this network is theoretically guaranteed with high computational efficiency. Quantitative results show that the proposed motion imitation control scheme offers excellent integrated tracking accuracy of [Formula: see text] m and is robust to different arm length ratios. Using this method, the humanoid robot can imitate the upper body motions of a human as accurately as possible under physical constraints, without significant delays.

Realizing Human-Like Manipulation with a Musculoskeletal System and Biologically Inspired Control Scheme

Control of Antagonistic McKibben Muscles Via a Bio-inspired Approach

Dexterous Manipulation Control of a Bionic Prosthesis in Cooperation with Human Upper Limbs

Bio-inspired Control of a Rehabilitation Robot Actuated by Pneumatic Artificial Muscles

Beyond End-Effector: Utilizing High-Resolution Tactile Signals for Physical Human–Robot Interaction

A Biological Humanoid Joint Controller Based on Muscle Model

Unified Motion/Force/Impedance Control for Manipulators in Unknown Contact Environments Based on Robust Model-Reaching Approach

Generalizable and Precise Control Based on Equilibrium-Point Hypothesis for Musculoskeletal Robotic System

A Biomimetic Planning Control Method To Anthropomorphize A 7-Dof Redundant Manipulator In Unstructured Environments

A Kind of Biomimetic Control Method to Anthropomorphize a Redundant Manipulator for Complex Tasks

Muscle-Synergies-Based Neuromuscular Control for Motion Learning and Generalization of a Musculoskeletal System

Contact-Implicit Model Predictive Control for Dexterous In-hand Manipulation: A Long-Horizon and Robust Approach

Scalable muscle-actuated human simulation and control

Equilibrium-Point Control and Robustness Analysis of Bioinspired Musculoskeletal Robotic System

A Combined Learning and Optimization Framework to Transfer Human Whole-body Loco-manipulation Skills to Mobile Manipulators

Human-Inspired Control of Dual-Arm Exoskeleton Robots With Force and Impedance Adaptation

Robust Real-Time Upper Limb Motion Transfer from Human to Humanoid for Manipulation Skill Teaching

A Learning-Based Hierarchical Control Scheme for an Exoskeleton Robot in Human-Robot Cooperative Manipulation.

Motion Control and Optimal Design of a Biomimetic Manipulator Based on Snake Coiling and Stretching

Robust Dexterous Manipulation Under Object Dynamics Uncertainties

Asymmetric Bimanual Control of Dual-Arm Exoskeletons for Human-Cooperative Manipulations