Abstract:A salient feature of human motor skill learning is the ability to exploit similarities across related tasks. In biological motor control, it has been hypothesized that muscle synergies, coherent activations of groups of muscles, allow for exploiting shared knowledge. Recent studies have shown that a rich set of complex motor skills can be generated by a combination of a small number of muscle synergies. In robotics, dynamic movement primitives are commonly used for motor skill learning. This machine learning approach implements a stable attractor system that facilitates learning and it can be used in high-dimensional continuous spaces. However, it does not allow for reusing shared knowledge, i.e., for each task an individual set of parameters has to be learned. We propose a novel movement primitive representation that employs parametrized basis functions, which combines the benefits of muscle synergies and dynamic movement primitives. For each task a superposition of synergies modulates a stable attractor system. This approach leads to a compact representation of multiple motor skills and at the same time enables efficient learning in high-dimensional continuous systems. The movement representation supports discrete and rhythmic movements and in particular includes the dynamic movement primitive approach as a special case. We demonstrate the feasibility of the movement representation in three multi-task learning simulated scenarios. First, the characteristics of the proposed representation are illustrated in a point-mass task. Second, in complex humanoid walking experiments, multiple walking patterns with different step heights are learned robustly and efficiently. Finally, in a multi-directional reaching task simulated with a musculoskeletal model of the human arm, we show how the proposed movement primitives can be used to learn appropriate muscle excitation patterns and to generalize effectively to new reaching skills.

Bootstrapping Motor Skill Learning with Motion Planning

Human Demonstration Trajectory Refinement for Redundant Manipulators.

Using Implicit Behavior Cloning and Dynamic Movement Primitive to Facilitate Reinforcement Learning for Robot Motion Planning

Offline Skill Generalization via Task and Motion Planning

Dynamic Movement Primitives Based Robot Skills Learning

Bridging the gap between Learning-to-plan, Motion Primitives and Safe Reinforcement Learning

Moving Personal Robots in Real-Time Using Primitive Motions

Skill Learning Strategy Based on Dynamic Motion Primitives for Human–Robot Cooperative Manipulation

R R: Rapid eXploration for Reinforcement learning via sampling-based reset distributions and imitation pre-training

Learning Whole-body Motor Skills for Humanoids

Human-Robot Skill Transfer with Enhanced Compliance via Dynamic Movement Primitives

Learned parametrized dynamic movement primitives with shared synergies for controlling robotic and musculoskeletal systems

HYPERmotion: Learning Hybrid Behavior Planning for Autonomous Loco-manipulation

Neural probabilistic motor primitives for humanoid control

Practice Makes Perfect: Planning to Learn Skill Parameter Policies

Reinforcement learning of motor skills with policy gradients

Speeding Up Optimization-based Motion Planning through Deep Learning

Demonstration Learning and Generalization of Robotic Motor Skills Based on Wearable Motion Tracking Sensors

Learning Skills from Demonstrations: A Trend from Motion Primitives to Experience Abstraction

Learning Robotic Manipulation through Visual Planning and Acting