Abstract:A salient feature of human motor skill learning is the ability to exploit similarities across related tasks. In biological motor control, it has been hypothesized that muscle synergies, coherent activations of groups of muscles, allow for exploiting shared knowledge. Recent studies have shown that a rich set of complex motor skills can be generated by a combination of a small number of muscle synergies. In robotics, dynamic movement primitives are commonly used for motor skill learning. This machine learning approach implements a stable attractor system that facilitates learning and it can be used in high-dimensional continuous spaces. However, it does not allow for reusing shared knowledge, i.e., for each task an individual set of parameters has to be learned. We propose a novel movement primitive representation that employs parametrized basis functions, which combines the benefits of muscle synergies and dynamic movement primitives. For each task a superposition of synergies modulates a stable attractor system. This approach leads to a compact representation of multiple motor skills and at the same time enables efficient learning in high-dimensional continuous systems. The movement representation supports discrete and rhythmic movements and in particular includes the dynamic movement primitive approach as a special case. We demonstrate the feasibility of the movement representation in three multi-task learning simulated scenarios. First, the characteristics of the proposed representation are illustrated in a point-mass task. Second, in complex humanoid walking experiments, multiple walking patterns with different step heights are learned robustly and efficiently. Finally, in a multi-directional reaching task simulated with a musculoskeletal model of the human arm, we show how the proposed movement primitives can be used to learn appropriate muscle excitation patterns and to generalize effectively to new reaching skills.

Hierarchical Learning of Primitives Using Neurodynamic Model.

Hierarchical Motion Understanding via Motion Programs

Hierarchical Dynamical Models of Motor Function

Hierarchical Learning Recurrent Neural Networks for 3D Motion Synthesis

Learning nonlinear dynamical system for movement primitives

Learning to Segment and Represent Motion Primitives from Driving Data for Motion Planning Applications

Robot Learning System Based on Adaptive Neural Control and Dynamic Movement Primitives.

Moving Personal Robots in Real-Time Using Primitive Motions

Learning Hierarchical Non-Parametric Hidden Markov Model of Human Motion

Dynamic Movement Primitives Based Robot Skills Learning

Learning Motion Primitives from Demonstration

Deep Probabilistic Movement Primitives with a Bayesian Aggregator

Learning A Highly Structured Motion Model for 3D Human Tracking (Draft)

Towards a self-organizing pre-symbolic neural model representing sensorimotor primitives

Neural probabilistic motor primitives for humanoid control

Hierarchical Dynamic Movement Primitive for the Smooth Movement of Robots Based on Deep Reinforcement Learning

Robot Complex Motion Learning Based on Unsupervised Trajectory Segmentation and Movement Primitives.

Learned parametrized dynamic movement primitives with shared synergies for controlling robotic and musculoskeletal systems

Motion Primitives Extraction and Regeneration Based on Real Driving Data

A novel teacher–student hierarchical approach for learning primitive information

Skill Learning Strategy Based on Dynamic Motion Primitives for Human–Robot Cooperative Manipulation