Abstract:Finding an efficient way to adapt robot trajectory is a priority to improve overall performance of robots. One approach for trajectory planning is through transferring human-like skills to robots by Learning from Demonstrations (LfD). The human demonstration is considered the target motion to mimic. However, human motion is typically optimal for human embodiment but not for robots because of the differences between human biomechanics and robot dynamics. The Dynamic Movement Primitives (DMP) framework is a viable solution for this limitation of LfD, but it requires tuning the second-order dynamics in the formulation. Our contribution is introducing a systematic method to extract the dynamic features from human demonstration to auto-tune the parameters in the DMP framework. In addition to its use with LfD, another utility of the proposed method is that it can readily be used in conjunction with Reinforcement Learning (RL) for robot training. In this way, the extracted features facilitate the transfer of human skills by allowing the robot to explore the possible trajectories more efficiently and increasing robot compliance significantly. We introduced a methodology to extract the dynamic features from multiple trajectories based on the optimization of human-likeness and similarity in the parametric space. Our method was implemented into an actual human-robot setup to extract human dynamic features and used to regenerate the robot trajectories following both LfD and RL with DMP. It resulted in a stable performance of the robot, maintaining a high degree of human-likeness based on accumulated distance error as good as the best heuristic tuning.

Deep Learning for Koopman-based Dynamic Movement Primitives

COMBINATION OF AFFINE DEFORMATION AND DYNAMIC MOVEMENT PRIMITIVE IN LEARNING HUMAN MOTION FOR REDUNDANT MANIPULATOR

On the Utility of Koopman Operator Theory in Learning Dexterous Manipulation Skills

KOROL: Learning Visualizable Object Feature with Koopman Operator Rollout for Manipulation

Learning Deep Neural Network Representations for Koopman Operators of Nonlinear Dynamical Systems

Koopman Operators in Robot Learning

Dynamics Harmonic Analysis of Robotic Systems: Application in Data-Driven Koopman Modelling

Dynamic Movement Primitives Based Robot Skills Learning

Deep Dynamics Models for Learning Dexterous Manipulation

Learning Cooperative Dynamic Manipulation Skills from Human Demonstration Videos

Learning Compositional Koopman Operators for Model-Based Control

Logic Learning from Demonstrations for Multi-step Manipulation Tasks in Dynamic Environments

Continual Learning and Lifting of Koopman Dynamics for Linear Control of Legged Robots

Deep Neural Networks With Koopman Operators for Modeling and Control of Autonomous Vehicles

Learning Robotic Manipulation from Demonstrations by Combining Deep Generative Model and Dynamic Control System

DLKoopman: A deep learning software package for Koopman theory

Imitation Learning with Limited Actions via Diffusion Planners and Deep Koopman Controllers

Human-Robot Skill Transfer with Enhanced Compliance via Dynamic Movement Primitives

A Generalized Robotic Handwriting Learning System based on Dynamic Movement Primitives (DMPs)

Learning Forceful Manipulation Skills from Multi-modal Human Demonstrations

A Distributed Deep Koopman Learning Algorithm for Control