Abstract:Learning from demonstration (LfD) has been widely studied as a convenient method for robot learning. In the LfD paradigm, the robot is required to learn relevant motion patterns from human demonstrations and apply them to various situations. Many advancements have been achieved in recent studies, however, there is a lack of studies on solutions for robots to learn the variability from demonstrations and adapt the reproduction to unseen scenarios in high-dimensional or long-trajectory cases. In this paper, a novel nonparametric kernelized gradient descent (KGD) method of LfD is proposed, which capitalizes on gradient descent and kernel-based approaches and produces a model with fewer open parameters than methods that employ basis functions. The proposed KGD method can accurately represent the complex demonstrations and utilize the variability of the demonstrations to adapt the trajectories smoothly to different unseen situations described by newly desired start-, via- and end-points precisely with high computational efficiency. Experiments were conducted to evaluate the performance of the proposed KGD method and compare it with commonly used probabilistic kernelized movement primitive (KMP) and mean-prior Gaussian process regression (MP-GPR) methods. The results indicated that the proposed KGD method performs better than KMP and MP-GPR in terms of the precision of the desired points, reproduction smoothness, and computation time. On account of the high efficiency and outstanding reproduction, KGD has the potential to be beneficial for better human–robot collaboration, facilitating assembly lines or improving robot learning. An important future challenge will be to extend the KGD towards considering the nonlinear constraints to learn more complex tasks.

Reinforcement Learning-based Learning from Demonstrations for Collaborative Robots

Bagging for Gaussian Mixture Regression in Robot Learning from Demonstration

Demonstration Guided Actor-Critic Deep Reinforcement Learning for Fast Teaching of Robots in Dynamic Environments

Collaborative Robot Learning from Demonstrations using Hidden Markov Model State Distribution

Learning from Successful and Failed Demonstrations via Optimization

Robot Learning from Demonstration Using Elastic Maps

Biologically Inspired Motion Modeling and Neural Control for Robot Learning From Demonstrations

Reinforcement learning with Demonstrations from Mismatched Task under Sparse Reward

Learning from Demonstration Framework for Multi-Robot Systems Using Interaction Keypoints and Soft Actor-Critic Methods

A survey of robot learning from demonstration

A survey of robot learning from demonstrations for Human-Robot Collaboration

GAN-Based Interactive Reinforcement Learning from Demonstration and Human Evaluative Feedback

Demonstration Learning and Generalization of Robotic Motor Skills Based on Wearable Motion Tracking Sensors

Leveraging Demonstrations for Deep Reinforcement Learning on Robotics Problems with Sparse Rewards

DMP and GMR Based Teaching by Demonstration for a KUKA LBR Robot

Recent Advances in Robot Learning from Demonstration

Ergodic imitation: Learning from what to do and what not to do

Learning Generalizable Robot Skills from Demonstrations in Cluttered Environments

Learning Under-Specified Object Manipulations from Human Demonstrations.

Kernelized Gradient Descent Method for Learning from Demonstration.

Diff-LfD: Contact-aware Model-based Learning from Visual Demonstration for Robotic Manipulation Via Differentiable Physics-based Simulation and Rendering.