Abstract:There has been substantial growth in research on the robot automation, which aims to make robots capable of directly interacting with the world or human. Robot learning for automation from human demonstration is central to such situation. However, the dependence of demonstration restricts robot to a fixed scenario, without the ability to explore in variant situations to accomplish the same task as in demonstration. Deep reinforcement learning methods may be a good method to make robot learning beyond human demonstration and fulfilling the task in unknown situations. The exploration is the core of such generalization to different environments. While the exploration in reinforcement learning may be ineffective and suffer from the problem of low sample efficiency. In this paper, we present Evolutionary Policy Gradient (EPG) to make robot learn from demonstration and perform goal oriented exploration efficiently. Through goal oriented exploration, our method can generalize robot learned skill to environments with different parameters. Our Evolutionary Policy Gradient combines parameter perturbation with policy gradient method in the framework of Evolutionary Algorithms (EAs) and can fuse the benefits of both, achieving effective and efficient exploration. With demonstration guiding the evolutionary process, robot can accelerate the goal oriented exploration to generalize its capability to variant scenarios. The experiments, carried out in robot control tasks in OpenAI Gym with dense and sparse rewards, show that our EPG is able to provide competitive performance over the original policy gradient methods and EAs. In the manipulator task, our robot can learn to open the door with vision in environments which are different from where the demonstrations are provided.

Learning robot anomaly recovery skills from multiple time-driven demonstrations

Generalize Robot Learning from Demonstration to Variant Scenarios with Evolutionary Policy Gradient

Demonstration Data-Driven Parameter Adjustment for Trajectory Planning in Highly Constrained Environments

Human Demonstration Trajectory Refinement for Redundant Manipulators.

Demonstration Learning and Generalization of Robotic Motor Skills Based on Wearable Motion Tracking Sensors

A Task-Learning Strategy for Robotic Assembly Tasks from Human Demonstrations

Biologically Inspired Motion Modeling and Neural Control for Robot Learning From Demonstrations

Learning Robotic Manipulation from Demonstrations by Combining Deep Generative Model and Dynamic Control System

Learning Push Recovery for A Bipedal Humanoid Robot with Dynamical Movement Primitives

Robot Task-Constrained Optimization and Adaptation with Probabilistic Movement Primitives

Human-Guided Robot Behavior Learning: A GAN-Assisted Preference-Based Reinforcement Learning Approach

Learning to Shift Attention for Motion Generation

Active Learning based on Data Uncertainty and Model Sensitivity

Environment-adaptive learning from demonstration for proactive assistance in human–robot collaborative tasks

Enhancing Robotic Adaptability: Integrating Unsupervised Trajectory Segmentation and Conditional ProMPs for Dynamic Learning Environments

Kernelized Gradient Descent Method for Learning from Demonstration.

Proactive Anomaly Detection for Robot Navigation with Multi-Sensor Fusion

Learning and generalization of task-parameterized skills through few human demonstrations

Adaptive Robotic Information Gathering via Non-Stationary Gaussian Processes

Incremental Learning of Probabilistic Movement Primitives (ProMPs) for Human-Robot Cooperation