Abstract:There has been substantial growth in research on the robot automation, which aims to make robots capable of directly interacting with the world or human. Robot learning for automation from human demonstration is central to such situation. However, the dependence of demonstration restricts robot to a fixed scenario, without the ability to explore in variant situations to accomplish the same task as in demonstration. Deep reinforcement learning methods may be a good method to make robot learning beyond human demonstration and fulfilling the task in unknown situations. The exploration is the core of such generalization to different environments. While the exploration in reinforcement learning may be ineffective and suffer from the problem of low sample efficiency. In this paper, we present Evolutionary Policy Gradient (EPG) to make robot learn from demonstration and perform goal oriented exploration efficiently. Through goal oriented exploration, our method can generalize robot learned skill to environments with different parameters. Our Evolutionary Policy Gradient combines parameter perturbation with policy gradient method in the framework of Evolutionary Algorithms (EAs) and can fuse the benefits of both, achieving effective and efficient exploration. With demonstration guiding the evolutionary process, robot can accelerate the goal oriented exploration to generalize its capability to variant scenarios. The experiments, carried out in robot control tasks in OpenAI Gym with dense and sparse rewards, show that our EPG is able to provide competitive performance over the original policy gradient methods and EAs. In the manipulator task, our robot can learn to open the door with vision in environments which are different from where the demonstrations are provided.

Towards Robot Incremental Learning Constraints from Comparative Demonstration

Learning Robot Manipulation Skills from Human Demonstration Videos Using Two-Stream 2-D/3-D Residual Networks with Self-Attention

Generalize Robot Learning from Demonstration to Variant Scenarios with Evolutionary Policy Gradient

Human Demonstration Trajectory Refinement for Redundant Manipulators.

Towards Learning from Demonstration System for Parts Assembly: A Graph Based Representation for Knowledge

Constrained-Space Optimization and Reinforcement Learning for Complex Tasks

Recent Advances in Robot Learning from Demonstration

Survey of Imitation Learning for Robotic Manipulation

Enabling Robots to Identify Missing Steps in Robot Tasks for Guided Learning from Demonstration

Learning Generalizable Robot Skills from Demonstrations in Cluttered Environments

How Can Everyday Users Efficiently Teach Robots by Demonstrations?

Learning from Successful and Failed Demonstrations via Optimization

Learning and Generalizing Variable Impedance Manipulation Skills from Human Demonstrations

Human Demonstrations are Generalizable Knowledge for Robots

An Incremental Learning Framework to Enhance Teaching by Demonstration Based on Multimodal Sensor Fusion

Constraint Inference in Control Tasks from Expert Demonstrations via Inverse Optimization

Learning Variable Impedance Skills from Demonstrations with Passivity Guarantee

Demonstration Guided Actor-Critic Deep Reinforcement Learning for Fast Teaching of Robots in Dynamic Environments

Robot Learning from Demonstration Using Elastic Maps

Quantifying Teaching Behaviour in Robot Learning from Demonstration

Screw Geometry Meets Bandits: Incremental Acquisition of Demonstrations to Generate Manipulation Plans