Abstract:Reinforcement learning (RL) and imitation learning (IL), especially equipped with deep neural networks, have been widely studied for autonomous robotic skill acquisition and control tasks. However, these methods and their extensions require extensive environmental interactions during training, which greatly prevents them from being applied to real-world robots. To alleviate this problem, we present an efficient model-free off-policy actor-critic algorithm for robotic skill acquisition and continuous control, by fusing the task reward with a task-oriented guiding reward, which is formulated by leveraging few and imperfect expert demonstrations. In this framework, the agent can explore the environment more intentionally, thus sampling efficiency can be achieved; moreover, the agent can also exploit the experience more effectively, thereby substantially improved performance can be realized simultaneously. The empirical results on robotic locomotion tasks show that the proposed scheme can lower sample complexity by 2-10 times in contrast with the state-of-the-art baseline deep RL (DRL) algorithms, while achieving performance better than that of the expert. Furthermore, the proposed algorithm achieves significant improvement in both sampling efficiency and asymptotic performance on tasks with sparse and delayed reward, wherein those baseline DRL algorithms struggle to make progress. This takes a substantial step forward to implement these methods to acquire skills autonomously for real robots.

A Survey of Deep Network Solutions for Learning Control in Robotics: From Reinforcement to Imitation

Deep-learning in Mobile Robotics - from Perception to Control Systems: A Survey on Why and Why Not.

A LiDAR Based End to End Controller for Robot Navigation Using Deep Neural Network

Learning for a Robot: Deep Reinforcement Learning, Imitation Learning, Transfer Learning

Deep Reinforcement Learning for Robotics: A Survey of Real-World Successes

Deep Reinforcement Learning for Motion Control Algorithms in Robotics

Learning with Training Wheels: Speeding up Training with a Simple Controller for Deep Reinforcement Learning

Deep Reinforcement Learning for Robotic Manipulation-The state of the art

A Survey of Imitation Learning: Algorithms, Recent Developments, and Challenges

A Survey of Sim-to-Real Transfer Techniques Applied to Reinforcement Learning for Bioinspired Robots

A Brief Survey of Deep Reinforcement Learning

How to Train Your Robot with Deep Reinforcement Learning; Lessons We've Learned

Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey

Deep Reinforcement Learning: A Brief Survey

Task-Oriented Deep Reinforcement Learning for Robotic Skill Acquisition and Control

A Survey on Deep Reinforcement Learning Algorithms for Robotic Manipulation

A Survey of Deep Learning Applications to Autonomous Vehicle Control

How to train your robot with deep reinforcement learning: lessons we have learned

A Deep Reinforcement Learning Solution for the Low Level Motion Control of a Robot Manipulator System

Robot Control in Human Environment Using Deep Reinforcement Learning and Convolutional Neural Network.