Abstract:Reinforcement learning (RL) is one of the popular methods for intelligent control and decision making in the field of robotics recently. The goal of RL is to learn an optimal policy of the agent by interacting with the environment via trail and error. There are two main algorithms for RL problems, including model-free and model-based methods. Model-free RL is driven by historical trajectories and empirical data of the agent to optimize the policy, which needs to take actions in the environment to collect the trajectory data and may cause the damage of the robot during training in the real environment. The main different between model-based and model-free RL is that a model of the transition probability in the interaction environment is employed. Thus the agent can search the optimal policy through internal simulation. However, the model of the transition probability is usually estimated from historical data in a single environment with statistical errors. Therefore, an issue is faced by the agent is that the optimal policy is sensitive to perturbations in the model of the environment which can lead to serious degradation in performance. Robust RL aims to learn a robust optimal policy that accounts for model uncertainty of the transition probability to systematically mitigate the sensitivity of the optimal policy in perturbed environments. In this overview, we begin with an introduction to the algorithms in RL, then focus on the model uncertainty of the transition probability in robust RL. In parallel, we highlight the current research and challenges of robust RL for robot control. To conclude, we describe some research areas in robust RL and look ahead to the future work about robot control in complex environments.

Complexity Analysis Of Reinforcement Learning And Its Application To Robotics

Reinforcement Learning in Robotics: Challenges and Applications

Deep Reinforcement Learning for Motion Control Algorithms in Robotics

Reinforcement learning for robot research: A comprehensive review and open issues

An Overview on Algorithms and Applications of Deep Reinforcement Learning

An Overview of Robust Reinforcement Learning.

Deep Reinforcement Learning for Robotics: A Survey of Real-World Successes

A Survey of Deep Reinforcement Learning in Video Games

Reinforcement Learning in Robotics: Applications and Real-World Challenges

Reinforcement Learning Within the Classical Robotics Stack: A Case Study in Robot Soccer

Comprehensive Survey of Reinforcement Learning: From Algorithms to Practical Challenges

Deep Reinforcement Learning: Framework, Applications, and Embedded Implementations

Sample-Efficiency, Stability and Generalization Analysis for Deep Reinforcement Learning on Robotic Peg-in-Hole Assembly

Deep Reinforcement Learning: An Overview

A Survey of Deep Network Solutions for Learning Control in Robotics: From Reinforcement to Imitation

Multi-Robot Real-time Game Strategy Learning Based on Deep Reinforcement Learning.

Algorithms in Multi-Agent Systems: A Holistic Perspective from Reinforcement Learning and Game Theory

Safe and Robust Reinforcement Learning: Principles and Practice

Deep Reinforcement Learning

Reinforcement learning for mobile robot: From reaction to deliberation