Abstract:Deep Reinforcement Learning (DRL) is a quickly evolving research field rooted in operations research and behavioural psychology, with potential applications extending across various domains, including robotics. This thesis delineates the background of modern Reinforcement Learning (RL), starting with the framework constituted by the Markov decision processes, Markov properties, goals and rewards, agent-environment interactions, and policies. We explain the main types of algorithms commonly used in RL, including value-based, policy gradient, and actor-critic methods, with a special emphasis on DQN, A2C and PPO. We then give a short literature review on some widely adopted frameworks for implementing RL algorithms and environments. Subsequently, we present Bidimensional Gripper Environment (BGE), a virtual simulator based on the Pymunk physics engine we developed to analyse top-down bidimensional object manipulation. The methodology section frames our agent-environment interaction as a Markov decision process, such that we can apply our RL algorithms. We list various goal formulation strategies, including reward shaping and curriculum learning. We also employ different steps of observation preprocessing to reduce the computational workload required. In the experimental phase, we run through a series of scenarios of increasing difficulty. We start with a simple static scenario and then gradually increase the amount of stochasticity. Whenever the agents show difficulty in learning, we counteract by increasing the degree of reward shaping and curriculum learning. These experiments demonstrate the substantial limitations and pitfalls of model-free algorithms under changing dynamics. In conclusion, we present a summary of our findings and remarks. We then outline potential future work to improve our methodology and possibly expand to real-world systems.

Deep Reinforcement Learning with Godot Game Engine

Godot Reinforcement Learning Agents

Deep Reinforcement Learning for NLP.

A Platform-Agnostic Deep Reinforcement Learning Framework for Effective Sim2Real Transfer towards Autonomous Driving

Deep Reinforcement Learning for 2D Physics-Based Object Manipulation in Clutter

Development of a Simulation Environment for Robot Soccer Game with Deep Reinforcement Learning and Role Assignment

Augmenting Automated Game Testing with Deep Reinforcement Learning

Deep Reinforcement Learning: Framework, Applications, and Embedded Implementations

A Survey of Deep Reinforcement Learning in Video Games

Deep Reinforcement Learning framework for Autonomous Driving

Dopamine: A Research Framework for Deep Reinforcement Learning

Decoding Reinforcement Learning for newcomers

Deep Reinforcement Learning

Novel Reinforcement Learning Research Platform for Role-Playing Games

DRIFT: Deep Reinforcement Learning for Intelligent Floating Platforms Trajectories

Safety-Driven Deep Reinforcement Learning Framework for Cobots: A Sim2Real Approach

A Human Mixed Strategy Approach to Deep Reinforcement Learning

DeepRacer: Educational Autonomous Racing Platform for Experimentation with Sim2Real Reinforcement Learning

Bridging the gap between Markowitz planning and deep reinforcement learning

Deep Reinforcement Learning for Motion Control Algorithms in Robotics

DeepSim: A Reinforcement Learning Environment Build Toolkit for ROS and Gazebo