Abstract:Due to the empirical success of reinforcement learning, an increasing number of students study the subject. However, from our practical teaching experience, we see students entering the field (bachelor, master and early PhD) often struggle. On the one hand, textbooks and (online) lectures provide the fundamentals, but students find it hard to translate between equations and code. On the other hand, public codebases do provide practical examples, but the implemented algorithms tend to be complex, and the underlying test environments contain multiple reinforcement learning challenges at once. Although this is realistic from a research perspective, it often hinders educational conceptual understanding. To solve this issue we introduce EduGym, a set of educational reinforcement learning environments and associated interactive notebooks tailored for education. Each EduGym environment is specifically designed to illustrate a certain aspect/challenge of reinforcement learning (e.g., exploration, partial observability, stochasticity, etc.), while the associated interactive notebook explains the challenge and its possible solution approaches, connecting equations and code in a single document. An evaluation among RL students and researchers shows 86% of them think EduGym is a useful tool for reinforcement learning education. All notebooks are available from <a class="link-external link-https" href="https://www.edugym.org/" rel="external noopener nofollow">this https URL</a>, while the full software package can be installed from <a class="link-external link-https" href="https://github.com/RLG-Leiden/edugym" rel="external noopener nofollow">this https URL</a>.

MDP environments for the OpenAI Gym

MDP Playground: An Analysis and Debug Testbed for Reinforcement Learning

Gym-ANM: Open-source software to leverage reinforcement learning for power system management in research and education

Gymnasium: A Standard Interface for Reinforcement Learning Environments

DIAMBRA Arena: a New Reinforcement Learning Platform for Research and Experimentation

EduGym: An Environment and Notebook Suite for Reinforcement Learning Education

Discovering Minimal Reinforcement Learning Environments

SDGym: Low-Code Reinforcement Learning Environments using System Dynamics Models

Controlgym: Large-Scale Control Environments for Benchmarking Reinforcement Learning Algorithms

DoorGym: A Scalable Door Opening Environment And Baseline Agent

Predictable MDP Abstraction for Unsupervised Model-Based RL

OffWorld Gym: open-access physical robotics environment for real-world reinforcement learning benchmark and research

Open-Source Reinforcement Learning Environments Implemented in MuJoCo with Franka Manipulator

Simple Noisy Environment Augmentation for Reinforcement Learning

CaiRL: A High-Performance Reinforcement Learning Environment Toolkit

pomdp_py: A Framework to Build and Solve POMDP Problems

Robust Anytime Learning of Markov Decision Processes

MAESTRO: Open-Ended Environment Design for Multi-Agent Reinforcement Learning

Look Around! Unexpected gains from training on environments in the vicinity of the target

DQN with model-based exploration: efficient learning on environments with sparse rewards

Craftium: An Extensible Framework for Creating Reinforcement Learning Environments