Abstract:Due to the empirical success of reinforcement learning, an increasing number of students study the subject. However, from our practical teaching experience, we see students entering the field (bachelor, master and early PhD) often struggle. On the one hand, textbooks and (online) lectures provide the fundamentals, but students find it hard to translate between equations and code. On the other hand, public codebases do provide practical examples, but the implemented algorithms tend to be complex, and the underlying test environments contain multiple reinforcement learning challenges at once. Although this is realistic from a research perspective, it often hinders educational conceptual understanding. To solve this issue we introduce EduGym, a set of educational reinforcement learning environments and associated interactive notebooks tailored for education. Each EduGym environment is specifically designed to illustrate a certain aspect/challenge of reinforcement learning (e.g., exploration, partial observability, stochasticity, etc.), while the associated interactive notebook explains the challenge and its possible solution approaches, connecting equations and code in a single document. An evaluation among RL students and researchers shows 86% of them think EduGym is a useful tool for reinforcement learning education. All notebooks are available from <a class="link-external link-https" href="https://www.edugym.org/" rel="external noopener nofollow">this https URL</a>, while the full software package can be installed from <a class="link-external link-https" href="https://github.com/RLG-Leiden/edugym" rel="external noopener nofollow">this https URL</a>.

Gymnasium: A Standard Interface for Reinforcement Learning Environments

EduGym: An Environment and Notebook Suite for Reinforcement Learning Education

Controlgym: Large-Scale Control Environments for Benchmarking Reinforcement Learning Algorithms

LapGym -- An Open Source Framework for Reinforcement Learning in Robot-Assisted Laparoscopic Surgery

ChemGymRL: An Interactive Framework for Reinforcement Learning for Digital Chemistry

Safety-Gymnasium: A Unified Safe Reinforcement Learning Benchmark

OR-Gym: A Reinforcement Learning Library for Operations Research Problems

CaiRL: A High-Performance Reinforcement Learning Environment Toolkit

OffWorld Gym: open-access physical robotics environment for real-world reinforcement learning benchmark and research

SDGym: Low-Code Reinforcement Learning Environments using System Dynamics Models

Jumanji: a Diverse Suite of Scalable Reinforcement Learning Environments in JAX

Gym-ANM: Open-source software to leverage reinforcement learning for power system management in research and education

PC-Gym: Benchmark Environments For Process Control Problems

DIAMBRA Arena: a New Reinforcement Learning Platform for Research and Experimentation

Human-Robot Gym: Benchmarking Reinforcement Learning in Human-Robot Collaboration

Scilab-RL: A software framework for efficient reinforcement learning and cognitive modeling research

RFRL Gym: A Reinforcement Learning Testbed for Cognitive Radio Applications

Craftium: An Extensible Framework for Creating Reinforcement Learning Environments

Hearts Gym: Learning Reinforcement Learning as a Team Event

Gym-preCICE: Reinforcement Learning Environments for Active Flow Control

gym-gazebo2, a toolkit for reinforcement learning using ROS 2 and Gazebo