Abstract:Multi-Agent Reinforcement Learning (MARL) has enjoyed significant recent progress thanks, in part, to the integration of deep learning techniques for modeling interactions in complex environments. This is naturally starting to benefit multi-robot systems (MRS) in the form of multi-robot RL (MRRL). However, existing infrastructure to train and evaluate policies predominantly focus on the challenges of coordinating virtual agents, and ignore characteristics important to robotic systems. Few platforms support realistic robot dynamics, and fewer still can evaluate Sim2Real performance of learned behavior. To address these issues, we contribute MARBLER: Multi-Agent RL Benchmark and Learning Environment for the Robotarium. MARBLER offers a robust and comprehensive evaluation platform for MRRL by marrying Georgia Tech's Robotarium (which enables rapid deployment on physical MRS) and OpenAI's Gym interface (which facilitates standardized use of modern learning algorithms). MARBLER offers a highly controllable environment with realistic dynamics, including barrier certificate-based obstacle avoidance. It allows anyone across the world to train and deploy MRRL algorithms on a physical testbed with reproducibility. Further, we introduce five novel scenarios inspired by common challenges in MRS and provide support for new custom scenarios. Finally, we use MARBLER to evaluate popular MARL algorithms and provide insights into their suitability for MRRL. In summary, MARBLER can be a valuable tool to the MRS research community by facilitating comprehensive and standardized evaluation of learning algorithms on realistic simulations and physical hardware. Links to our open-source framework and videos of real-world experiments can be found at <a class="link-external link-https" href="https://shubhlohiya.github.io/MARBLER/" rel="external noopener nofollow">this https URL</a>.

MushroomRL: Simplifying Reinforcement Learning Research

Craftium: An Extensible Framework for Creating Reinforcement Learning Environments

Scilab-RL: A software framework for efficient reinforcement learning and cognitive modeling research

A Survey on Explainable Reinforcement Learning: Concepts, Algorithms, Challenges

Efficient Reinforcement Learning Development with RLzoo

EasyRL4Rec: An Easy-to-use Library for Reinforcement Learning Based Recommender Systems

SERL: A Software Suite for Sample-Efficient Robotic Reinforcement Learning

Cleanba: A Reproducible and Efficient Distributed Reinforcement Learning Platform

PufferLib: Making Reinforcement Learning Libraries and Environments Play Nice

rl_reach: Reproducible Reinforcement Learning Experiments for Robotic Reaching Tasks

ChainerRL: A Deep Reinforcement Learning Library

ReLIC: A Recipe for 64k Steps of In-Context Reinforcement Learning for Embodied AI

ShinRL: A Library for Evaluating RL Algorithms from Theoretical and Practical Perspectives

Decoding Reinforcement Learning for newcomers

MARBLER: An Open Platform for Standardized Evaluation of Multi-Robot Reinforcement Learning Algorithms

Efficient Reinforcement Learning via Decoupling Exploration and Utilization

Glue - Enhancing Compatibility and Flexibility of Reinforcement Learning Platforms by Decoupling Algorithms and Environments.

RLtools: A Fast, Portable Deep Reinforcement Learning Library for Continuous Control

Acme: A Research Framework for Distributed Reinforcement Learning

Reinforcement Learning with Foundation Priors: Let the Embodied Agent Efficiently Learn on Its Own

PLANRL: A Motion Planning and Imitation Learning Framework to Bootstrap Reinforcement Learning