OmniDrones: An Efficient and Flexible Platform for Reinforcement Learning in Drone Control

Botian Xu,Feng Gao,Chao Yu,Ruize Zhang,Yi Wu,Yu Wang

2023-09-22

Abstract:In this work, we introduce OmniDrones, an efficient and flexible platform tailored for reinforcement learning in drone control, built on Nvidia's Omniverse Isaac Sim. It employs a bottom-up design approach that allows users to easily design and experiment with various application scenarios on top of GPU-parallelized simulations. It also offers a range of benchmark tasks, presenting challenges ranging from single-drone hovering to over-actuated system tracking. In summary, we propose an open-sourced drone simulation platform, equipped with an extensive suite of tools for drone learning. It includes 4 drone models, 5 sensor modalities, 4 control modes, over 10 benchmark tasks, and a selection of widely used RL baselines. To showcase the capabilities of OmniDrones and to support future research, we also provide preliminary results on these benchmark tasks. We hope this platform will encourage further studies on applying RL to practical drone systems.

Robotics,Artificial Intelligence

What problem does this paper attempt to address?

This paper aims to solve several key problems in multi - rotor UAV control by introducing an efficient and flexible reinforcement learning platform named OmniDrones. Specifically, the OmniDrones platform focuses on the following aspects:

1. **Improve simulation efficiency**: Based on Nvidia's Omniverse Isaac Sim, OmniDrones can achieve a data collection speed of more than 105 steps per second, which is crucial for large - scale application of reinforcement learning methods.

2. **Enhance flexibility**: The platform provides four commonly - used UAV models, four control modes and five sensor modalities, and these components are easy to expand. Users can easily import their own models and add custom dynamic characteristics.

3. **Support reinforcement learning**: OmniDrones contains a series of diverse single - agent and multi - agent tasks with different challenges and difficulty levels. Tasks can be easily extended and seamlessly integrated with modern reinforcement learning libraries.

4. **Provide benchmark test results**: In order to demonstrate the functions of OmniDrones and support future research, the authors implemented and evaluated a variety of popular single - agent and multi - agent reinforcement learning algorithms on the platform and provided preliminary benchmark test results.

Through these functions, the OmniDrones platform hopes to encourage more researchers to explore the potential of applying reinforcement learning to actual UAV systems, especially in multi - agent coordination, adaptive control and modular UAV design.