Abstract:Developing learning-based methods for navigation of aerial robots is an intensive data-driven process that requires highly parallelized simulation. The full utilization of such simulators is hindered by the lack of parallelized high-level control methods that imitate the real-world robot interface. Responding to this need, we develop the Aerial Gym simulator that can simulate millions of multirotor vehicles parallelly with nonlinear geometric controllers for the Special Euclidean Group SE(3) for attitude, velocity and position tracking. We also develop functionalities for managing a large number of obstacles in the environment, enabling rapid randomization for learning of navigation tasks. In addition, we also provide sample environments having robots with simulated cameras capable of capturing RGB, depth, segmentation and optical flow data in obstacle-rich environments. This simulator is a step towards developing a - currently missing - highly parallelized aerial robot simulation with geometric controllers at a large scale, while also providing a customizable obstacle randomization functionality for navigation tasks. We provide training scripts with compatible reinforcement learning frameworks to navigate the robot to a goal setpoint based on attitude and velocity command interfaces. Finally, we open source the simulator and aim to develop it further to speed up rendering using alternate kernel-based frameworks in order to parallelize ray-casting for depth images thus supporting a larger number of robots.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to develop an efficient and parallelized simulator for training and testing the navigation capabilities of multi - rotor aircraft (such as drones). Specifically, the researchers hope to solve the following key problems: 1. **Parallel Simulation**: Although existing simulators are powerful, they are not efficient in handling large - scale parallel simulations, especially when simulating a large number of aircraft. Therefore, a tool that can efficiently parallelize the simulation of thousands of aircraft is required. 2. **High - Fidelity Control Interface**: Many existing simulators lack parallelized advanced control methods that match the interfaces of real - world robots, which limits their effectiveness in practical applications. Therefore, it is necessary to develop non - linear geometric controllers that can run in parallel on the GPU to achieve precise tracking of the attitude, speed, and position of the aircraft. 3. **Environment Randomization**: In order to make the learning algorithm generalize better to different environments, a system that can quickly randomize environmental obstacles is required. This can ensure the diversity of training data and avoid over - fitting to specific types of obstacles. 4. **Sensor Simulation**: In order to more realistically simulate perception tasks in the real world, the aircraft needs to be equipped with simulated cameras that can capture RGB images, depth maps, segmentation maps, and optical flow data, thereby supporting vision - based navigation tasks. ### Solution To address the above challenges, the researchers developed the Aerial Gym simulator, whose main features include: - **Parallel Simulation**: Utilize the powerful functions of NVIDIA Isaac Gym to parallelize the simulation of thousands of aircraft on the GPU. - **Non - linear Geometric Controller**: Design a non - linear geometric controller for the SE(3) group and parallelize it to run efficiently on the GPU. These controllers can achieve precise tracking of the attitude, speed, and position of the aircraft. - **Environment Randomization**: Through the Asset Manager, different types of obstacles can be randomly generated in each environment to ensure the diversity and complexity of the environment. - **Sensor Simulation**: Equip the aircraft with simulated cameras that can capture multiple types of image data and support vision - based navigation tasks. ### Formula Display The formulas involved in the paper are as follows: - **Rotation Matrix Calculation**: \[ R_d = R_z(\psi)R_y(\theta_d)R_x(\phi_d) \] where \(R_j(\eta)\) represents the rotation matrix of rotating around the \(j\)-axis by an angle of \(\eta\). - **Angular Velocity Error**: \[ e_\Omega=\Omega - R^T R_d\Omega_d \] - **Attitude Tracking Error**: \[ e_R=\frac{1}{2}(R_d^T R - R^T R_d)^\vee \] - **Non - linear Controller**: \[ M = - k_R e_R - k_\Omega e_\Omega+\Omega\times J\Omega \] - **Command Acceleration Vector**: \[ a_d = k_v(v_d - v) \] - **Total Thrust and Tilt Angle**: \[ f=(a_d + mg)\cdot V\vec{b}_3 \] \[ \phi_d=\text{atan2}(- a_{d,y},\sqrt{a_{d,x}^2 + a_{d,z}^2}) \] \[ \theta_d=\text{atan2}(a_{d,x},a_{d,z}) \] Through these improvements, the Aerial Gym simulator can significantly improve the efficiency and accuracy of large - scale aircraft simulation, providing strong support for the research and development of advanced aircraft navigation algorithms.

Aerial Gym -- Isaac Gym Simulator for Aerial Robots

A Comprehensive Simulation Testbench For Aerial Robot In Dynamic Scenario Using Gazebo-Ros

FastSim: A Modular and Plug-and-Play Simulator for Aerial Robots

Air Learning: A Deep Reinforcement Learning Gym for Autonomous Aerial Robot Visual Navigation

Learning to Fly -- a Gym Environment with PyBullet Physics for Reinforcement Learning of Multi-agent Quadcopter Control

Pegasus Simulator: An Isaac Sim Framework for Multiple Aerial Vehicles Simulation

Astralis: A High-Fidelity Simulator for Heterogeneous Robot and Human-Robot Teaming

Back to Newton's Laws: Learning Vision-based Agile Flight via Differentiable Physics

GymFG: A Framework with a Gym Interface for FlightGear

Indoor Visual Exploration with Multi-Rotor Aerial Robotic Vehicles

Robotic Learning in your Backyard: A Neural Simulator from Open Source Components

SOCIALGYM 2.0: Simulator for Multi-Agent Social Robot Navigation in Shared Human Spaces

Gaussian Splatting to Real World Flight Navigation Transfer with Liquid Networks

Learning autonomous driving from aerial imagery

Orbit: A Unified Simulation Framework for Interactive Robot Learning Environments

GRADE: Generating Realistic And Dynamic Environments for Robotics Research with Isaac Sim

A Mobile Robot Experiment System with Lightweight Simulator Generator for Deep Reinforcement Learning Algorithm.

Online Aerial 2.5D Terrain Mapping and Active Aerial Vehicle Exploration for Ground Robot Navigation

RotorTM: A Flexible Simulator for Aerial Transportation and Manipulation

VisFly: An Efficient and Versatile Simulator for Training Vision-based Flight

RoboGSim: A Real2Sim2Real Robotic Gaussian Splatting Simulator