Abstract:In this work, a novel, end-to-end motion planning method is proposed for quadrotor navigation in cluttered environments. The proposed method circumvents the explicit sensing-reconstructing-planning in contrast to conventional navigation algorithms. It uses raw depth images obtained from a front-facing camera and directly generates local motion plans in the form of smooth motion primitives that move a quadrotor to a goal by avoiding obstacles. Promising training and testing results are presented in both AirSim simulations and real flights with DJI F330 Quadrotor equipped with Intel RealSense D435. The proposed system in action can be found in <a class="link-external link-https" href="https://youtu.be/pYvKhc8wrTM" rel="external noopener nofollow">this https URL</a>.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: in a partially known complex environment, how can a quadrotor achieve autonomous navigation? Specifically, when a quadrotor is flying in an environment where only the rough path is known but there is no information about the positions of obstacles, it needs to generate a local motion plan based on online sensor data to reach the target location safely and quickly. ### Specific description of the problem 1. **Environmental conditions**: - The environment is partially known, that is, only the approximate path from the starting point to the target is known, but the positions of obstacles on the path are not clear. 2. **Task requirements**: - The quadrotor needs to generate a local motion plan based on its online sensor data (such as depth images) to avoid obstacles and reach the target location safely and quickly. 3. **Limitations of existing methods**: - Traditional navigation algorithms usually divide perception, reconstruction, and planning into three independent modules, which may lead to incompatibility between modules. Especially when an error occurs in a certain module, the entire system may fail. ### Solution To overcome the above problems, the paper proposes an end - to - end motion planning method based on Deep Reinforcement Learning (DRL). This method directly uses the raw depth images from the front - facing camera to generate smooth motion primitives, thus bypassing the explicit perception - reconstruction - planning process. The main features of this method include: - **Input**: Raw depth images and relative position information. - **Output**: Select appropriate motion primitives to generate a local motion plan. - **Model**: A Deep Q - Network (DQN) with approximately 75,000 parameters is used, which can handle complex action - value function estimation problems. In this way, the paper aims to build a reliable and unified module that can achieve safe autonomous navigation of quadrotors in complex environments. ### Core contributions of the paper - Propose a novel end - to - end motion planning method suitable for autonomous navigation of quadrotors in complex environments. - Use deep reinforcement learning techniques to directly generate motion plans from raw sensor data, simplifying the traditional navigation process. - Demonstrate the effectiveness and robustness of this method in the AirSim simulation environment and real - flight tests. In summary, the goal of this paper is to develop a method that can achieve autonomous navigation of quadrotors in partially known environments and improve the overall performance and reliability of the system through deep reinforcement learning techniques.

End-to-End Motion Planning of Quadrotors Using Deep Reinforcement Learning

Autonomous Flights in Dynamic Environments with Onboard Vision

Internal and External Disturbances Aware Motion Planning and Control for Quadrotors

A Reinforcement Learning Based Motion Planner for Quadrotor Autonomous Flight in Dense Environment

An End-to-End Deep Reinforcement Learning Method for UAV Autonomous Motion Planning

Deep Reinforcement Learning for End-to-End Local Motion Planning of Autonomous Aerial Robots in Unknown Outdoor Environments: Real-Time Flight Experiments

Real-time Quadrotor Navigation Through Planning in Depth Space in Unstructured Environments

Deep Reinforcement Learning-based Quadcopter Controller: A Practical Approach and Experiments

A RDA-Based Deep Reinforcement Learning Approach for Autonomous Motion Planning of UAV in Dynamic Unknown Environments

A Motion Camouflage-Inspired Path Planning Method for UAVs Based on Reinforcement Learning

Rapid Quadrotor Navigation in Diverse Environments using an Onboard Depth Camera

Collision Avoidance and Navigation for a Quadrotor Swarm Using End-to-end Deep Reinforcement Learning

Combining Motion Planner and Deep Reinforcement Learning for UAV Navigation in Unknown Environment

Learning Agile Flight Maneuvers: Deep SE(3) Motion Planning and Control for Quadrotors

Quadrotor Autonomous Navigation in Semi-Known Environments Based on Deep Reinforcement Learning

Deep Reinforcement Learning for Motion Planning of Mobile Robots

Deep Drone Racing: Learning Agile Flight in Dynamic Environments

Decentralized Motion Planning for Multi-Robot Navigation using Deep Reinforcement Learning

Quadrotor Mapless Navigation in Static and Dynamic Environments Based on Deep Reinforcement Learning

Data-driven Offline Reinforcement Learning Approach for Quadrotor’s Motion and Path Planning

End-to-end Reinforcement Learning for Time-Optimal Quadcopter Flight