DRAL: Deep Reinforcement Adaptive Learning for Multi-UAVs Navigation in Unknown Indoor Environment

Kangtong Mo,Linyue Chu,Xingyu Zhang,Xiran Su,Yang Qian,Yining Ou,Wian Pretorius

2024-10-10

Abstract:Autonomous indoor navigation of UAVs presents numerous challenges, primarily due to the limited precision of GPS in enclosed environments. Additionally, UAVs' limited capacity to carry heavy or power-intensive sensors, such as overheight packages, exacerbates the difficulty of achieving autonomous navigation indoors. This paper introduces an advanced system in which a drone autonomously navigates indoor spaces to locate a specific target, such as an unknown Amazon package, using only a single camera. Employing a deep learning approach, a deep reinforcement adaptive learning algorithm is trained to develop a control strategy that emulates the decision-making process of an expert pilot. We demonstrate the efficacy of our system through real-time simulations conducted in various indoor settings. We apply multiple visualization techniques to gain deeper insights into our trained network. Furthermore, we extend our approach to include an adaptive control algorithm for coordinating multiple drones to lift an object in an indoor environment collaboratively. Integrating our DRAL algorithm enables multiple UAVs to learn optimal control strategies that adapt to dynamic conditions and uncertainties. This innovation enhances the robustness and flexibility of indoor navigation and opens new possibilities for complex multi-drone operations in confined spaces. The proposed framework highlights significant advancements in adaptive control and deep reinforcement learning, offering robust solutions for complex multi-agent systems in real-world applications.

Robotics

What problem does this paper attempt to address?

The paper aims to address the problem of autonomous navigation and collaborative transportation of unknown loads by multiple Unmanned Aerial Vehicles (UAVs) in unknown indoor environments. Specifically, the paper proposes a deep reinforcement adaptive learning algorithm named DRAL (Deep Reinforcement Adaptive Learning), which enables multiple UAVs to locate specific targets (such as unknown Amazon packages) using only a single camera and to work collaboratively in unknown environments to lift objects. This method overcomes the limitations of GPS accuracy in indoor environments and the constraints of carrying large sensors, demonstrating real-time simulation effects in various indoor environments and proving its stability and adaptability. Additionally, the method introduces visualization techniques to gain a deeper understanding of the training network and extends to include adaptive control algorithms, allowing multiple UAVs to learn optimal control strategies under dynamic conditions and uncertainties. Experimental results show that compared to methods such as Q-learning, deep Q-learning, and Sarsa, DRAL exhibits significant advantages in terms of success rate and exploration time for transportation tasks.

DRAL: Deep Reinforcement Adaptive Learning for Multi-UAVs Navigation in Unknown Indoor Environment

A Learning-Based Flexible Autonomous Motion Control Method for UAV in Dynamic Unknown Environments

Autonomous Navigation of UAVs in Large-Scale Complex Environments: A Deep Reinforcement Learning Approach

Deep-learning based autonomous-exploration for UAV navigation

Relevant experience learning: A deep reinforcement learning method for UAV autonomous motion planning in complex unknown environments

Deep Reinforcement Learning Approach with Multiple Experience Pools for UAV's Autonomous Motion Planning in Complex Unknown Environments

Autonomous Navigation of UAV in Multi-Obstacle Environments Based on a Deep Reinforcement Learning Approach

UAV navigation in high dynamic environments: A deep reinforcement learning approach

Robust Motion Control for UAV in Dynamic Uncertain Environments Using Deep Reinforcement Learning.

Autonomous Navigation of UAV in Large-Scale Unknown Complex Environment with Deep Reinforcement Learning.

Autonomous UAV Navigation with Adaptive Control Based on Deep Reinforcement Learning

A UAV Navigation Approach Based on Deep Reinforcement Learning in Large Cluttered 3D Environments

A RDA-Based Deep Reinforcement Learning Approach for Autonomous Motion Planning of UAV in Dynamic Unknown Environments

Multi-Agent Deep Reinforcement Learning for UAVs Navigation in Unknown Complex Environment

An Improved Method towards Multi-UAV Autonomous Navigation Using Deep Reinforcement Learning

UAV Visual Flight Control Method Based on Deep Reinforcement Learning

Autonomous Navigation of the UAV through Deep Reinforcement Learning with Sensor Perception Enhancement

Learning to Explore Indoor Environments using Autonomous Micro Aerial Vehicles

UAV Autonomous Navigation Based on Deep Reinforcement Learning in Highly Dynamic and High-Density Environments

Deep-reinforcement-learning-based UAV autonomous navigation and collision avoidance in unknown environments

UAV Obstacle Avoidance by Human-in-the-Loop Reinforcement in Arbitrary 3D Environment