Abstract:This paper presents our method for enabling a UAV quadrotor, equipped with a monocular camera, to autonomously avoid collisions with obstacles in unstructured and unknown indoor environments. When compared to obstacle avoidance in ground vehicular robots, UAV navigation brings in additional challenges because the UAV motion is no more constrained to a well-defined indoor ground or street environment. Unlike ground vehicular robots, a UAV has to navigate across more types of obstacles - for e.g., objects like decorative items, furnishings, ceiling fans, sign-boards, tree branches, etc., are also potential obstacles for a UAV. Thus, methods of obstacle avoidance developed for ground robots are clearly inadequate for UAV navigation. Current control methods using monocular images for UAV obstacle avoidance are heavily dependent on environment information. These controllers do not fully retain and utilize the extensively available information about the ambient environment for decision making. We propose a deep reinforcement learning based method for UAV obstacle avoidance (OA) which is capable of doing exactly the same. The crucial idea in our method is the concept of partial observability and how UAVs can retain relevant information about the environment structure to make better future navigation decisions. Our OA technique uses recurrent neural networks with temporal attention and provides better results compared to prior works in terms of distance covered without collisions. In addition, our technique has a high inference rate and reduces power wastage as it minimizes oscillatory motion of UAV.

Monocular vision guided deep reinforcement learning UAV systems with representation learning perception

UAV Visual Flight Control Method Based on Deep Reinforcement Learning

End-to-End Deep Reinforcement Learning for Image-Based UAV Autonomous Control

UAV Autonomous Navigation Based on Multi-modal Perception: A Deep Hierarchical Reinforcement Learning Method

A Vision Based Deep Reinforcement Learning Algorithm for UAV Obstacle Avoidance

UAV Target Tracking Method Based on Deep Reinforcement Learning

End-to-end UAV Intelligent Training via Deep Reinforcement Learning

Integrated moment-based LGMD and deep reinforcement learning for UAV obstacle avoidance

Autonomous Navigation of the UAV through Deep Reinforcement Learning with Sensor Perception Enhancement

Vision Based Drone Obstacle Avoidance by Deep Reinforcement Learning

UAV navigation in high dynamic environments: A deep reinforcement learning approach

Deep Reinforcement Learning for Autonomous Driving by Transferring Visual Features.

Deep Reinforcement Learning-Based End-to-End Control for UAV Dynamic Target Tracking

Explainable Deep Reinforcement Learning for UAV Autonomous Navigation

Towards Monocular Vision based Obstacle Avoidance through Deep Reinforcement Learning

UAV Obstacle Avoidance by Human-in-the-Loop Reinforcement in Arbitrary 3D Environment

Memory-Based Deep Reinforcement Learning for Obstacle Avoidance in UAV With Limited Environment Knowledge

Deep Reinforcement Learning Based Local Planner for UAV Obstacle Avoidance Using Demonstration Data

Learning the Spatial Perception and Obstacle Avoidance with the Monocular Vision on a Quadrotor

Autonomous obstacle avoidance of UAV based on deep reinforcement learning

Autonomous quadrotor obstacle avoidance based on dueling double deep recurrent Q-learning with monocular vision