Abstract:This paper presents our method for enabling a UAV quadrotor, equipped with a monocular camera, to autonomously avoid collisions with obstacles in unstructured and unknown indoor environments. When compared to obstacle avoidance in ground vehicular robots, UAV navigation brings in additional challenges because the UAV motion is no more constrained to a well-defined indoor ground or street environment. Unlike ground vehicular robots, a UAV has to navigate across more types of obstacles - for e.g., objects like decorative items, furnishings, ceiling fans, sign-boards, tree branches, etc., are also potential obstacles for a UAV. Thus, methods of obstacle avoidance developed for ground robots are clearly inadequate for UAV navigation. Current control methods using monocular images for UAV obstacle avoidance are heavily dependent on environment information. These controllers do not fully retain and utilize the extensively available information about the ambient environment for decision making. We propose a deep reinforcement learning based method for UAV obstacle avoidance (OA) which is capable of doing exactly the same. The crucial idea in our method is the concept of partial observability and how UAVs can retain relevant information about the environment structure to make better future navigation decisions. Our OA technique uses recurrent neural networks with temporal attention and provides better results compared to prior works in terms of distance covered without collisions. In addition, our technique has a high inference rate and reduces power wastage as it minimizes oscillatory motion of UAV.

Learning the Spatial Perception and Obstacle Avoidance with the Monocular Vision on a Quadrotor

Autonomous Flights in Dynamic Environments with Onboard Vision

Autonomous quadrotor obstacle avoidance based on dueling double deep recurrent Q-learning with monocular vision

Monocular Vision Based Obstacle Detection for Robot Navigation in Unstructured Environment

Monocular Event-Based Vision for Obstacle Avoidance with a Quadrotor

Quadrotor Autonomous Navigation in Semi-Known Environments Based on Deep Reinforcement Learning

Obstacle Avoidance of Monocular Quadrotors with Depth Estimation

Towards Monocular Vision based Obstacle Avoidance through Deep Reinforcement Learning

Reactive Obstacle Avoidance of Monocular Quadrotors with Online Adapted Depth Prediction Network.

Fusing Stereopsis & Corner Sparse Optical Flow for Real-time Obstacle Avoidance of Unmanned Aerial Vehicle

Monocular Depth Estimation for UAV Obstacle Avoidance

Integrated moment-based LGMD and deep reinforcement learning for UAV obstacle avoidance

Memory-Based Deep Reinforcement Learning for Obstacle Avoidance in UAV With Limited Environment Knowledge

A Monocular Vision Obstacle Avoidance Method Applied to Indoor Tracking Robot

Monocular vision guided deep reinforcement learning UAV systems with representation learning perception

End-to-End Learning-Based Obstacle Avoidance for Fixed-Wing UAVs

Visual path following with obstacle avoidance for quadcopters in indoor environments

Seeing Through Pixel Motion: Learning Obstacle Avoidance from Optical Flow with One Camera

A real-time dynamic obstacle tracking and mapping system for UAV navigation and collision avoidance with an RGB-D camera

Obstacle Avoidance for Outdoor Flight of a Quadrotor Based on Computer Vision

Monocular Camera-based Complex Obstacle Avoidance via Efficient Deep Reinforcement Learning