Abstract:This article presents a complete solution for autonomous mapping and inspection tasks, namely a lightweight multi-camera drone design coupled with computationally efficient planning algorithms and environment representations for enhanced autonomous navigation in exploration and mapping tasks. The proposed system utilizes state-of-the-art Next-Best-View (NBV) planning techniques, with geometric and semantic segmentation information computed with Deep Convolutional Neural Networks (DCNNs) to improve the environment map representation. The main contributions of this article are the following. First, we propose a novel efficient sensor observation model and a utility function that encodes the expected information gains from observations taken from specific viewpoints. Second, we propose a reward function that incorporates both geometric and semantic probabilistic information provided by a DCNN for semantic segmentation that operates in close to real-time. The incorporation of semantics in the environment representation enables biasing exploration towards specific object categories while disregarding task-irrelevant ones during path planning. Experiments in both a virtual and a real scenario demonstrate the benefits on reconstruction accuracy of using semantics for biasing exploration towards task-relevant objects, when compared with purely geometric state-of-the-art methods. Finally, we present a unified approach for the selection of the number of cameras on a UAV, to optimize the balance between power consumption, flight-time duration, and exploration and mapping performance trade-offs. Unlike previous design optimization approaches, our method is couples with the sense and plan algorithms. The proposed system and general formulations can be be applied in the mapping, exploration, and inspection of any type of environment, as long as environment dependent semantic training data are available, with demonstrated successful applicability in the inspection of dry dock shipyard environments.

An Open-Source System for Vision-Based Micro-Aerial Vehicle Mapping, Planning, and Flight in Cluttered Environments

Autonomous Flights in Dynamic Environments with Onboard Vision

USV-Tracker: A Novel USV Tracking System for Surface Investigation with Limited Resources

Vision Object-Oriented Augmented Sampling-Based Autonomous Navigation for Micro Aerial Vehicles

Efficient Submap-based Autonomous MAV Exploration using Visual-Inertial SLAM Configurable for LiDARs or Depth Cameras

Safe Local Exploration for Replanning in Cluttered Unknown Environments for Micro-Aerial Vehicles

Toward Autonomy of Micro Aerial Vehicles in Unknown and Global Positioning System Denied Environments

An informative path planning framework for UAV-based terrain monitoring

Search-based 3D Planning and Trajectory Optimization for Safe Micro Aerial Vehicle Flight Under Sensor Visibility Constraints

HE-Nav: A High-Performance and Efficient Navigation System for Aerial-Ground Robots in Cluttered Environments

Scalable Autonomous Drone Flight in the Forest with Visual-Inertial SLAM and Dense Submaps Built without LiDAR

UrbanFly: Uncertainty-Aware Planning for Navigation Amongst High-Rises with Monocular Visual-Inertial SLAM Maps

Online Aerial 2.5D Terrain Mapping and Active Aerial Vehicle Exploration for Ground Robot Navigation

Multi-camera visual SLAM for autonomous navigation of micro aerial vehicles

Multiresolution Mapping and Informative Path Planning for UAV-based Terrain Monitoring

Monocular Vision based Collaborative Localization for Micro Aerial Vehicle Swarms

A Multi-UAV System for Exploration and Target Finding in Cluttered and GPS-Denied Environments

Online Aerial Terrain Mapping for Ground Robot Navigation

Overview obstacle maps for obstacle-aware navigation of autonomous drones

History-aware Autonomous Exploration in Confined Environments using MAVs

Integrated design-sense-plan architecture for autonomous geometric-semantic mapping with UAVs