Abstract:The International Journal of Robotics Research, Ahead of Print. We present a coordinated autonomy pipeline for multi-sensor exploration of confined environments. We simultaneously address four broad challenges that are typically overlooked in prior work: (a) make effective use of both range and vision sensing modalities, (b) perform this exploration across a wide range of environments, (c) be resilient to adverse events, and (d) execute this onboard teams of physical robots. Our solution centers around a behavior tree architecture, which adaptively switches between various behaviors involving coordinated exploration and responding to adverse events. Our exploration strategy exploits the benefits of both visual and range sensors with a generalized frontier-based exploration algorithm and an OpenVDB-based map processing pipeline. Our local planner utilizes a dynamically feasible trajectory library and a GPU-based Euclidean distance transform map to allow fast and safe navigation through both tight doorways and expansive spaces. The autonomy pipeline is evaluated with an extensive set of field experiments, with teams of up to three robots that fly up to 3 m/s and distances exceeding 1 km in confined spaces. We provide a summary of various field experiments and detail resilient behaviors that arose: maneuvering narrow doorways, adapting to unexpected environment changes, and emergency landing. Experiments are also detailed from the DARPA Subterranean Challenge, where our proposed autonomy pipeline contributed to us winning the "Most Sectors Explored" award. We provide an extended discussion of lessons learned, release software as open source, and present a video that illustrates our extensive field trials.

AutoInspect: Towards Long-Term Autonomous Industrial Inspection

Evaluation of a Smart Mobile Robotic System for Industrial Plant Inspection and Supervision

Autonomous Robotic System for Pipeline Integrity Inspection

Toward Fully Automated Inspection of Critical Assets Supported by Autonomous Mobile Robots, Vision Sensors, and Artificial Intelligence

A Smart Robotic System for Industrial Plant Supervision

Flexible integration of robotics, ultrasonics and metrology for the inspection of aerospace components

Opportunistic (Re)planning for Long-Term Deep-Ocean Inspection: An Autonomous Underwater Architecture

Robust Autonomous Mobile Manipulation for Substation Inspection

An Intelligent Equipment Inspection System based on Robotic Arm

Multi-robot, multi-sensor exploration of multifarious environments with full mission aerial autonomy

A Surface Adaptive First-Look Inspection Planner for Autonomous Remote Sensing of Open-Pit Mines

Flexible Supervised Autonomy for Exploration in Subterranean Environments

Localisation and Navigation Framework for Autonomous Railway Robotic Inspection and Repair System

Robotic Defect Inspection with Visual and Tactile Perception for Large-scale Components

Robotic System with Power Line Communication for In-pipe Inspection of Underground Urban Gas Pipeline

Autonomous Robot Navigation with Rich Information Mapping in Nuclear Storage Environments

Inspection and maintenance of industrial infrastructure with autonomous underwater robots

Autonomous Exploration and General Visual Inspection of Ship Ballast Water Tanks using Aerial Robots

Autonomous Evolution Robotic Systems for Underwater Surveillance and Inspection

Artificial Intelligence for Long-Term Robot Autonomy: A Survey