Abstract:Drones have performed various tasks, such as surveillance, photography, agriculture, and package delivery. However, these tasks typically involve drones simply observing or capturing information from their surroundings without physically interacting with them. Aerial manipulation shifts this paradigm and implements drones with robotic arms that allow interaction with the environment rather than simply touching it. For example, in construction, aerial manipulation in conjunction with human interaction could allow operators to perform several tasks, such as hosing decks, drilling into surfaces, and sealing cracks via a drone. For over a decade, researchers have been working on aerial manipulation for industrial applications. These works are valuable to aerial manipulation but have not been widespread in the public domain yet. This is because most of the works are conducted in controlled indoor environments (e.g., motion capture systems), and the knowledge gap exists between researchers and the wider public who are interested in deploying aerial manipulation for practical tasks. To fill this gap, our recent work integrated the worker's experience into aerial manipulation using haptic technology. The net effect is that such a human-in-the-loop system could enable workers to leverage their experience to complete manipulation tasks while remotely controlling a mobile manipulating drone on the task site. The system increased the feasibility and adaptiveness of aerial manipulation. The remaining challenges are completing tasks beyond the operator's line-of-sight and lack of dexterity. To address the challenges, we present a human-embodied drone interface in this article. The interface consists of immersive virtual/augmented reality and haptic technologies. Such an interface allows the drones to embody and transport the operator's senses, actions, and presence to a remote location in real-time. Therefore, the operator can both physically interact with the environment and socially interact with actual workers on the worksite. Two different human-embodied interfaces are developed and tested with several tasks suggested by the United States Department-of-Transportation: pick-and-place, drilling, peg-in-hole, and key insert/rotation. The conclusion describes the advantages and challenges of the interface with future works.

Improving Human Interfaces for Commercial Camera Drone Systems

Web-based Interactive Drone Control Using Hand Gesture

Human-embodied drone interface for aerial manipulation: advantages and challenges

Working under the Shadow of Drones: Investigating Occupational Safety Hazards among Commercial Drone Pilots

The State-of-the-Art of Human–Drone Interaction: A Survey

FlightAR: AR Flight Assistance Interface with Multiple Video Streams and Object Detection Aimed at Immersive Drone Control

Improving Usability, Efficiency, and Safety of UAV Path Planning through a Virtual Reality Interface

Challenges and Future Directions for Human-Drone Interaction Research: An Expert Perspective

A Natural Human-Drone Embodied Interface: Empirical Comparison With a Traditional Interface

Evaluation of Human-Robot Interfaces based on 2D/3D Visual and Haptic Feedback for Aerial Manipulation

InDrone: a 2D-based drone flight behavior visualization platform for indoor building inspection

Challenges in Close-Proximity Safe and Seamless Operation of Manned and Unmanned Aircraft in Shared Airspace

Drone Control in AR: An Intuitive System for Single-Handed Gesture Control, Drone Tracking, and Contextualized Camera Feed Visualization in Augmented Reality

User Preferences in Drone Design and Operation

Designing Drone Game for Construction Site Inspection

Intelligently Assisting Human-Guided Quadcopter Photography

Evaluating the Potential of Drone Swarms in Nonverbal HRI Communication

Human drone interaction in delivery of medical supplies: A scoping review of experimental studies

Conceptual Design of Human-Drone Communication in Collaborative Environments

HADRON: Human-friendly Control and Artificial Intelligence for Military Drone Operations