Abstract:The use of semi-autonomous Unmanned Aerial Vehicles (UAVs or drones) to support emergency response scenarios, such as fire surveillance and search-and-rescue, has the potential for huge societal benefits. Onboard sensors and artificial intelligence (AI) allow these UAVs to operate autonomously in the environment. However, human intelligence and domain expertise are crucial in planning and guiding UAVs to accomplish the mission. Therefore, humans and multiple UAVs need to collaborate as a team to conduct a time-critical mission successfully. We propose a meta-model to describe interactions among the human operators and the autonomous swarm of UAVs. The meta-model also provides a language to describe the roles of UAVs and humans and the autonomous decisions. We complement the meta-model with a template of requirements elicitation questions to derive models for specific missions. We also identify common scenarios where humans should collaborate with UAVs to augment the autonomy of the UAVs. We introduce the meta-model and the requirements elicitation process with examples drawn from a search-and-rescue mission in which multiple UAVs collaborate with humans to respond to the emergency. We then apply it to a second scenario in which UAVs support first responders in fighting a structural fire. Our results show that the meta-model and the template of questions support the modeling of the human-on-the-loop human interactions for these complex missions, suggesting that it is a useful tool for modeling the human-on-the-loop interactions for multi-UAVs missions.

Human-Drone Interactions with Semi-Autonomous Cohorts of Collaborating Drones

Firefighters' Perceptions on Collaboration and Interaction with Autonomous Drones: Results of a Field Trial

Multimodal Interaction with Multiple Co-located Drones in Search and Rescue Missions

The State-of-the-Art of Human–Drone Interaction: A Survey

The Next Generation of Human-Drone Partnerships: Co-Designing an Emergency Response System

Conceptual Design of Human-Drone Communication in Collaborative Environments

Model-Driven Requirements for Humans-on-the-Loop Multi-UAV Missions

Evaluating the Potential of Drone Swarms in Nonverbal HRI Communication

TagTeam: Towards Wearable-Assisted, Implicit Guidance for Human--Drone Teams

Communication and Coordination for Drone Networks

Working under the Shadow of Drones: Investigating Occupational Safety Hazards among Commercial Drone Pilots

Improving Human Interfaces for Commercial Camera Drone Systems

Don't Drone Yourself in Work: Discussing DronOS as a Framework for Human-Drone Interaction

Social Interaction with Drones using Human Emotion Recognition

HOLA-Drone: Hypergraphic Open-ended Learning for Zero-Shot Multi-Drone Cooperative Pursuit

HADRON: Human-friendly Control and Artificial Intelligence for Military Drone Operations

Challenges and Future Directions for Human-Drone Interaction Research: An Expert Perspective

Survey of Multi-agent Communication Strategies for Information Exchange and Mission Control of Drone Deployments

Preferred Distance in Human-Drone Interaction

Human-UAV Teaming in Dynamic and Uncertain Environments.