Abstract:Search-and-rescue (SaR) in unknown environments requires precise, optimal, and fast decisions. Robots are promising candidates for autonomously performing SaR tasks in unknown environments. While humans use their heuristics to effectively deal with uncertainties, optimisation of multiple objectives in the presence of physical and control constraints is a mathematical challenge that requires machine computations. Thus having both human-inspired and mathematical control capabilities is desired for SaR robots. Moreover, coordinating the decisions of robots with little computation cost in large-scale SaR missions is an open challenge. Finally, in real-life data perceived by SaR robots may be prone to uncertainties. We introduce a hierarchical multi-agent control architecture that exploits non-homogeneous and imperfect perception capabilities of SaR robots, as well as the computational efficiency and robustness to failure of decentralised control methods and global performance improvement of centralised control methods. The integrated structure of the proposed control framework allows to combine human-inspired and mathematical decision making methods in a coordinated and computationally efficient way. The results of various computer-based simulations show that while the area coverage of the proposed approach is comparable to existing heuristic methods that are particularly developed for coverage-oriented SaR, the efficiency of the introduced approach in locating the trapped victims is significantly higher. Furthermore, with comparable computation times, the proposed control approach successfully avoids potential conflicts that exist in non-cooperative methods. These results confirm that the proposed multi-agent control system is capable of combining coverage-oriented and target-oriented SaR in a balanced and coordinated way.

Human-Robot Collaboration Using Monte Carlo Tree Search

Learning to Cooperate: Application of Deep Reinforcement Learning for Online AGV Path Finding.

Human-Robot Collaborative Multi-Agent Path Planning using Monte Carlo Tree Search and Social Reward Sources

Efficient Balancing A* Search for Multi-robot Collaboration with Blockchain Consensus.

Cooperative Search and Exploration in Robotic Networks

Human-Robot Collaborative Minimum Time Search through Sub-priors in Ant Colony Optimization

Cooperative multi-agent target searching: a deep reinforcement learning approach based on parallel hindsight experience replay

A Combined Hierarchical Reinforcement Learning Based Approach for Multi-Robot Cooperative Target Searching in Complex Unknown Environments

Monte Carlo Tree Search for Multi-Robot Task Allocation

Human-Aware Robot Task Planning Based on a Hierarchical Task Model

Multi-robot Source Navigation Method Based on Coordination Graph Monte Carlo Tree Search

A Collaborative Multi-Agent Model with Knowledge-Based Communication for the RoboCupRescue Simulation

UAV Swarm Cooperative Target Search: A Multi-Agent Reinforcement Learning Approach

An-Improved $\Alpha-\Mathbf{shapes}$ Algorithm for Solving Collaborative Workspaces of Dual SCARA Robots Based on Monte Carlo Method

The Modified RRT-based Cooperative Searching for Human and UAV

Multi-agent Collaboration for Feasible Collaborative Behavior Construction and Evaluation

Research on human --- robot collaboration in rescue robotics

Hierarchical Integration of Model Predictive and Fuzzy Logic Control for Combined Coverage and Target-Oriented Search-and-Rescue via Robots with Imperfect Sensors

A Multi-Robot Cooperative Searching Algorithm in Unknown Environments Based on Neural Network

Cooperative target search of multi-robot in grid map

Hierarchical Search-Based Cooperative Motion Planning