Abstract:Robotic shepherding is a bio-inspired approach to autonomously guiding a swarm of agents towards a desired location. The research area has earned increasing research interest recently due to the efficacy of controlling a large number of agents in a swarm (sheep) using a smaller number of actuators (sheepdogs). However, shepherding a highly dispersed swarm in an obstacle-cluttered environment remains challenging for existing methods. To improve the efficacy of shepherding in complex environments with obstacles and dispersed sheep, this paper proposes a planning-assisted context-sensitive autonomous shepherding framework with collision avoidance abilities. The proposed approach models the swarm shepherding problem as a single Travelling Salesperson Problem (TSP), with two sheepdogs\textquoteright\ modes: no-interaction and interaction. An adaptive switching approach is integrated into the framework to guide real-time path planning for avoiding collisions with static and dynamic obstacles; the latter representing moving sheep swarms. We then propose an overarching hierarchical mission planning system, which is made of three sub-systems: a clustering approach to group and distinguish sheep sub-swarms, an Ant Colony Optimisation algorithm as a TSP solver for determining the optimal herding sequence of the sub-swarms, and an online path planner for calculating optimal paths for both sheepdogs and sheep. The experiments on various environments, both with and without obstacles, objectively demonstrate the effectiveness of the proposed shepherding framework and planning approaches.

Learning to Herd Agents Amongst Obstacles: Training Robust Shepherding Behaviors Using Deep Reinforcement Learning

Learning to Cooperate: Application of Deep Reinforcement Learning for Online AGV Path Finding.

Air-to-ground Shepherd Problem: an Action-Delay Reinforcement Learning Approach

Hierarchical Decision and Control for Continuous Multitarget Problem: Policy Evaluation with Action Delay

Mapless Collaborative Navigation for a Multi-Robot System Based on the Deep Reinforcement Learning

Continuous Deep Hierarchical Reinforcement Learning for Ground-Air Swarm Shepherding

Reactive shepherding along a dynamic path

Emergent Cooperative Strategies for Multi-Agent Shepherding via Reinforcement Learning

Planning-Assisted Context-Sensitive Autonomous Shepherding of Dispersed Robotic Swarms in Obstacle-Cluttered Environments

Robotic Shepherding in Cluttered and Unknown Environments using Control Barrier Functions

A Comprehensive Review of Shepherding as a Bio-inspired Swarm-Robotics Guidance Approach

Autonomous Vehicle Patrolling Through Deep Reinforcement Learning: Learning to Communicate and Cooperate

Multi-robots Formation and Navigation Based Reinforcement Learning

Flocking of Under-Actuated Unmanned Surface Vehicles via Deep Reinforcement Learning and Model Predictive Path Integral Control

Relative Distributed Formation and Obstacle Avoidance with Multi-agent Reinforcement Learning

Reinforcement learning for multi-agent formation navigation with scalability

Multi-Agent Reinforcement Learning-Based UAV Pathfinding for Obstacle Avoidance in Stochastic Environment

Hierarchical Reinforcement Learning with Opponent Modeling for Distributed Multi-agent Cooperation

Hierarchical Reinforcement Learning for Swarm Confrontation with High Uncertainty

Flocking Control of UAV Swarms with Deep Reinforcement Leaming Approach

Multi-robot Cooperative Object Transportation using Decentralized Deep Reinforcement Learning