Abstract:Multi-agent Pathfinding (MAPF) problem generally asks to find a set of conflict-free paths for a set of agents confined to a graph and is typically solved in a centralized fashion. Conversely, in this work, we investigate the decentralized MAPF setting, when the central controller that posses all the information on the agents' locations and goals is absent and the agents have to sequientially decide the actions on their own without having access to a full state of the environment. We focus on the practically important lifelong variant of MAPF, which involves continuously assigning new goals to the agents upon arrival to the previous ones. To address this complex problem, we propose a method that integrates two complementary approaches: planning with heuristic search and reinforcement learning through policy optimization. Planning is utilized to construct and re-plan individual paths. We enhance our planning algorithm with a dedicated technique tailored to avoid congestion and increase the throughput of the system. We employ reinforcement learning to discover the collision avoidance policies that effectively guide the agents along the paths. The policy is implemented as a neural network and is effectively trained without any reward-shaping or external guidance. We evaluate our method on a wide range of setups comparing it to the state-of-the-art solvers. The results show that our method consistently outperforms the learnable competitors, showing higher throughput and better ability to generalize to the maps that were unseen at the training stage. Moreover our solver outperforms a rule-based one in terms of throughput and is an order of magnitude faster than a state-of-the-art search-based solver.

Multi-Agent Path Finding Method Based on Evolutionary Reinforcement Learning

Learning to Cooperate: Application of Deep Reinforcement Learning for Online AGV Path Finding.

Moving Forward in Formation: A Decentralized Hierarchical Learning Approach to Multi-Agent Moving Together

Multi-agent Pathfinding with Local and Global Guidance

RDE: A Hybrid Policy Framework for Multi-Agent Path Finding Problem

Multi-Agent Path Finding via Reinforcement Learning with Hybrid Reward

HiMAP: Learning Heuristics-Informed Policies for Large-Scale Multi-Agent Pathfinding

Multiagent Path Finding Using Deep Reinforcement Learning Coupled With Hot Supervision Contrastive Loss

Multi-agent Pathfinding with Communication Reinforcement Learning and Deadlock Detection

Ensembling Prioritized Hybrid Policies for Multi-agent Pathfinding

Multi-Agent Path Finding Using Imitation-Reinforcement Learning with Transformer

Multi-Agent Path Finding with Heterogeneous Geometric and Kinematic Constraints in Continuous Space

Improving Learnt Local MAPF Policies with Heuristic Search

Crowd Perception Communication-Based Multi-Agent Path Finding with Imitation Learning

Attention-Cooperated Reinforcement Learning for Multi-agent Path Planning

A LOAD BALANCE PERSONALIZED PATH FINDING WITH MULTIPLE-AGENT DEEP REINFORCEMENT LEARNING

Learning team-based navigation: a review of deep reinforcement learning techniques for multi-agent pathfinding

PCE: Multi-Agent Path Finding Via Priority-Aware Communication & Experience Learning

Cooperative Reward Shaping for Multi-Agent Pathfinding

Curriculum Learning Based Multi-Agent Path Finding for Complex Environments.

Learn to Follow: Decentralized Lifelong Multi-agent Pathfinding via Planning and Learning