Abstract:Multi-agent Pathfinding (MAPF) problem generally asks to find a set of conflict-free paths for a set of agents confined to a graph and is typically solved in a centralized fashion. Conversely, in this work, we investigate the decentralized MAPF setting, when the central controller that posses all the information on the agents' locations and goals is absent and the agents have to sequientially decide the actions on their own without having access to a full state of the environment. We focus on the practically important lifelong variant of MAPF, which involves continuously assigning new goals to the agents upon arrival to the previous ones. To address this complex problem, we propose a method that integrates two complementary approaches: planning with heuristic search and reinforcement learning through policy optimization. Planning is utilized to construct and re-plan individual paths. We enhance our planning algorithm with a dedicated technique tailored to avoid congestion and increase the throughput of the system. We employ reinforcement learning to discover the collision avoidance policies that effectively guide the agents along the paths. The policy is implemented as a neural network and is effectively trained without any reward-shaping or external guidance. We evaluate our method on a wide range of setups comparing it to the state-of-the-art solvers. The results show that our method consistently outperforms the learnable competitors, showing higher throughput and better ability to generalize to the maps that were unseen at the training stage. Moreover our solver outperforms a rule-based one in terms of throughput and is an order of magnitude faster than a state-of-the-art search-based solver.

Anytime Automatic Algorithm Selection for the Multi-Agent Path Finding Problem

Learning to Cooperate: Application of Deep Reinforcement Learning for Online AGV Path Finding.

No Panacea in Planning: Algorithm Selection for Suboptimal Multi-Agent Path Finding

Anytime Multi-Agent Path Finding via Machine Learning-Guided Large Neighborhood Search

Algorithm Selection for Optimal Multi-Agent Path Finding via Graph Embedding

Automatic Algorithm Selection for Pseudo-Boolean Optimization with Given Computational Time Limits

CL-MAPF: Multi-Agent Path Finding for Car-Like robots with kinematic and spatiotemporal constraints

Learn to Follow: Decentralized Lifelong Multi-agent Pathfinding via Planning and Learning

Improving Learnt Local MAPF Policies with Heuristic Search

Automatic discovery of optimal meta-solvers via multi-objective optimization

Multi-Agent Path Finding Method Based on Evolutionary Reinforcement Learning

Safe Multi-Agent Pathfinding with Time Uncertainty

Multi-Agent Path Finding with Heterogeneous Geometric and Kinematic Constraints in Continuous Space

MS*: A New Exact Algorithm for Multi-agent Simultaneous Multi-goal Sequencing and Path Finding

MGCBS: An Optimal and Efficient Algorithm for Solving Multi-Goal Multi-Agent Path Finding Problem

Dynamic Programming based Local Search approaches for Multi-Agent Path Finding problems on Directed Graphs

Scalable Mechanism Design for Multi-Agent Path Finding

Improved Anonymous Multi-Agent Path Finding Algorithm

A stochastic process approach for multi-agent path finding with non-asymptotic performance guarantees

Attention-based Priority Learning for Limited Time Multi-Agent Path Finding.

Compilation-based Solvers for Multi-Agent Path Finding: a Survey, Discussion, and Future Opportunities