Abstract:Multi-agent Pathfinding (MAPF) problem generally asks to find a set of conflict-free paths for a set of agents confined to a graph and is typically solved in a centralized fashion. Conversely, in this work, we investigate the decentralized MAPF setting, when the central controller that posses all the information on the agents' locations and goals is absent and the agents have to sequientially decide the actions on their own without having access to a full state of the environment. We focus on the practically important lifelong variant of MAPF, which involves continuously assigning new goals to the agents upon arrival to the previous ones. To address this complex problem, we propose a method that integrates two complementary approaches: planning with heuristic search and reinforcement learning through policy optimization. Planning is utilized to construct and re-plan individual paths. We enhance our planning algorithm with a dedicated technique tailored to avoid congestion and increase the throughput of the system. We employ reinforcement learning to discover the collision avoidance policies that effectively guide the agents along the paths. The policy is implemented as a neural network and is effectively trained without any reward-shaping or external guidance. We evaluate our method on a wide range of setups comparing it to the state-of-the-art solvers. The results show that our method consistently outperforms the learnable competitors, showing higher throughput and better ability to generalize to the maps that were unseen at the training stage. Moreover our solver outperforms a rule-based one in terms of throughput and is an order of magnitude faster than a state-of-the-art search-based solver.

Lifelong Multi-Agent Path Finding in A Dynamic Environment.

Learning to Cooperate: Application of Deep Reinforcement Learning for Online AGV Path Finding.

Moving Forward in Formation: A Decentralized Hierarchical Learning Approach to Multi-Agent Moving Together

Incremental Conflict-Based Search for Multi-agent Path Finding in Dynamic Environment

Multi-Agent Path Finding with Heterogeneous Geometric and Kinematic Constraints in Continuous Space

Dynamic Path Finding for Multi-Load Agent Pickup and Delivery Problem

Multi-agent Pathfinding with Local and Global Guidance

Traffic Flow Optimisation for Lifelong Multi-Agent Path Finding

Lifelong Multi-Agent Path Finding in Large-Scale Warehouses

A coordinated scheduling approach for task assignment and multi-agent path planning

Lifelong Multi-Agent Path Finding for Online Pickup and Delivery Tasks

Transient Multi-Agent Path Finding for Lifelong Navigation in Dense Environments

Learn to Follow: Decentralized Lifelong Multi-agent Pathfinding via Planning and Learning

Lifelong Path Planning with Kinematic Constraints for Multi-Agent Pickup and Delivery

Towards Deployment-Efficient and Collision-Free Multi-Agent Path Finding (student Abstract).

MGCBS: An Optimal and Efficient Algorithm for Solving Multi-Goal Multi-Agent Path Finding Problem

Scaling Lifelong Multi-Agent Path Finding to More Realistic Settings: Research Challenges and Opportunities

Caching-Augmented Lifelong Multi-Agent Path Finding

CL-MAPF: Multi-Agent Path Finding for Car-Like robots with kinematic and spatiotemporal constraints

Multi-Agent Path Finding with Real Robot Dynamics and Interdependent Tasks for Automated Warehouses

Integrated Task Assignment and Path Planning for Capacitated Multi-Agent Pickup and Delivery