Abstract:Multi-agent Pathfinding (MAPF) problem generally asks to find a set of conflict-free paths for a set of agents confined to a graph and is typically solved in a centralized fashion. Conversely, in this work, we investigate the decentralized MAPF setting, when the central controller that posses all the information on the agents' locations and goals is absent and the agents have to sequientially decide the actions on their own without having access to a full state of the environment. We focus on the practically important lifelong variant of MAPF, which involves continuously assigning new goals to the agents upon arrival to the previous ones. To address this complex problem, we propose a method that integrates two complementary approaches: planning with heuristic search and reinforcement learning through policy optimization. Planning is utilized to construct and re-plan individual paths. We enhance our planning algorithm with a dedicated technique tailored to avoid congestion and increase the throughput of the system. We employ reinforcement learning to discover the collision avoidance policies that effectively guide the agents along the paths. The policy is implemented as a neural network and is effectively trained without any reward-shaping or external guidance. We evaluate our method on a wide range of setups comparing it to the state-of-the-art solvers. The results show that our method consistently outperforms the learnable competitors, showing higher throughput and better ability to generalize to the maps that were unseen at the training stage. Moreover our solver outperforms a rule-based one in terms of throughput and is an order of magnitude faster than a state-of-the-art search-based solver.

A LOAD BALANCE PERSONALIZED PATH FINDING WITH MULTIPLE-AGENT DEEP REINFORCEMENT LEARNING

Learning to Cooperate: Application of Deep Reinforcement Learning for Online AGV Path Finding.

Moving Forward in Formation: A Decentralized Hierarchical Learning Approach to Multi-Agent Moving Together

Multi-Agent Path Finding Method Based on Evolutionary Reinforcement Learning

Multi-Agent Path Finding via Reinforcement Learning with Hybrid Reward

Multi-agent Pathfinding with Local and Global Guidance

Learn to Follow: Decentralized Lifelong Multi-agent Pathfinding via Planning and Learning

Multiagent Path Finding Using Deep Reinforcement Learning Coupled With Hot Supervision Contrastive Loss

Anytime Multi-Agent Path Finding via Machine Learning-Guided Large Neighborhood Search

Traffic Flow Optimisation for Lifelong Multi-Agent Path Finding

Multi-Agent Path Finding with Heterogeneous Geometric and Kinematic Constraints in Continuous Space

ALPHA: Attention-based Long-horizon Pathfinding in Highly-structured Areas

Attention-based Priority Learning for Limited Time Multi-Agent Path Finding.

Scaling Lifelong Multi-Agent Path Finding to More Realistic Settings: Research Challenges and Opportunities

HiMAP: Learning Heuristics-Informed Policies for Large-Scale Multi-Agent Pathfinding

Attention-Cooperated Reinforcement Learning for Multi-agent Path Planning

Multi-Robot Path Planning Combining Heuristics and Multi-Agent Reinforcement Learning

Dynamic Path Finding for Multi-Load Agent Pickup and Delivery Problem

Lifelong Multi-Agent Path Finding in A Dynamic Environment.

Caching-Augmented Lifelong Multi-Agent Path Finding

Learning team-based navigation: a review of deep reinforcement learning techniques for multi-agent pathfinding