Abstract:Aiming at the problem of integrated task assignment and trajectory planning of a massive number of agents in the scenario with different priority task nodes and multiple static obstacles, this paper proposes a general framework based on bilayer-coupled mean field games, which couples the minimum cost of trajectory planning of an agent in the task assignment process to achieve a reasonable, globally optimal, and targeted adjustable assignment result. In the proposed general framework, firstly, the multi-population mean field game is used to plan the optimal trajectory of an agent between each pair of priority adjacent task nodes, and the minimum costs are calculated. Then, based on the discrete time finite state space mean field game, a task assignment model in the discrete task space is constructed, and the minimum costs obtained in the trajectory planning are coupled into the model as a reference, the task assignment strategies are finally obtained. Moreover, we give a specific example of the proposed general framework and prove the existence of equilibrium solutions of two mean field games. The effectiveness of the proposed general framework is demonstrated through simulation experiments and results analysis. Note to Practitioners —In multi-agent decision-making and control, task assignment and trajectory planning are two fundamental problems that coexist in many scenarios. Examples include the collaborative exploration of multiple task areas by UAV swarm, and the lane selection and efficient driving of autonomous vehicles. There are many methods for dealing with the integrated task assignment and trajectory planning. However, they have difficulties in dealing with large-scale agent problems, mainly due to the significant increase in communication and computation costs as the number of agents increases. In response to this problem, based on the characteristic of mean field game that transforms the game between individuals into a game between an individual and the whole, this paper proposes a general framework of bilayer-coupled mean field games for the scenario with different priority task nodes and multiple static obstacles. The multi-population mean field game is used to plan the optimal trajectory of agents, and the discrete time finite state space mean field game is utilized for task assignment, in which the cost of trajectory planning between task nodes is considered. We propose a specific example model and theoretically prove the existence of an equilibrium solution of this model. The effectiveness of the general framework is verified by simulation experiments and results analysis.

Hierarchical Learning with Heuristic Guidance for Multi-task Assignment and Distributed Planning in Interactive Scenarios

Optimization-based Motion Planning for Autonomous Parking Considering Dynamic Obstacle: A Hierarchical Framework

Moving Forward in Formation: A Decentralized Hierarchical Learning Approach to Multi-Agent Moving Together

Learning Hierarchical Behavior and Motion Planning for Autonomous Driving.

A coordinated scheduling approach for task assignment and multi-agent path planning

A Hierarchical Framework for Cooperative Tasks in Multi-agent Systems

Multi-UAV Cooperative Motion Planning under Global Spatio-Temporal Path Inspiration in Constraint-Rich Dynamic Environments

Multi-UAV Adaptive Cooperative Formation Trajectory Planning Based on an Improved MATD3 Algorithm of Deep Reinforcement Learning

Hierarchical Perception-Improving for Decentralized Multi-Robot Motion Planning in Complex Scenarios

An Enhanced Hierarchical Planning Framework for Multi-Robot Autonomous Exploration

Reinforcement Learning Assisted Multi-UAV Task Allocation and Path Planning for IIoT

Task Allocation and Path Planning for Multiple Destinations Oriented Towards Task Updates

Hierarchical Task Assignment Strategy for Heterogeneous Multi-UAV System in Large-Scale Search and Rescue Scenarios

A Hierarchical Framework For Coordinating Large-Scale Robot Networks

D-HAL: Distributed Hierarchical Adversarial Learning for Multi-Agent Interaction in Autonomous Intersection Management

Hierarchical Planning for Autonomous Parking in Dynamic Environments

Knowledge Distillation-Based Edge-Decision Hierarchies for Interactive Behavior-Aware Planning in Autonomous Driving System

Integrated Task Assignment and Trajectory Planning for a Massive Number of Agents Based on Bilayer-Coupled Mean Field Games

Hierarchical Q-Learning Path Planning for Cooperative Tracking Control of Multi-Agent Systems with Lumped Uncertainties

Decentralized Multi-Agent Trajectory Planning in Dynamic Environments with Spatiotemporal Occupancy Grid Maps

Hierarchical Control Framework for Path Planning of Mobile Robots in Dynamic Environments Through Global Guidance and Reinforcement Learning