Abstract:A unified framework for multi-agent task assignment and distributed trajectory planning that can autonomously adapt to complex interactive environments and multi-task constraints has always been the bottleneck of unmanned cluster task. In multi-agent systems such as smart parking lots and smart intersections, tasks are time-varying with dynamically interactive agents, which cause the challenges such as inefficient assignment, spatiotemporal conflict and poor adaptive ability. Focusing on them, this paper proposes a hierarchical framework that combines centralized task assignment module with a multi-agent reinforcement learning based distributed trajectory planning module, which has a good scalability and task adaptability. The benefit of the proposed hierarchical framework is that it utilizes behavioral heuristic of congestion level and planning cost during assignment to motivate the appropriate assignment, which achieve an organic integration of multiple objectives. In terms of spatiotemporal conflicts for multi-agent, a weighted network structure is designed to capture dynamic obstacle information while introducing conflict constraints for collision avoidance policy optimization. Furthermore, in order to cope with changing tasks, re-assignment and re-planning mechanisms are incorporated into the framework, as well as the graph encoding layer which is adaptive to the uncertain tasks. Extensive experiments are conducted in autonomous parking scenarios to validate the effectiveness of the approach in task assignment and path conflict mitigation. Compared with other state of art methods, the task assignment and overall success rates have increased by 12.1% and 6.8%, respectively, with negligible computing time.

Parallel Automatic Hierarchy in Hierarchical Reinforcement Learning

Algorithm for Automatic Constructing Option Based on Multi-Agent

Moving Forward in Formation: A Decentralized Hierarchical Learning Approach to Multi-Agent Moving Together

Dynamic Hierarchies in Hierarchical Reinforcement Learning

Hierarchical Reinforcement Learning in Complex 3D Environments

Automatic formation of the structure of abstract machines in hierarchical reinforcement learning with state clustering

Subgoal-based Hierarchical Reinforcement Learning for Multi-Agent Collaboration

Hierarchical Reinforcement Learning with an Automatically Generated Hierarchy Based on Immune Clustering

Option Automatic Generation in Hierarchical Reinforcement Learning

Hierarchical Method for Cooperative Multiagent Reinforcement Learning in Markov Decision Processes

Automatic hierarchical approach of MAXQ based on action space partition

HELSA: Hierarchical Reinforcement Learning with Spatiotemporal Abstraction for Large-Scale Multi-Agent Path Finding

A Hierarchical Framework for Cooperative Tasks in Multi-agent Systems

Advances in Hierarchical Reinforcement Learning

Multi-Agent Hierarchical Reinforcement Learning by Integrating Options into MAXQ

Automatic Discovery and Transfer of Maxq Hierarchies in A Complex System

Automatically Discovering Hierarchies in Multi-agent Reinforcement Learning

Hierarchical Reinforcement Learning with Advantage-Based Auxiliary Rewards

Deep Multi-Agent Reinforcement Learning with Discrete-Continuous Hybrid Action Spaces

Hierarchical Learning with Heuristic Guidance for Multi-task Assignment and Distributed Planning in Interactive Scenarios