Abstract:Multi-vehicle pursuit (MVP) such as autonomous police vehicles pursuing suspects is important but very challenging due to its mission and safety critical nature. While multi-agent reinforcement learning (MARL) algorithms have been proposed for MVP problem in structured grid-pattern roads, the existing algorithms use randomly training samples in centralized learning, which leads to homogeneous agents showing low collaboration performance. For the more challenging problem of pursuing multiple evading vehicles, these algorithms typically select a fixed target evading vehicle for pursuing vehicles without considering dynamic traffic situation, which significantly reduces pursuing success rate. To address the above problems, this paper proposes a Progression Cognition Reinforcement Learning with Prioritized Experience for MVP (PEPCRL-MVP) in urban multi-intersection dynamic traffic scenes. PEPCRL-MVP uses a prioritization network to assess the transitions in the global experience replay buffer according to the parameters of each MARL agent. With the personalized and prioritized experience set selected via the prioritization network, diversity is introduced to the learning process of MARL, which can improve collaboration and task related performance. Furthermore, PEPCRL-MVP employs an attention module to extract critical features from complex urban traffic environments. These features are used to develop progression cognition method to adaptively group pursuing vehicles. Each group efficiently target one evading vehicle in dynamic driving environments. Extensive experiments conducted with a simulator over unstructured roads of an urban area show that PEPCRL-MVP is superior to other state-of-the-art methods. Specifically, PEPCRL-MVP improves pursuing efficiency by 3.95% over TD3-DMAP and its success rate is 34.78% higher than that of MADDPG. Codes are open sourced.

Large Scale Pursuit-Evasion under Collision Avoidance Using Deep Reinforcement Learning.

Multi-Agent Cooperative Pursuit-Evasion Control Using Gene Expression Programming

Distributed Pursuit-Evasion Game of Limited Perception USV Swarm Based on Multiagent Proximal Policy Optimization

Bearing Angle Measurement Based Cooperative Pursuit-Evasion Game in Non-Convex Environments

Coordination and Control in Multiagent Systems for Enhanced Pursuit-Evasion Game Performance

Learning to Play Pursuit-Evasion with Dynamic and Sensor Constraints

Crafting a robotic swarm pursuit–evasion capture strategy using deep reinforcement learning

Cooperative Pursuit with Multiple Pursuers based on Deep Minimax Q-learning

Multi-UAV Pursuit-Evasion with Online Planning in Unknown Environments by Deep Reinforcement Learning

Decentralized optimal large scale multi-player pursuit-evasion strategies: A mean field game approach with reinforcement learning

Learning Effective Communication for Cooperative Pursuit with Multi-Agent Reinforcement Learning

Adaptive Optimal Control via Q-Learning for Multi-Agent Pursuit-Evasion Games

Multi-Target Pursuit by a Decentralized Heterogeneous UAV Swarm using Deep Multi-Agent Reinforcement Learning

Coordinated control of multiple mobile robots in pursuit-evasion games

Learning Vision-based Pursuit-Evasion Robot Policies

Game of Drones: Multi-UAV Pursuit-Evasion Game With Online Motion Planning by Deep Reinforcement Learning

Learning Multi-Pursuit Evasion for Safe Targeted Navigation of Drones

Cooperative multi-agent target searching: a deep reinforcement learning approach based on parallel hindsight experience replay

Progression Cognition Reinforcement Learning with Prioritized Experience for Multi-Vehicle Pursuit

Multi-AUV Pursuit-Evasion Game in the Internet of Underwater Things: an Efficient Training Framework Via Offline Reinforcement Learning

Autonomous Decision Making for UAV Cooperative Pursuit-Evasion Game with Reinforcement Learning