A Problem In Psychoanalytic Technique

F. G. Worden

DOI: https://doi.org/10.1177/000306515500300206

IF: 0.919

1955-04-01

Journal of the American Psychoanalytic Association

Abstract:

What problem does this paper attempt to address?

Large Scale Pursuit-Evasion under Collision Avoidance Using Deep Reinforcement Learning.

Helei Yang,Peng Ge,Junjie Cao,Yifan Yang,Yong Liu

DOI: https://doi.org/10.1109/iros55552.2023.10341975

2023-01-01

Abstract:This paper examines a pursuit-evasion game (PEG) involving multiple pursuers and evaders. The decentralized pursuers aim to collaborate to capture the faster evaders while avoiding collisions. The policies of all agents are learning-based and are subjected to kinematic constraints that are specific to unicycles. To address the challenge of high dimensionality encountered in large-scale scenarios, we propose a state processing method named Mix-Attention, which is based on Self-Attention. This method effectively mitigates the curse of dimensionality. The simulation results provided in this study demonstrate that the combination of Mix-Attention and Independent Proximal Policy Optimization (IPPO) surpasses alternative approaches when solving the multi-pursuer multi-evader PEG, particularly as the number of entities increases. Moreover, the trained policies showcase their ability to adapt to scenarios involving varying numbers of agents and obstacles without requiring retraining. This adaptability showcases their transferability and robustness. Finally, our proposed approach has been validated through physical experiments conducted with six robots.
Coordination and Control in Multiagent Systems for Enhanced Pursuit-Evasion Game Performance

Hua Zhuang,Pengqun Gao,Xiaotong Wu,Ying Zhang,Huayi Jia

DOI: https://doi.org/10.1007/s13235-024-00584-5

2024-09-05

Dynamic Games and Applications

Abstract:This study introduces a creative approach called the Hybrid Deep Reinforcement Learning Approach (HYDREIL), which aims to improve coordination and control within the multiagent system for pursuit-evasion games. By combining the advanced techniques of DRL, this study can provide a strong foundation for improving the performance of pursuit-evasion games. The proposed HYDREIL combines the Improved Deep Deterministic Policy Gradient Algorithm (IDDPG) with fuzzy logic and the BFGS algorithm based on the Armijo-Goldstein criterion with the Deep Q Neural Network (DQN). Traditional techniques lag in coordinating with complex and robust systems. The combination provides a robust framework that addresses the difficulties of coordinating multiple agents in pursuit of game scenarios. Pursuing-evasion games aim to catch moving objects in constantly changing surroundings, which presents many difficulties for autonomous systems. This study is based on the bio-inspired differential pursuit of the Dog and Sheep game. In this game environment, the proposed HYDREIL-based DDPG is used to overcome the challenges of the traditional DRL models. At the same time, IDQN is used for real-time decision-making and to improve adaptive learning ability. Through both simulated tests and real-world experiments, the study shows the efficacy of HYDREIL. The ability of the HYDREIL is evaluated according to the learning ability based on average escape rates under challenging scenarios of the game. HYDREIL shows significant improvement even in complex game scenarios and improves the escape rate compared to traditional baseline models. Overall, the proposed HYDREIL framework shows a notable development in multiagent systems and provides an effective solution to the problems associated with control and coordination in pursuit of effective detection scenarios.

mathematics, interdisciplinary applications
Learning Evasion Strategy in Pursuit-Evasion by Deep Q-network

Jiagang Zhu,Wei Zou,Zheng Zhu

DOI: https://doi.org/10.1109/icpr.2018.8546182

2018-01-01

Abstract:This paper presents an approach for learning the evasion strategy for the evader in pursuit-evasion against the pursuers with Deep Q-network (DQN). To give the immediate reward to the agent, we handcraft a reward function, which considers both the evader escaping from being surrounded by the pursuers and keeping distance from the pursuers. This is a combination of the artificial potential field method with deep reinforcement learning. Our learned evasion strategy is verified by a series of experiments in three different game scenarios. The training stability and the value function are analyzed respectively. The three learned agents are compared with a random agent and a repulsive agent. We show the effectiveness of our method.
Pursuit and evasion game between UVAs based on multi-agent reinforcement learning

Guangyan Xu,Yang Zhao,Hao Liu

DOI: https://doi.org/10.1109/CAC48633.2019.8997447

2019-11-01

Abstract:Pursuit and evasion game between UVAs is a typical differential game. Differential games are usually difficult to obtain the optimal solutions because of the complex bilateral extremum problems. Reinforcement learning has superiorities in solving differential games with the advantages such as it does not need accurate controlled models and a lot of training data. In this paper, a multi-agent reinforcement learning model is established for UAV pursuit and evasion game. The relative motion state equation is used to describe the state to simplify the state set, and the pursuit and evasion game is transformed into a zero-sum game which is solved by Minimax-Q learning. The reinforcement learning model established in this paper reduces the complexity of solving problem and guarantees the convergence speed. Finally, the simulation results verify the rationality of the obtained control policy which makes both the pursuer and the evader tend to be advantageous to their own direction in the course of the countermeasures.

Computer Science,Engineering
Cooperative Pursuit with Multiple Pursuers based on Deep Minimax Q-learning

Mengda Ji,Genjiu Xu,Zekun Duan,Liying Wang,Zesheng Li,Jianjun Ge,Mingqiang Li

DOI: https://doi.org/10.1016/j.ast.2024.108919

IF: 5.457

2024-01-28

Aerospace Science and Technology

Abstract:Cooperative pursuit with multiple pursuers is critical in swarm missions. For example, in order to capture a faster-moving evader, it becomes necessary to deploy multiple unmanned aerial vehicles to form an encirclement and approach the evader. In this paper, a cooperative pursuit strategy is developed by utilizing reinforcement learning techniques and pursuit-evasion games. Firstly, we propose a novel surrounding algorithm to form a complete encirclement based on the dynamics of pursuit-evasion games. Based on this surrounding algorithm, we employ reinforcement learning techniques to train cooperative pursuit strategies to capture the evader by surrounding and approaching the evader. In pursuit-evasion games and other non-cooperative games, it is assumed that the opponent can model the others' behaviors, adapt its adversarial strategies, and exploit the others' weaknesses. The cooperative pursuit strategy needs to consider the adversarial strategies taken by the evader and counteract them. To address this issue, we employ a Deep Minimax Q-learning algorithm to simultaneously learn the evader's adversarial strategy and the cooperative pursuit strategy that cannot be exploited by the evader. Finally, we present extensive numerical simulations to evaluate the performance of the proposed learning-based cooperative pursuit strategy in various scenarios.

engineering, aerospace
Autonomous Decision Making for UAV Cooperative Pursuit-Evasion Game with Reinforcement Learning

Yang Zhao,Zidong Nie,Kangsheng Dong,Qinghua Huang,Xuelong Li

2024-11-05

Abstract:The application of intelligent decision-making in unmanned aerial vehicle (UAV) is increasing, and with the development of UAV 1v1 pursuit-evasion game, multi-UAV cooperative game has emerged as a new challenge. This paper proposes a deep reinforcement learning-based model for decision-making in multi-role UAV cooperative pursuit-evasion game, to address the challenge of enabling UAV to autonomously make decisions in complex game environments. In order to enhance the training efficiency of the reinforcement learning algorithm in UAV pursuit-evasion game environment that has high-dimensional state-action space, this paper proposes multi-environment asynchronous double deep Q-network with priority experience replay algorithm to effectively train the UAV's game policy. Furthermore, aiming to improve cooperation ability and task completion efficiency, as well as minimize the cost of UAVs in the pursuit-evasion game, this paper focuses on the allocation of roles and targets within multi-UAV environment. The cooperative game decision model with varying numbers of UAVs are obtained by assigning diverse tasks and roles to the UAVs in different scenarios. The simulation results demonstrate that the proposed method enables autonomous decision-making of the UAVs in pursuit-evasion game scenarios and exhibits significant capabilities in cooperation.

Artificial Intelligence,Multiagent Systems,Robotics
Flow Cytometric Characterization of Alveolar Macrophages

B. Lehnert,Y. Valdez,D. Fillak,J. Steinkamp,C. Stewart

DOI: https://doi.org/10.1002/jlb.39.3.285

1986-03-01

Journal of Leukocyte Biology

Abstract:Phenotypes of lung free cells (FC) harvested from Fischer‐344 rats by episodic lavage were characterized by flow cytometry. Parameters evaluated included electronic volume (EV), axial light loss (ALL), 90° light scatter (LS), blue autofluorescence (BA), and green‐yellow autofluorescence (G‐YA). Three phenotypic populations, FC‐A, FC‐B, and FC‐C were identified by their differing LS characteristics. FC‐C represented 90% of the cells and were exclusively alveolar macrophages. Two subpopulations in FC‐C, FC‐CI and FC‐CII, were further distinguished by their unique ALL features. The morphologic appearances of these subpopulations by light microscopy clearly differed in sorted preparations. Based on their patterns of autofluorescence, these FC‐CI and FC‐CII phenotypes were found to be composed of eight subpopulations. In FC populations harvested during further lavage episodes of the same lungs, the relative contributions of FC‐CI to the FC‐C subpopulation decreased as FC‐CII correspondingly increased. This study demonstrates 1) that subpopulations of lavaged AM can be categorized according to their optical phenotypes by flow cytometry and 2) that the relative frequency of retrieval of some phenotypes depends on how exhaustively the lungs are lavaged. With regard to the latter, bronchoalveolar lavage does not randomly sample the underlying AM population in the alveolar compartment.
Generalization Strategy Design of UAVs Pursuit Evasion Game Based on DDPG

FU Xiaowei,XU Zhe,WANG Hui

DOI: https://doi.org/10.1051/jnwpu/20224010047

2022-01-01

Abstract:UAVs pursuit evasion game is a research hotspot in the field of air combat. Traditional solutions have many limitations to this problem, such as the difficulty of the model to adapt to complex dynamic environments to quickly make decisions, and the poor generalization of different mission scenarios. Based on the DDPG(deep deterministic policy gradient) algorithm, a mathematical model of UAVs pursuit and evasion countermeasures is established in this paper. On this basis, this research designs a variety of countermaneuver strategies for escaping UAV, and uses the training method of course learning ideas. In the training process, the intelligence of the escaping UAV is gradually improved, so as to progressively train the confrontation strategy of the chasing UAV. The simulation results show that compared with direct training, the pursuit strategy of the chasing UAV trained by the research method of course learning can converge faster, and can better perform the hunting mission of enemy aircraft, and can be applied to a variety of enemy aircraft with a variety of maneuvering strategies, which effectively improved the generalization of the UAV′s pursuit and escape confrontation decision model.
A Payoff Augmentation Approach to Two Pursuers and One Evader Inertial Model Differential Game.

Yiqun Zhang,Pengfei Zhang,Xiaodong Wang,Feng Song,Chaoyong Li

DOI: https://doi.org/10.1109/taes.2022.3199706

IF: 3.491

2022-01-01

IEEE Transactions on Aerospace and Electronic Systems

Abstract:In this article, we study the two-on-one inertial model pursuit-evasion differential game with a payoff augmentation approach. In particular, the pursuit-evasion game is treated as a deadline game, and its payoff function is augmented to eliminate the deadline as well as to facilitate a more sophisticate model. In addition, we introduce the retrogressive path for analytical solution to the equilibrium strategy for the closed-loop game, and proceed to demonstrate that the closed-loop game can be converted to a one-side optimization problem for the evader, with the help of the augmented payoff function, under an open-loop Stackelberg strategy. More specifically, we establish the conditional equivalency between the open-loop solution and the closed-loop one. Simulation results verify the effectiveness of the proposed strategy.
Decentralized optimal large scale multi-player pursuit-evasion strategies: A mean field game approach with reinforcement learning

Zejian Zhou,Hao Xu

DOI: https://doi.org/10.1016/j.neucom.2021.01.141

IF: 6

2022-05-01

Neurocomputing

Abstract:In this paper, the intelligent design for the pursuit-evasion game with large scale multi-pursuer and multi-evader has been investigated. Due to the vast number of agents, the notorious ”Curse of Dimensionality” can seriously challenge the traditional design in multi-player pursuit-evasion game, especially under harsh environment with limited communication resource to support information exchange among multi-players. To address this intractable challenge, the emerging Mean Field Games (MFG) theory has been utilized to solve the optimal pursuit-evasion strategies based on a new form of probability density function (PDF) instead of detailed information from all the other players/agents. As such, not only the information exchange is reduced, but also the computation dimension for the optimal strategy derivation is decreased. Specifically, the MFG has been integrated into the pursuit-evasion game to generate a hierarchical structure where the pursuers and the evaders form two mean field groups separately. To online solve the mean field equations, i.e., two coupled partial differential equations, the actor-critic reinforcement learning mechanism is adopted and further extended to a novel actor-critic-mass-opponent (ACMO) approach. In ACMO, the actor neural network estimates the optimal control, the critic neural network approximates the optimal cost function, the mass neural network learns the agent’s group PDF, and the opponent neural network predicts the opponents’ average states in the form of PDF that causes maximum cost for the agent’s group. The Lyapunov theory is utilized to provide the convergence analysis for all neural networks and the stability analysis for the closed-loop system. Eventually, a series of numerical simulations are conducted to demonstrate the effectiveness of the developed scheme.

computer science, artificial intelligence
A Deep Reinforcement Learning-Based Approach in Porker Game

Yan Kong Yan Kong,Yefeng Rui Yan Kong,Chih-Hsien Hsia Yefeng Rui

DOI: https://doi.org/10.53106/199115992023043402004

2023-04-01

電腦學刊

Abstract:Recent years have witnessed the big success deep reinforcement learning achieved in the domain of card and board games, such as Go, chess and Texas Hold’em poker. However, Dou Di Zhu, a traditional Chinese card game, is still a challenging task for deep reinforcement learning methods due to the enormous action space and the sparse and delayed reward of each action from the environment. Basic reinforcement learning algorithms are more effective in the simple environments which have small action spaces and valuable and concrete reward functions, and unfortunately, are shown not be able to deal with Dou Di Zhu satisfactorily. This work introduces an approach named Two-steps Q-Network based on DQN to playing Dou Di Zhu, which compresses the huge action space through dividing it into two parts according to the rules of Dou Di Zhu and fills in the sparse rewards using inverse reinforcement learning (IRL) through abstracting the reward function from experts’ demonstrations. It is illustrated by the experiments that two-steps Q-network gains great advancements compared with DQN used in Dou Di Zhu.  
A Comparative Study of Deep Reinforcement Learning Models: DQN vs PPO vs A2C

Neil De La Fuente,Daniel A. Vidal Guerra

2024-07-19

Abstract:This study conducts a comparative analysis of three advanced Deep Reinforcement Learning models: Deep Q-Networks (DQN), Proximal Policy Optimization (PPO), and Advantage Actor-Critic (A2C), within the BreakOut Atari game environment. Our research assesses the performance and effectiveness of these models in a controlled setting. Through rigorous experimentation, we examine each model's learning efficiency, strategy development, and adaptability under dynamic game conditions. The findings provide critical insights into the practical applications of these models in game-based learning environments and contribute to the broader understanding of their capabilities. The code is publicly available at <a class="link-external link-http" href="http://github.com/Neilus03/DRL_comparative_study" rel="external noopener nofollow">this http URL</a>.

Machine Learning
Intelligent Maneuver Strategy for a Hypersonic Pursuit-Evasion Game Based on Deep Reinforcement Learning

Yunhe Guo,Zijian Jiang,Hanqiao Huang,Hongjia Fan,Weiye Weng

DOI: https://doi.org/10.3390/aerospace10090783

IF: 2.66

2023-09-05

Aerospace

Abstract:In order to improve the problem of overly relying on situational information, high computational power requirements, and weak adaptability of traditional maneuver methods used by hypersonic vehicles (HV), an intelligent maneuver strategy combining deep reinforcement learning (DRL) and deep neural network (DNN) is proposed to solve the hypersonic pursuit–evasion (PE) game problem under tough head-on situations. The twin delayed deep deterministic (TD3) gradient strategy algorithm is utilized to explore potential maneuver instructions, the DNN is used to fit to broaden application scenarios, and the intelligent maneuver strategy is generated with the initial situation of both the pursuit and evasion sides as the input and the maneuver game overload of the HV as the output. In addition, the experience pool classification strategy is proposed to improve the training convergence and rate of the TD3 algorithm. A set of reward functions is designed to achieve adaptive adjustment of evasion miss distance and energy consumption under different initial situations. The simulation results verify the feasibility and effectiveness of the above intelligent maneuver strategy in dealing with the PE game problem of HV under difficult situations, and the proposed improvement strategies are validated as well.

engineering, aerospace
Research on Action Strategies and Simulations of DRL and MCTS-based Intelligent Round Game

Yuxiang Sun,Bo Yuan,Yongliang Zhang,Wanwen Zheng,Qingfeng Xia,Bojian Tang,Xianzhong Zhou

DOI: https://doi.org/10.1007/s12555-020-0277-0

2021-06-16

Abstract:<p class="a-plus-plus">The reinforcement learning problem of complex action control in multiplayer online battlefield games has brought considerable interest in the deep learning field. This problem involves more complex states and action spaces than traditional confrontation games, making it difficult to search for any strategy with human-level performance. This paper presents a deep reinforcement learning model to solve this problem from the perspective of game simulations and algorithm implementation. A reverse reinforcement-learning model based on high-level player training data is established to support downstream algorithms. With less training data, the proposed model is converged quicker, and more consistent with the action strategies of high-level players' decision-making. Then an intelligent deduction algorithm based on DDQN is developed to achieve a better generalization ability under the guidance of a given reward function. At the game simulation level, this paper constructs Monte Carlo Tree Search Intelligent Decision Model for turn-based antagonistic deduction games to generate next-step actions. Furthermore, a prototype game simulator that combines offline with online functions is implemented to verify the performance of proposed model and algorithm. The experiments show that our proposed approach not only has a better reference value to the antagonistic environment using incomplete information, but also accurate and effective in predicting the return value. Moreover, our work provides a theoretical validation platform and testbed for related research on game AI for deductive games.</p>
A Dynamics Perspective of Pursuit-Evasion Games of Intelligent Agents with the Ability to Learn

Hao Xiong,Huanhui Cao,Lin Zhang,Wenjie Lu

DOI: https://doi.org/10.48550/arXiv.2104.01445

2021-04-04

Abstract:Pursuit-evasion games are ubiquitous in nature and in an artificial world. In nature, pursuer(s) and evader(s) are intelligent agents that can learn from experience, and dynamics (i.e., Newtonian or Lagrangian) is vital for the pursuer and the evader in some scenarios. To this end, this paper addresses the pursuit-evasion game of intelligent agents from the perspective of dynamics. A bio-inspired dynamics formulation of a pursuit-evasion game and baseline pursuit and evasion strategies are introduced at first. Then, reinforcement learning techniques are used to mimic the ability of intelligent agents to learn from experience. Based on the dynamics formulation and reinforcement learning techniques, the effects of improving both pursuit and evasion strategies based on experience on pursuit-evasion games are investigated at two levels 1) individual runs and 2) ranges of the parameters of pursuit-evasion games. Results of the investigation are consistent with nature observations and the natural law - survival of the fittest. More importantly, with respect to the result of a pursuit-evasion game of agents with baseline strategies, this study achieves a different result. It is shown that, in a pursuit-evasion game with a dynamics formulation, an evader is not able to escape from a slightly faster pursuer with an effective learned pursuit strategy, based on agile maneuvers and an effective learned evasion strategy.

Systems and Control,Multiagent Systems
A Survey of Deep Reinforcement Learning in Video Games

Kun Shao,Zhentao Tang,Yuanheng Zhu,Nannan Li,Dongbin Zhao

DOI: https://doi.org/10.48550/arXiv.1912.10944

2019-12-23

Multiagent Systems

Abstract:Deep reinforcement learning (DRL) has made great achievements since proposed. Generally, DRL agents receive high-dimensional inputs at each step, and make actions according to deep-neural-network-based policies. This learning mechanism updates the policy to maximize the return with an end-to-end method. In this paper, we survey the progress of DRL methods, including value-based, policy gradient, and model-based algorithms, and compare their main techniques and properties. Besides, DRL plays an important role in game artificial intelligence (AI). We also take a review of the achievements of DRL in various video games, including classical Arcade games, first-person perspective games and multi-agent real-time strategy games, from 2D to 3D, and from single-agent to multi-agent. A large number of video game AIs with DRL have achieved super-human performance, while there are still some challenges in this domain. Therefore, we also discuss some key points when applying DRL methods to this field, including exploration-exploitation, sample efficiency, generalization and transfer, multi-agent learning, imperfect information, and delayed spare rewards, as well as some research directions.
Crafting a robotic swarm pursuit–evasion capture strategy using deep reinforcement learning

Charles H. Wu,Donald A. Sofge,Daniel M. Lofaro

DOI: https://doi.org/10.1007/s10015-022-00761-y

2022-05-06

Artificial Life and Robotics

Abstract:In this paper we study the multi-agent pursuit–evasion problem, and present an extension of the Multi-Agent Deep Deterministic Policy Gradient (MADDPG) deep reinforcement learning algorithm. Previous pursuit–evasion advancements with MADDPG have focused on training capture strategies dependent on the restriction of evader movement with environmental features. We demonstrate a method to train pursuer agents to collaboratively surround and encircle an evader for reliable capture without a strategy rooted in environment entrapment (i.e. cornering). Our method utilizes a novel two-stage, variable-aggression, continuous reward function based on geometrical inscribed circles (incircles), along with a corresponding observation space, with agents operating in an entrapment-disadvantaged environment. Our results show reliable capture of an intelligent, superior evader by three trained pursuers in open space with our encircling strategy. A key novelty of our work is demonstrating the ability to transition behaviors learned using deep reinforcement learning from a simulated robotic system with imperfect world assumptions to a real-world robotic agents.
Adaptive Deep Reinforcement Learning for Non-Stationary Environments

Zhu Jin,Wei Yutong,Kang Yu,Jiang Xiaofeng,Dullerud Geir E.

DOI: https://doi.org/10.1007/s11432-021-3347-8

2022-01-01

Science China Information Sciences

Abstract:Deep reinforcement learning (DRL) is currently used to solve Markov decision process problems for which the environment is typically assumed to be stationary. In this paper, we propose an adaptive DRL method for non-stationary environments. First, we introduce model uncertainty and propose the self-adjusting deep Q -learning algorithm, which can achieve the rebalance of exploration and exploitation automatically as the environment changes. Second, we propose a feasible criterion to judge the appropriateness of parameter setting of deep Q -networks and minimize the misjudgment probability based on the large deviation principle (LDP). The effectiveness of the proposed adaptive DRL method is illustrated in terms of an advanced persistent threat (APT) attack simulation game. Experimental results show that compared with the classic deep Q -learning algorithms in non-stationary and stationary environments, the adaptive DRL method improves performance by at least 14.28% and 30.56%, respectively.
Exploring Dominant Strategies in Iterated and Evolutionary Games: a Multi-Agent Reinforcement Learning Approach

Long Wang,Qi Su,Hongyu Wang,Yu Xia

DOI: https://doi.org/10.21203/rs.3.rs-5462150/v1

2024-01-01

Abstract:Exploring dominant strategies in iterated games holds profound theoretical and practical significance across diverse domains. Previous studies, through mathematical analysis of limited cases, have unveiled classic strategies such as tit-for-tat, generous-tit-for-tat, win-stay-lose-shift, and zero-determinant strategies. While these strategies offer valuable insights into human decision-making, they represent only a small subset of possible strategies, constrained by limited mathematical and computational tools available to explore larger strategy spaces. To bridge this gap, we propose a novel approach using multi-agent reinforcement learning to delve into complex decision-making processes that go beyond human intuition. Our approach has led to the discovery of a new strategy, i.e., memory-two bilateral reciprocity (MTBR) strategy. MTBR consistently outperforms a wide range of strategies in pairwise interactions while achieving high payoffs. When introduced into an evolving population with diverse strategies, MTBR demonstrates dominance and fosters higher levels of cooperation and social welfare in both homogeneous and heterogeneous structures, as well as across various game types. This high performance is verified by simulations and mathematical analysis. Our work highlights the potential of multi-agent reinforcement learning in uncovering dominant strategies in complex environments, offering a new perspective on strategy exploration in iterated games.
Transfer reinforcement learning for multi‐agent pursuit‐evasion differential game with obstacles in a continuous environment

Penglin Hu,Quan Pan,Chunhui Zhao,Yaning Guo

DOI: https://doi.org/10.1002/asjc.3328

IF: 2.4

2024-02-04

Asian Journal of Control

Abstract:In this paper, we study the multi‐pursuer single‐evader pursuit‐evasion (MSPE) differential game in a continuous environment with the consideration of obstacles. We propose a novel pursuit‐evasion algorithm based on reinforcement learning and transfer learning. In the source task learning stage, we employ the Q‐learning and value function approximation method to overcome the challenges posed by the large‐scale storage space required by the conventional Q‐table solution method. This approach expands the discrete space to the continuous space by value function approximation and effectively reduces the demand for storage space. During the target task learning stage, we utilize the Gaussian mixture model (GMM) to classify the source tasks. The source policies whose corresponding state‐value sets have the highest probability densities are assigned for the agent in the target task for learning. This methodology not only effectively avoids negative transfer but also enhances the algorithm's generalization ability and convergence speed. Through simulation and experiment, we demonstrate the algorithm's effectiveness.

automation & control systems

A Problem In Psychoanalytic Technique

Large Scale Pursuit-Evasion under Collision Avoidance Using Deep Reinforcement Learning.

Coordination and Control in Multiagent Systems for Enhanced Pursuit-Evasion Game Performance

Learning Evasion Strategy in Pursuit-Evasion by Deep Q-network

Pursuit and evasion game between UVAs based on multi-agent reinforcement learning

Cooperative Pursuit with Multiple Pursuers based on Deep Minimax Q-learning

Autonomous Decision Making for UAV Cooperative Pursuit-Evasion Game with Reinforcement Learning

Flow Cytometric Characterization of Alveolar Macrophages

Generalization Strategy Design of UAVs Pursuit Evasion Game Based on DDPG

A Payoff Augmentation Approach to Two Pursuers and One Evader Inertial Model Differential Game.

Decentralized optimal large scale multi-player pursuit-evasion strategies: A mean field game approach with reinforcement learning

A Deep Reinforcement Learning-Based Approach in Porker Game

A Comparative Study of Deep Reinforcement Learning Models: DQN vs PPO vs A2C

Intelligent Maneuver Strategy for a Hypersonic Pursuit-Evasion Game Based on Deep Reinforcement Learning

Research on Action Strategies and Simulations of DRL and MCTS-based Intelligent Round Game

A Dynamics Perspective of Pursuit-Evasion Games of Intelligent Agents with the Ability to Learn

A Survey of Deep Reinforcement Learning in Video Games

Crafting a robotic swarm pursuit–evasion capture strategy using deep reinforcement learning

Adaptive Deep Reinforcement Learning for Non-Stationary Environments

Exploring Dominant Strategies in Iterated and Evolutionary Games: a Multi-Agent Reinforcement Learning Approach

Transfer reinforcement learning for multi‐agent pursuit‐evasion differential game with obstacles in a continuous environment