Pursuit-Evasion Game with Hybrid System of Dynamics

Mehdi Salimi

DOI: https://doi.org/10.48550/arXiv.2007.08136

2020-07-16

Abstract:We consider a pursuit-evasion differential game with a Hybrid system of dynamics in Hilbert space with integral constraints on the control functions of players. We show that the pursuer has a winning strategy.

Optimization and Control,Dynamical Systems

What problem does this paper attempt to address?

Bearing Angle Measurement Based Cooperative Pursuit-Evasion Game in Non-Convex Environments

Di Guo,Gangfeng Yan,Zhiyun Lin

DOI: https://doi.org/10.1109/ascc.2013.6606238

2013-01-01

Abstract:This paper addresses a cooperative pursuit-evasion game in non-convex environments, for which a team of pursuers are equipped with onboard bearing angle measurement sensors. Different from many existing work, our work assumes that the agents have no global coordinate system and thus can not measure the absolute positions, but it is expected for the pursuers to estimate the positions of other agents in their local frames. Based on the estimated positions, a distributed computation method is developed where a series of Hamilton-Jacobi-Bellman (HJB) equations are solved cooperatively in order to determine the control input for every pursuer with the help of limited information exchange among pursuers. We demonstrate the effectiveness of the proposed scheme by simulations.
An infinite dimensional pursuit-evasion differential game with finite number of players

Mehdi Salimi,Massimiliano Ferrara

DOI: https://doi.org/10.48550/arXiv.1506.00919

2015-06-02

Abstract:We study a pursuit-evasion differential game with finite number of pursuers and one evader in Hilbert space with geometric constraints on the control functions of players. We solve the game by presenting explicit strategies for pursuers which guarantee their pursuit as well as an strategy for the evader which guarantees its evasion.

Optimization and Control
Multi-Pursuer and One-Evader Evasion Differential Game with Integral Constraints for an Infinite System of Binary Differential Equations

Ruzakhon Kazimirova,Gafurjan Ibragimov,Bruno Antonio Pansera,Abdulla Ibragimov

DOI: https://doi.org/10.3390/math12081183

IF: 2.4

2024-04-16

Mathematics

Abstract:In the Hilbert space l2, a differential evasion game involving multiple pursuers is considered. Integral constraints are imposed on player control functions. The pursuers are tasked with bringing the state of a system back to the origin of l2, while the evader simultaneously tries to avoid it. It is assumed that the energy of the evader is greater than the total energy of the pursuers. In this paper, we contribute to the solution of the differential evasion game with multiple pursuers by building an exact strategy for the evader.

mathematics
An Isochron-Based Solution to Pursuit-Evasion Games of Two Heterogeneous Players

Shuai Li,Chen Wang,Guangming Xie

DOI: https://doi.org/10.1109/tac.2024.3485451

IF: 6.549

2024-01-01

IEEE Transactions on Automatic Control

Abstract:In this paper, we study a pursuit-evasion game between two players with heterogeneous kinematics, where the pursuer is with damped double integrator dynamics and the evader is with single integrator dynamics. The pursuer aims at capturing the evader as soon as possible, while the evader wants to avoid or delay the capture. Traditional methods to solve pursuit-evasion games rely on the Hamilton-Jacobi-Isaacs (HJI) equations and retrogressive path equations, which are very complicated and non-intuitive, thus failing to obtain a complete solution. To overcome these challenges, we develop an intuitive isochron-based method to thoroughly analyze all possible situations of the game and a concise geometric approach to calculate the optimal strategies, providing a complete solution to this game. Specifically, the isochron-based method effectively leverages three main factors, the players' motion capability, the pursuer's capture capability, and the players' states. Based on these, we analyze the players' superiority and the geometrical features of their isochrones and the intersections, thus acquiring concise conditions that determine the game's outcome. For the success-capture cases, we propose a new geometric approach to calculate the target points of the players, and then obtain the closed-loop state feedback optimal pursuit and evasion strategies. We then get the corresponding value function and provide a validation using the HJI equation. For the success-evasion cases, we exploit the intersection of the players' isochrones to design some effective evasion strategies, which ensure that the evader can always avoid or delay the capture. Finally, some numerical simulations are carried out to validate the effectiveness and applicability of our results.
Optimal Strategies for Pursuit-evasion Differential Games of Players with Damped Double Integrator Dynamics

Shuai Li,Chen Wang,Guangming Xie

DOI: https://doi.org/10.1109/tac.2023.3346815

IF: 6.549

2024-01-01

IEEE Transactions on Automatic Control

Abstract:In this article, we investigate and derive optimal strategies for the pursuit-evasion problem of two players with damped double integrator dynamics. The pursuer is assumed to have a greater acceleration and attempt to capture the evader as quickly as possible, while the evader wants to avoid or delay the capture. Different from the problems with single integrator dynamics, optimal strategies for such a problem are not intuitive. To solve this problem, we exploit both geometrical methods and differential games. Specifically, we first illustrate some properties of the optimal strategies, using which isochrones of the players are constructed. Then, by exploring the geometrical characteristics of the isochrones of the two players, we derive the target point directly without using the explicit formula of the intersections of isochrones. We propose an algorithm to determine the capture time, which is exactly the value function of the game, and finally the optimal strategies are derived subsequently. To prove the optimality of the proposed strategies, differential games and Hamilton-Jacobi-Isaacs (HJI) equation are used, where we show that the proposed value function is the solution to the HJI equation under our proposed strategies. Moreover, we apply our results to the game with one pursuer and multiple evaders, and some useful results are given. Finally, we carry out various simulations to show the optimality and effectiveness of our proposed strategies.
Large Scale Pursuit-Evasion under Collision Avoidance Using Deep Reinforcement Learning.

Helei Yang,Peng Ge,Junjie Cao,Yifan Yang,Yong Liu

DOI: https://doi.org/10.1109/iros55552.2023.10341975

2023-01-01

Abstract:This paper examines a pursuit-evasion game (PEG) involving multiple pursuers and evaders. The decentralized pursuers aim to collaborate to capture the faster evaders while avoiding collisions. The policies of all agents are learning-based and are subjected to kinematic constraints that are specific to unicycles. To address the challenge of high dimensionality encountered in large-scale scenarios, we propose a state processing method named Mix-Attention, which is based on Self-Attention. This method effectively mitigates the curse of dimensionality. The simulation results provided in this study demonstrate that the combination of Mix-Attention and Independent Proximal Policy Optimization (IPPO) surpasses alternative approaches when solving the multi-pursuer multi-evader PEG, particularly as the number of entities increases. Moreover, the trained policies showcase their ability to adapt to scenarios involving varying numbers of agents and obstacles without requiring retraining. This adaptability showcases their transferability and robustness. Finally, our proposed approach has been validated through physical experiments conducted with six robots.
Pursuit-evasion differential games of players with different speeds in spaces of different dimensions

Shuai Li,Chen Wang,Guangming Xie

DOI: https://doi.org/10.48550/arXiv.2202.13522

2022-02-28

Systems and Control

Abstract:We study pursuit-evasion differential games between a faster pursuer moving in 3D space and an evader moving in a plane. We first extend the well-known Apollonius circle to 3D space, by which we construct the isochron for the considered two players. Then both cases with and without a static target are considered and the corresponding optimal strategies are derived using the concept of isochron. In order to guarantee the optimality of the proposed strategies, the value functions are given and are further proved to be the solution of Hamilton-Jacobi-Isaacs equation. Simulations with comparison between the proposed strategies and other classical strategies are carried out and the results show the optimality of the proposed strategies.
A Model Predictive Stackelberg Solution to Orbital Pursuit-Evasion Game

Yuchen LIU,Chaoyong LI,Jun JIANG,Yonghe ZHANG

DOI: https://doi.org/10.1016/j.cja.2024.08.029

IF: 5.7

2024-01-01

Chinese Journal of Aeronautics

Abstract:In this paper, we investigate analytical numerical iterative strategies for the pursuit-evasion game involving spacecraft with leader-follower information. In the proposed problem, the interplay between two spacecraft gives rise to a dynamic and real-time game, complicated further by the presence of J2 perturbation. The primary challenge lies in crafting control strategies that are both efficient and applicable to real-time game problems within a nonlinear system. To overcome this challenge, we introduce the model prediction and iterative correction technique proposed in model predictive static programming, enabling the generation of strategies in analytical iterative form for nonlinear systems. Subsequently, we proceed by integrating this model predictive framework into a simplified Stackelberg equilibrium formulation, tailored to address the practical complexities of leader-follower pursuit-evasion scenarios. Simulation results validate the effectiveness and exceptional efficiency of the proposed solution within a receding horizon framework.
An Introduction to Pursuit-evasion Differential Games

Isaac E. Weintraub,Meir Pachter,Eloy Garcia

DOI: https://doi.org/10.48550/arXiv.2003.05013

2020-03-11

Abstract:Pursuit and evasion conflicts represent challenging problems with important applications in aerospace and robotics. In pursuit-evasion problems, synthesis of intelligent actions must consider the adversary's potential strategies. Differential game theory provides an adequate framework to analyze possible outcomes of the conflict without assuming particular behaviors by the opponent. This article presents an organized introduction of pursuit-evasion differential games with an overview of recent advances in the area. First, a summary of the seminal work is outlined, highlighting important contributions. Next, more recent results are described by employing a classification based on the number of players: one-pursuer-one-evader, N-pursuers-one-evader, one-pursuer-M-evaders, and N-pursuer-M-evader games. In each scenario, a brief summary of the literature is presented. Finally, two representative pursuit-evasion differential games are studied in detail: the two-cutters and fugitive ship differential game and the active target defense differential game. These problems provide two important applications and, more importantly, they give great insight into the realization of cooperation between friendly agents in order to form a team and defeat the adversary.

Optimization and Control
Equilibrium Strategy of the Pursuit-Evasion Game in Three-Dimensional Space

Nuo Chen,Linjing Li,Wenji Mao

DOI: https://doi.org/10.1109/jas.2023.123996

2024-02-03

IEEE/CAA Journal of Automatica Sinica

Abstract:The pursuit-evasion game models the strategic interaction among players, attracting attention in many realistic scenarios, such as missile guidance, unmanned aerial vehicles, and target defense. Existing studies mainly concentrate on the cooperative pursuit of multiple players in two-dimensional pursuit-evasion games. However, these approaches can hardly be applied to practical situations where players usually move in three-dimensional space with a three-degree-of-freedom control. In this paper, we make the first attempt to investigate the equilibrium strategy of the realistic pursuit-evasion game, in which the pursuer follows a three-degree-of-freedom control, and the evader moves freely. First, we describe the pursuer's three-degree-of-freedom control and the evader's relative coordinate. We then rigorously derive the equilibrium strategy by solving the retrogressive path equation according to the Hamilton-Jacobi-Bellman-Isaacs (HJBI) method, which divides the pursuit-evasion process into the navigation and acceleration phases. Besides, we analyze the maximum allowable speed for the pursuer to capture the evader successfully and provide the strategy with which the evader can escape when the pursuer's speed exceeds the threshold. We further conduct comparison tests with various unilateral deviations to verify that the proposed strategy forms a Nash equilibrium.

automation & control systems
Pursuit and Evasion Linear Differential Game Problems with Generalized Integral Constraints

Bashir Mai Umar,Jewaidu Rilwan,Maggie Aphane,Kanikar Muangchoo

DOI: https://doi.org/10.3390/sym16050513

2024-04-25

Symmetry

Abstract:In this paper, we study pursuit and evasion differential game problems of one pursuer/one evader and many pursuers/one evader, respectively, in the space Rn. In both problems, we obtain sufficient conditions that guarantee the completion of a pursuit and an evasion. We construct the players' optimal strategies in both problems, and we estimate the possible distance that an evader can preserve from pursuers. Lastly, we illustrate our results via some numerical examples.

multidisciplinary sciences
A Payoff Augmentation Approach to Two Pursuers and One Evader Inertial Model Differential Game.

Yiqun Zhang,Pengfei Zhang,Xiaodong Wang,Feng Song,Chaoyong Li

DOI: https://doi.org/10.1109/taes.2022.3199706

IF: 3.491

2022-01-01

IEEE Transactions on Aerospace and Electronic Systems

Abstract:In this article, we study the two-on-one inertial model pursuit-evasion differential game with a payoff augmentation approach. In particular, the pursuit-evasion game is treated as a deadline game, and its payoff function is augmented to eliminate the deadline as well as to facilitate a more sophisticate model. In addition, we introduce the retrogressive path for analytical solution to the equilibrium strategy for the closed-loop game, and proceed to demonstrate that the closed-loop game can be converted to a one-side optimization problem for the evader, with the help of the augmented payoff function, under an open-loop Stackelberg strategy. More specifically, we establish the conditional equivalency between the open-loop solution and the closed-loop one. Simulation results verify the effectiveness of the proposed strategy.
A Dynamics Perspective of Pursuit-Evasion Games of Intelligent Agents with the Ability to Learn

Hao Xiong,Huanhui Cao,Lin Zhang,Wenjie Lu

DOI: https://doi.org/10.48550/arXiv.2104.01445

2021-04-04

Abstract:Pursuit-evasion games are ubiquitous in nature and in an artificial world. In nature, pursuer(s) and evader(s) are intelligent agents that can learn from experience, and dynamics (i.e., Newtonian or Lagrangian) is vital for the pursuer and the evader in some scenarios. To this end, this paper addresses the pursuit-evasion game of intelligent agents from the perspective of dynamics. A bio-inspired dynamics formulation of a pursuit-evasion game and baseline pursuit and evasion strategies are introduced at first. Then, reinforcement learning techniques are used to mimic the ability of intelligent agents to learn from experience. Based on the dynamics formulation and reinforcement learning techniques, the effects of improving both pursuit and evasion strategies based on experience on pursuit-evasion games are investigated at two levels 1) individual runs and 2) ranges of the parameters of pursuit-evasion games. Results of the investigation are consistent with nature observations and the natural law - survival of the fittest. More importantly, with respect to the result of a pursuit-evasion game of agents with baseline strategies, this study achieves a different result. It is shown that, in a pursuit-evasion game with a dynamics formulation, an evader is not able to escape from a slightly faster pursuer with an effective learned pursuit strategy, based on agile maneuvers and an effective learned evasion strategy.

Systems and Control,Multiagent Systems
Synchronous Near-Optimal Control for Discrete-Time Nonlinear Pursuit-Evasion Game

Peng Zhang,Yuan Yuan,Huaping Liu

DOI: https://doi.org/10.1109/ICARM49381.2020.9195379

2020-01-01

Abstract:This paper studies the synchronous near-optimal controller design for nonlinear pursuit-evasion (PE) games. In the studied PE game, an agent called the pursuer endeavors to catch the escaping agent called the evader, while the evader tries to avoid getting caught. Firstly, an approximate discrete-time coupled Hamilton-Jacobi-Isaacs equation is developed to derive the saddle-point equilibrium. Then, the synchronous control strategy is established for the nonlinear PE game and its convergence is proven. Finally, a nonlinear aircraft system is employed to check the validity of the designed PE technique.
Optimal Strategies for the Game with Two Faster 3D Pursuers and One Slower 2D Evader

Runqi Zhang,Shuai Li,Chen Wang,Guangming Xie

DOI: https://doi.org/10.23919/ccc55666.2022.9902586

2022-01-01

Abstract:A pursuit-evasion differential game with two faster pursuers in 3D space and one slower evader in a 2D plane is studied. Two pursuers, which have different speeds, attempt to cooperate to capture the evader while the evader struggles to avoid or delay the capture. Using differential games and the concept of isochron, we present a complete solution to this game and develop the optimal strategies for both the pursuers and the evader. In order to guarantee the optimality of the proposed strategies, the value function of the game is given and is further proved to be the solution of the corresponding Hamilton-Jacobi-Isaacs equation. Finally, simulations are carried out with comparisons between the proposed strategies and other typical strategies, the results of which show the optimality of the proposed strategies.
Bounded-Rational Pursuit-Evasion Games

Yue Guan,Dipankar Maity,Christopher M. Kroninger,Panagiotis Tsiotras

DOI: https://doi.org/10.48550/arXiv.2003.06954

2020-03-16

Abstract:We present a framework that incorporates the idea of bounded rationality into dynamic stochastic pursuit-evasion games. The solution of a stochastic game is characterized, in general, by its (Nash) equilibria in feedback form. However, computing these Nash equilibrium strategies may require extensive computational resources. In this paper, the agents are modeled as bounded rational entities having limited computational resources. We illustrate the framework by applying it to a pursuit-evasion game between two vehicles in a stochastic wind field, where both the pursuer and the evader are bounded rational. We show how such a game may be analyzed by properly casting it as an iterative sequence of finite-state Markov Decision Processes (MDPs). Leveraging tools and algorithms from cognitive hierarchy theory ("level-$k$ thinking") we compute the solution of the ensuing discrete game, while taking into consideration the rationality level of each agent. We also present an online algorithm for each agent to infer its opponent rationality level.

Systems and Control
Multiple-to-one Orbital Pursuit: A Computational Game Strategy

Yuchen Liu,Yonghe Zhang,Jun Jiang,Chaoyong Li

DOI: https://doi.org/10.1109/taes.2024.3471497

IF: 3.491

2024-01-01

IEEE Transactions on Aerospace and Electronic Systems

Abstract:In this paper, we investigate the cooperative pursuitevasion problem among on-orbit multiple spacecraft. The presented problem involves a dynamic pursuit process that gives rise to a multiple-to-one pursuit game, in which multiple pursuing spacecraft collaborate to collectively reduce the minimum distance between pursuers and evader. The main challenge lies in establishing the game amidst intricate mission intentions and ensuring efficient generation of game strategies, e.g., the Nash equilibrium strategy. To this end, we formulate the multiple spacecraft pursuit-evasion problem within the framework of a multi-player computational game. Subsequently, a one-step lookahead Nash equilibrium is introduced to facilitate the periodic modification of ideal trajectories during the dynamic game process. In addition, in order to enhance the solution efficiency, we integrate an action-reaction search procedure embedded with a dynamic pruning technique into the search for Nash equilibrium. Simulation results validate the effectiveness of the proposed scheme.
Guidance Strategy of Motion Camouflage for Spacecraft Pursuit-Evasion Game

Jianqing Li,Chaoyong Li,Yonghe Zhang

DOI: https://doi.org/10.1016/j.cja.2023.10.007

IF: 5.7

2023-01-01

Chinese Journal of Aeronautics

Abstract:This work is inspired by a stealth pursuit behavior called motion camouflage whereby a pursuer approaches an evader while the pursuer camouflages itself against a predetermined background. We formulate the spacecraft pursuit-evasion problem as a stealth pursuit strategy of motion camouflage, in which the pursuer tries to minimize a motion camouflage index defined in this paper. The Euler-Hill reference frame whose origin is set on the circular reference orbit is used to describe the dynamics. Based on the rule of motion camouflage, a guidance strategy in open-loop form to achieve motion camouflage index is derived in which the pursuer lies on the camouflage constraint line connecting the central spacecraft and evader. In order to dispose of the dependence on the evader acceleration in the open-loop guidance strategy, we further consider the motion camouflage pursuit problem within an infinite-horizon nonlinear quadratic differential game. The saddle point solution to the game is derived by using the state-dependent Riccati equation method, and the resulting closed-loop guidance strategy is effective in achieving motion camouflage. Simulations are performed to demonstrate the capabilities of the proposed guidance strategies for the pursuit–evasion game scenario.
Resilient Pursuit Evasion Guidance with Feedback Game Strategy

Bin Yang,Xiaodong Wang,Pengfei Zhang,Chaoyong Li

DOI: https://doi.org/10.1016/j.ast.2024.109427

IF: 5.457

2024-01-01

Aerospace Science and Technology

Abstract:This paper proposed a resilient guidance strategy for planar pursuit evasion, in which the homing guidance problem is formulated as a Stackelberg game. As is known, the most salient challenge for pursuit evasion guidance is how to ensure an interception despite both players (i.e., missile and target) actively optimize their own interest with preferably incomplete information. Toward this, we introduce a game-theoretic guidance strategy that effectively integrates incentive feedback strategy into pursuit evasion game. In particular, the proposed resilient guidance law takes the form of Stackelberg game conjecture with missile/interceptor as the designated leader, and rigorously proves that leader's interest can be best served with a properly designed feedback gain, and an interception can be made possible in spite of incomplete knowledge on target's intentions (i.e., performance index). Simulation results verify the performance of the proposed strategy.
Optimal Intermittent Sensing for Pursuit-Evasion Games

Dipankar Maity

2023-07-02

Abstract:We consider a class of pursuit-evasion differential games in which the evader has continuous access to the pursuer's location, but not vice-versa. There is a remote sensor (e.g., a radar station) that can sense the evader's location upon a request from the pursuer and communicate that sensed location to the pursuer. The pursuer has a budget on the total number of sensing requests. The outcome of the game is determined by the sensing and motion strategies of the players. We obtain an equilibrium sensing strategy for the pursuer and an equilibrium motion strategy for the evader. We quantify the degradation in the pursuer's pay-off due to its sensing limitations.

Systems and Control,Computer Science and Game Theory

Pursuit-Evasion Game with Hybrid System of Dynamics

Bearing Angle Measurement Based Cooperative Pursuit-Evasion Game in Non-Convex Environments

An infinite dimensional pursuit-evasion differential game with finite number of players

Multi-Pursuer and One-Evader Evasion Differential Game with Integral Constraints for an Infinite System of Binary Differential Equations

An Isochron-Based Solution to Pursuit-Evasion Games of Two Heterogeneous Players

Optimal Strategies for Pursuit-evasion Differential Games of Players with Damped Double Integrator Dynamics

Large Scale Pursuit-Evasion under Collision Avoidance Using Deep Reinforcement Learning.

Pursuit-evasion differential games of players with different speeds in spaces of different dimensions

A Model Predictive Stackelberg Solution to Orbital Pursuit-Evasion Game

An Introduction to Pursuit-evasion Differential Games

Equilibrium Strategy of the Pursuit-Evasion Game in Three-Dimensional Space

Pursuit and Evasion Linear Differential Game Problems with Generalized Integral Constraints

A Payoff Augmentation Approach to Two Pursuers and One Evader Inertial Model Differential Game.

A Dynamics Perspective of Pursuit-Evasion Games of Intelligent Agents with the Ability to Learn

Synchronous Near-Optimal Control for Discrete-Time Nonlinear Pursuit-Evasion Game

Optimal Strategies for the Game with Two Faster 3D Pursuers and One Slower 2D Evader

Bounded-Rational Pursuit-Evasion Games

Multiple-to-one Orbital Pursuit: A Computational Game Strategy

Guidance Strategy of Motion Camouflage for Spacecraft Pursuit-Evasion Game

Resilient Pursuit Evasion Guidance with Feedback Game Strategy

Optimal Intermittent Sensing for Pursuit-Evasion Games