Abstract:As an intelligent device integrating a series of advanced technologies, mobile robots have been widely used in the field of defense and military affairs because of their high degree of autonomy and flexibility. They can independently track and attack dynamic targets. However, traditional tracking attack algorithms are sensitive to the changes of the external environment, and does not have mobility and expansibility, while deep reinforcement learning can adapt to different environments because of its good learning and exploration ability. In order to pursuit target accurately and robust, this paper proposes a solution based on deep reinforcement learning algorithm. In view of the low accuracy and low robustness of traditional dynamic target pursuit, this paper models the dynamic target tracking and attack problem of mobile robots as a Partially Observable Markov Decision Process (POMDP), and proposes a general-purpose end-to-end deep reinforcement learning framework based on dual agents to track and attack targets accurately in different scenarios. Aiming at the problem that it is difficult for mobile robots to accurately track targets and evade obstacles, this paper uses partial zero-sum game to improve the reward function to provide implicit guidance for attackers to pursue targets, and uses asynchronous advantage actor critic (A3C) algorithm to train models in parallel. Experiments in this paper show that the model can be transferred to different scenarios and has good generalization performance. Compared with the baseline method, the attacker’s time to successfully destroy the target is reduced by 44.7% at most in the maze scene and 40.5% at most in the block scene, which verifies the effectiveness of the proposed method. In addition, this paper analyzes the effectiveness of each structure of the model through ablation experiments, which illustrates the effectiveness and necessity of each module and provides a theoretical basis for subsequent research.

Research on Target Detection Method Based on Attention Mechanism and Reinforcement Learning

Cooperative multi-agent target searching: a deep reinforcement learning approach based on parallel hindsight experience replay

Target tracking strategy using deep deterministic policy gradient

Enhanced Autonomous Navigation of Robots by Deep Reinforcement Learning Algorithm with Multistep Method

Deep Deterministic Policy Gradient Algorithm Based on Convolutional Block Attention for Autonomous Driving.

Multi-agent Collaborative Target Search Based on Curiosity Intrinsic Motivation

Enhancing Robotic Navigation: An Evaluation of Single and Multi-Objective Reinforcement Learning Strategies

Inspection Robot Navigation Based on Improved TD3 Algorithm

Spacecraft Proximity Maneuvering and Rendezvous with Collision Avoidance Based on Reinforcement Learning.

Intelligent Navigation of Indoor Robot Based on Improved DDPG Algorithm

Deep Reinforcement Learning for Autonomous Driving with an Auxiliary Actor Discriminator

Path Planning in Complex Environments Using Attention-Based Deep Deterministic Policy Gradient

When Do Drivers Concentrate? Attention-based Driver Behavior Modeling With Deep Reinforcement Learning

Path tracking control based on Deep reinforcement learning in Autonomous driving

Attentive Hybrid Reinforcement Learning-Based Eco-Driving Strategy for Connected Vehicles with Hybrid Action Spaces and Surrounding Vehicles Attention

Scene Adaptive Persistent Target Tracking and Attack Method Based on Deep Reinforcement Learning.

Deep Reinforcement Learning for Target Searching in Cognitive Electronic Warfare

Research on Autonomous Obstacle Avoidance and Target Tracking of UAV Based on Improved Dueling DQN Algorithm

Robot Grasping Method Optimization Using Improved Deep Deterministic Policy Gradient Algorithm of Deep Reinforcement Learning.

Interactive Robot Navigation in Crowded Pedestrian Environments Based on Deep Reinforcement Learning

Navigation of Mobile Robots Based on Deep Reinforcement Learning: Reward Function Optimization and Knowledge Transfer