Abstract:There is a concerted effort to build intelligent sea and numerous artificial intelligence technologies have been explored. At present, more and more people are engaged in the research of deep reinforcement learning algorithm, and its mainstream application is in the field of games. Reinforcement learning has conquered chess belonging to complete information game, and Texas poker belonging to incomplete information games. And it reached or even surpassed the highest player level of mankind in E-sports games with huge state space and complex action space. However, reinforcement learning algorithm still has great challenges in fields such as automatic driving. The main reason is that the training of reinforcement learning needs to build an environment for interacting with agents. However, it is very difficult to construct realistic simulation scenes, and there is no guarantee that we will not encounter the state that the agent has not seen. Therefore, it is necessary to explore the simulation scene first. Based on this, this paper mainly studies reinforcement learning in simulation scenario. There are huge challenges in migrating them to real scenario applications, especially in sea missions. Aiming at the heterogeneous multi-agent game confrontation scenario, this paper proposes a sea battlefield game confrontation decision algorithm based on multi-agent deep deterministic policy gradient. The algorithm combines long short-term memory and actor-critic, which not only realizes the convergence of the algorithm in huge state space and action space, but also solves the problem of sparse real rewards. At the same time, imitation learning is integrated into the decision algorithm, which not only improves the convergence speed of the algorithm, but also greatly improves the effectiveness of the algorithm. The results show that the algorithm can deal with a variety of different tactical sea battlefield scenarios, make flexible decisions according to the changes of the enemy, and the average winning rate is close to 90%.

Study on Anti-sea Combat Simulation of Warship Formation Based on Artificial Life

WarShip formation anti-Sea attack Simulation SyStem baSed on multi-Agent

Research on Agent Theory Simulation Method of the Air Combat Based on Network Centric Warfare

Underwater Multi-agent Cooperative Formation Hunting Based on Deep Reinforcement Learning

Study and Design of Multi-Robots Pursuing Based on Improved Ant Colony Labor Division Method

A New and Effective Design and Application of Swarm-Intelligence-Based Multi Agent System Architecture

A MADDPG-based multi-agent antagonistic algorithm for sea battlefield confrontation

Simulation on Vessel Intelligent Collision Avoidance Based on Artificial Fish Swarm Algorithm

Multi-agent Cooperative Combat Simulation in Naval Battlefield with Reinforcement Learning

Research on Shipborne Artillery Weapon System Based on Multi-agent Theory

Modeling and Simulation of Tank Unit Combat Based on Multi-Agent System

Simulation model of naval equipment cooperative combat based on multi-agent system

Autonomous Game Character Based on Artificial Life

Research on Warship Tactical Decision-Making System in Sea War Simulating

Study of Semi Autonomous Agent Communication Model and Application in War Game

Analysis and Simulation of Submarine-searching Operation of Surface Ships

Research on modeling and simulation of formation cooperation under air early warning command and guidance on the sea battles

Intelligent collision avoidance decision-making method for unmanned ships based on driving practice

The Research and Improvement Of Digital Artificial Life Model Autolife

Multi-Agent System Structure of Combat Simulation

Study on Agent-based Combat Analysis Simulation Framework of Satellite System of Systems