The design and implementation of defensive tactics based on Markov Countermeasures

Ang Sun,Qi Guo
2010-01-01
Abstract:This paper analyzes the design of the robot soccer SimroSot (11vs11) based on defensive tactics. Within the reinforcement of learning techniques we make mathematical modeling on the random, discrete state, discrete-time firstly, and study respectively according to different characteristics between offensive, defensive and goalie. And design the model of man-to-man defense making use of learning algorithm based on Markov countermeasures. The model is set up at the environment of knowledge where state transition probability function P and the reward function R were known, and solves the optimal strategy making use of dynamic programming techniques. The model has been verified in the simulating game platform SimroSot (11vs11), and has achieved the desired results.
What problem does this paper attempt to address?