Abstract:The robot soccer game has been considered as an illustrative scenario to test the performance of research outcomes on multi-agent systems (MAS). While various algorithm has been developed for a robot soccer game and implemented in the RoboCup competition, relatively little collaboration can be found in existing results, e.g., the formation for passing and dribbling during the offense or the collaborative obstruction during defense, which are very common in the teamwork of human soccer game. This paper focuses on the collaboration problem in robot soccer games and proposes a dynamic formation planning and control strategy. Specifically, the offensive team maintains a desired formation and transits among the tasks of catching, passing, dribbling, and kicking based on a behavioral model. The defensive team is regulated by a reinforcement-learning-based policy network and dynamically forms a barrier to obstruct the offender. The strategies of both teams will swap according to the evolving situation of the match. Both simulation studies and real-world experiments are carried out to illustrate the performance of the proposed method, and the convergence to the desired formation is also rigorously proved.

Balanced Reactive-Deliberative Architecture for Multi-Agent System for Simulation League of RoboCup

A New Multi-Agent System Architecture and Its Application in

Towards a cooperative soccer team in RoboCup

An Intelligent Decision-Making Subsystem For Autonomous Soccer Robot

A Multi-agent Architecture Based Cooperation and Intelligent Decision Making Method for Multirobot Systems

A Coordination Model Using Fuzzy Reinforcement Learning for Multi-Agent System

Dynamic Formation Planning and Control for Robot Soccer Game with Multi-Agent Reinforcement Learning and Behavioral Model

Cooperation-based behavior design

A New and Effective Design and Application of Swarm-Intelligence-Based Multi Agent System Architecture

A Collaborative Multi-Agent Model with Knowledge-Based Communication for the RoboCupRescue Simulation

Autonomous robot soccer system based on hybrid architecture

Application of Multi-Agent Layered Collaboration Model in RoboCup Simulation Match

Agent Behavior Strategy Based on Fuzzy Evaluation and Inference in Robocupsoccer

Application of multi-agent reinforcement learning to RoboCup

Design and Development of Multi-Robot Architecture and Decision-Making Model

Agent architecture: a survey on RoboCup-99 simulator teams

Multi-Agent Coordination Method Based On Fuzzy Q-Learning

Behavior-based Intelligent Agent System to Robot Soccer

Study On Architecture And Learning Method Of The Multi-Agent Robot System

Reinforcement learning based on multi-agent in robocup

A muti-agent defensive strategy based on monte carlo method