Abstract:A robot soccer system is a typical complex time-sequence decision-making system. Problems of uncertain knowledge representation and complex models always exist in robot soccer games. To achieve an adaptive decision-making mechanism, a method with fuzzy Bayesian reinforcement learning (RL) is proposed in this paper. To extract the features utilized in the proposed learning method, a fuzzy comprehensive evaluation method (FCEM) is developed. This method classifies the situations in robot soccer games into a set of features. With the fuzzy analytical hierarchy process (FAHP), the FCEM can calculate the weights according to defined factors for these features, which comprise the dimensionality of the state space. The weight imposed on each feature determines the range of each dimension. Through a Bayesian network, the comprehensively evaluated features are transformed into decision bases. An RL method for strategy selection over time is implemented. The fuzzy mechanism can skillfully adapt experiences to the learning system and provide flexibility in state aggregation, thus improving learning efficiency. The experimental results demonstrate that the proposed method has better knowledge representation and strategy selection than other competing methods.

Cooperation Strategy for Robot Soccer Based on Defuzzification.

Towards a cooperative soccer team in RoboCup

An Intelligent Decision-Making Subsystem For Autonomous Soccer Robot

Fuzzy Logic Based Strategy for Robot Soccer

Game Strategy Based on Fuzzy Logic for Soccer Robots

Agent Behavior Strategy Based on Fuzzy Evaluation and Inference in Robocupsoccer

Cooperation Strategy among Multi-Agent Based on Fuzzy Q-learning

Design of Strategy Based on Home and Opponent Information in Robot Soccer Competition

Probability Fuzzy Cognitive Map for Decision-Making in Soccer Robotics

Embedding cooperation in robots to play soccer game

A Coordination Model Using Fuzzy Reinforcement Learning for Multi-Agent System

Multi-Agent Coordination Method Based On Fuzzy Q-Learning

Fuzzy logic based intelligent learning method in multi-robot system

Studying of feature-based match modeling in robot soccer and decision-making system's self-learning

Intelligent learning technique based-on fuzzy logic for multi-robot path planning

An Adaptive Decision-Making Method with Fuzzy Bayesian Reinforcement Learning for Robot Soccer

Cooperation-based behavior design

Dynamic Formation Planning and Control for Robot Soccer Game with Multi-Agent Reinforcement Learning and Behavioral Model

Progress in the Decision-making of Robot Soccer

Study and application of reinforcement learning based on DAI in cooperative strategy of robot soccer

Fuzzy Decision Method For Motion Deadlock Resolving In Robot Soccer Games