Abstract:In a multi-agent system, action selection is important for the cooperation and coordination among agents. The better cooperative behaviors can usually be acquired by reinforcement learning. The overlap of actions selected by each agent makes the acquisition of cooperative behaviors less efficient. To solve the problem we propose a novel learning architecture. The architecture consists of several learning modules which amount to the number of agents involved in the task, a generalized rule base module and a final action selection module. Every learning module includes a Q learning module and an ASPL (Action Selection Priority Level) module. ASPL module to determine the action selection priority level based on which the cooperative behaviors can be well controlled. Generalized rule base module stores the environment states, Q value and action parameters etc. information, and extracts action rules based Q value from learning process. Final action selection module decides agent’s final action based on ASPL and generalized rule base. The learning architecture can decrease environment state space and agent’s action space, and accelerate learning speed of agents. We have applied the proposed method to a robot soccer match and the efficiency was verified by the results of both the computer simulation and real experiments.

A New Multi-Agent System Architecture and Its Application in

Towards a cooperative soccer team in RoboCup

An Intelligent Decision-Making Subsystem For Autonomous Soccer Robot

A Plan Recognition Approach for Agent in Adversarial Multi-Agent System

Algebraic Method for Describing and Analyzing the Architecture of Mas Based Autonomous Mobile Robot

The Multi-Agent System Based on Reinforcement Learning

Multi-agent system based autonomic computing environment

Agent architecture: a survey on RoboCup-99 simulator teams

A New Architecture For Distribution Control And Automation System

Cooperation Design System Based on Mobile-C Agent Platform

A Federated Multi-Agent System: Autonomic Control of Web Services

On Multi-Agent Collaborative Planning and Its Application in RoboCup

A Dynamic Cooperation Model of Multi-Agent System

A dynamic architecture for multi-agent systems

Research on architecture of distributed multi-agent simulation environment systems

Cooperative Behavior Acquisition Based Modular Q Learning in Multi-Agent System

Design and Implementation of a Robot System Architecture Based on Agent Technology and Delegate Mechanism

AN OPEN MULTI-AGENT ARCHITECTURE FOR DISTRIBUTED AUTONOMOUS ROBOT SYSTEMS

A muti-agent defensive strategy based on monte carlo method

Dynamic Formation Planning and Control for Robot Soccer Game with Multi-Agent Reinforcement Learning and Behavioral Model

ON AGENT-BASED SYSTEM ARCHITECTURE OF DISTRIBUTED SOFTWARE DEPLOYMENT