Abstract:In large-scale systems there are fundamental challenges when centralised techniques are used for task allocation. The number of interactions is limited by resource constraints such as on computation, storage, and network communication. We can increase scalability by implementing the system as a distributed task-allocation system, sharing tasks across many agents. However, this also increases the resource cost of communications and synchronisation, and is difficult to scale. In this paper we present four algorithms to solve these problems. The combination of these algorithms enable each agent to improve their task allocation strategy through reinforcement learning, while changing how much they explore the system in response to how optimal they believe their current strategy is, given their past experience. We focus on distributed agent systems where the agents' behaviours are constrained by resource usage limits, limiting agents to local rather than system-wide knowledge. We evaluate these algorithms in a simulated environment where agents are given a task composed of multiple subtasks that must be allocated to other agents with differing capabilities, to then carry out those tasks. We also simulate real-life system effects such as networking instability. Our solution is shown to solve the task allocation problem to 6.7% of the theoretical optimal within the system configurations considered. It provides 5x better performance recovery over no-knowledge retention approaches when system connectivity is impacted, and is tested against systems up to 100 agents with less than a 9% impact on the algorithms' performance.

Adaptive Load Balancing of Parallel Applications with Multi-Agent Reinforcement Learning on Heterogeneous Systems

Load Balancing for Task Scheduling Based on Multi-Agent Reinforcement Learning in Cloud-Edge-End Collaborative Environments

Agent-based Grid Load Balancing Using Performance-Driven Task Scheduling

Multi-Agent Reinforcement Learning for Long-Term Network Resource Allocation through Auction: a V2X Application

Heterogeneous multi-agent task allocation based on graph neural network ant colony optimization algorithms

Task Allocation with Load Management in Multi-Agent Teams

Dynamic neighbourhood optimisation for task allocation using multi-agent

Decentralized scheduling through an adaptive, trading-based multi-agent system

An adaptive load balancing framework for parallel database systems based on collaborative agents

Reinforcement Learning for Load-balanced Parallel Particle Tracing

Distributed Task Offloading Based on Multi-Agent Deep Reinforcement Learning.

Fully Distributed Fog Load Balancing with Multi-Agent Reinforcement Learning

Game-theoretic Robotic Offloading Via Multi-Agent Learning for Agricultural Applications in Heterogeneous Networks

Multi-Agent Reinforcement Learning for Network Load Balancing in Data Center

Multiagent Deep Reinforcement Learning for Task Offloading and Resource Allocation in Cybertwin-Based Networks.

Multi-agent Reinforcement Learning for Dynamic Dispatching in Material Handling Systems

Multi-agent assignment via state augmented reinforcement learning

A Scheduling Algorithm Based on Reinforcement Learning for Heterogeneous Environments.

A Novel Multi-Agent Reinforcement Learning Approach for Job Scheduling in Grid Computing

A Multi-agent Reinforcement Learning Based Offloading Strategy for Multi-access Edge Computing

An Intelligent Offloading System Based on Multiagent Reinforcement Learning