Abstract:Small-cell mobile edge computing (SE-MEC) networks amalgamate the virtues of MEC and small-cell networks, providing user devices (UDs) with lower-latency services and enhancing data processing capabilities. Nevertheless, time-varying wireless channels, dynamic UD requirements, and severe interference among UDs make it difficult to fully exploit the limited network resources and stably provide computing services for UDs. Therefore, efficient task offloading and resource allocation (TORA) is essential to SE-MEC networks. Moreover, since multiple small cells are deployed, decentralized TORA schemes are preferred in practice. Thus, this paper aims to design distributed adaptive TORA schemes with low communication overhead for SE-MEC networks. In pursuit of an eco-friendly design, an optimization problem with the goal of minimizing the total energy consumption (TEC) of UDs subject to delay constraints is formulated. To effectively deal with network's dynamic characteristics, the reinforce learning framework is applied, where the TEC minimization problem is first modeled as a partially observable Markov decision process (POMDP), and then an efficient multi-agent proximal policy optimization (MAPPO)-based scheme is presented to solve it. In the presented MAPPO-based scheme, each small-cell base station (SBS) serves as an agent and is capable of making TORA decisions only with its own local information. To promote collaboration among multiple agents, a global reward function is designed, where both TEC and delay constraints satisfaction probability (DCSP) of the UDs are taken into account. A state normalization mechanism is also introduced into the presented MAPPO-based scheme for enhancing learning performance. Simulation results show that although the proposed MAPPO-based scheme works in a distributed manner, it achieves very similar performance to the centralized one, and it also shows that there exists a trade-off between DCSP and TEC. In addition, it is demonstrated that the state normalization mechanism has a significant effect on reducing TEC.

Deep Reinforcement Learning Based Task Offloading and Resource Allocation in Small Cell MEC

Task Offloading, Load Balancing, and Resource Allocation in MEC Networks

Collaborative Task Offloading and Resource Allocation in Small-Cell MEC: A Multi-Agent PPO-Based Scheme

Task and Resource Allocation in Mobile Edge Computing: an Improved Reinforcement Learning Approach

Mobility-Aware Computation Offloading with Adaptive Load Balancing in Small-Cell MEC

Joint Offloading and Resource Allocation Using Deep Reinforcement Learning in Mobile Edge Computing

Deep Reinforcement Learning Based Computation Offloading and Resource Allocation for MEC

An intelligent task offloading method based on multi-agent deep reinforcement learning in ultra-dense heterogeneous network with mobile edge computing

Energy and Delay-Aware Task Offloading and Resource Allocation in Mobile Edge Computing

Dynamic Offloading Strategy for Delay-Sensitive Task in Mobile-Edge Computing Networks

Performance Optimization in Mobile-Edge Computing Via Deep Reinforcement Learning

Energy Efficient and Low Delay Partial Offloading Scheduling and Power Allocation for MEC

Deep Reinforcement Learning for Energy Minimization in Multi-RIS-Aided Cell-Free MEC Networks

Dependency-Aware Dynamic Task Offloading Based on Deep Reinforcement Learning in Mobile Edge Computing

Multi-Agent Deep Reinforcement Learning for Computation Offloading and Interference Coordination in Small Cell Networks

Towards Decentralized Task Offloading and Resource Allocation in User-Centric MEC

A Q-learning based Method for Energy-Efficient Computation Offloading in Mobile Edge Computing

Towards Decentralized Task Offloading and Resource Allocation in User-Centric Mobile Edge Computing

Adaptive Edge Resource Allocation for Maximizing the Number of Tasks Completed on Time - A Deep Q-Learning Approach.

A Machine Learning Approach for Task and Resource Allocation in Mobile-Edge Computing-Based Networks

Joint Task Offloading and Resource Allocation for Mobile Edge Computing in Ultra-Dense Network