Abstract:With the rapid development of Internet-of-Things (IoT) devices and mobile communication technologies, Multi-access Edge Computing (MEC) has emerged as a promising paradigm to extend cloud computing and storage capabilities to the edge of cellular networks, near to IoT devices. MEC enables IoT devices with limited battery capacity and computation/storage capabilities to execute their computation-intensive and latency-sensitive applications at the edge of the networks. However, to efficiently execute these applications in MEC systems, each task must be properly offloaded and scheduled onto the MEC servers. Additionally, the MEC servers may intelligently balance and share their computing resources to satisfy the application QoS and QoE. Therefore, effective resource allocation (RA) mechanisms in MEC are vital for ensuring its foreseen advantages. Recently, Machine Learning (ML) and Deep Learning (DL) have emerged as key methods for many challenging aspects of MEC. Particularly, ML and DL play a crucial role in addressing the challenges of RA in MEC. This paper presents a comprehensive survey of ML/DL-based RA mechanisms in MEC. We first present tutorials that demonstrate the advantages of applying ML and DL in MEC. Then, we present enabling technologies for quickly running ML/DL training and inference in MEC. Afterward, we provide an in-depth survey of recent works that used ML/DL methods for RA in MEC from three aspects: (1) ML/DL-based methods for task offloading; (2) ML/DL-based methods for task scheduling; and (3) ML/DL-based methods for joint resource allocation. Finally, we discuss key challenges and future research directions of applying ML/DL for resource allocation in MEC networks.

Deep Reinforcement Learning-Based Resource Management for Flexible Mobile Edge Computing: Architectures, Applications, and Research Issues

Data-Intensive Application Deployment at Edge: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning-Based Dynamic Resource Management for Mobile Edge Computing in Industrial Internet of Things

Deep Reinforcement Learning based Path Planning for UAV-assisted Edge Computing Networks

AI Driven Heterogeneous MEC System with UAV Assistance for Dynamic Environment: Challenges and Solutions

Task Offloading and Trajectory Control for UAV-Assisted Mobile Edge Computing Using Deep Reinforcement Learning

Mobility-Aware Resource Allocation in Multi-Access Edge Computing Using Deep Reinforcement Learning

Resource Awareness In Unmanned Aerial Vehicle-Assisted Mobile-Edge Computing Systems

RL-Based User Association and Resource Allocation for Multi-UAV Enabled MEC

Deep Reinforcement Learning Based Freshness-Aware Path Planning for UAV-Assisted Edge Computing Networks with Device Mobility

Reinforcement Learning-Empowered Mobile Edge Computing for 6G Edge Intelligence

DDPG-based Resource Management for MEC/UAV-Assisted Vehicular Networks

A Deep Reinforcement Learning Based Approach for Optimizing Trajectory and Frequency in Energy Constrained Multi-UAV Assisted MEC System

Deep Reinforcement Learning for Collaborative Edge Computing in Vehicular Networks

Machine and Deep Learning for Resource Allocation in Multi-Access Edge Computing: A Survey

Energy-Efficient Collaborative Multi-Access Edge Computing Via Deep Reinforcement Learning

Reinforcement Learning with UAV Assistance for Optimized Computation Offloading in Mobile Edge Computing

Beyond the Edge: An Advanced Exploration of Reinforcement Learning for Mobile Edge Computing, its Applications, and Future Research Trajectories

Uav-Irs-Assisted Energy Harvesting for Edge Computing Based on Deep Reinforcement Learning

Semi-Distributed Resource Management in UAV-Aided MEC Systems: A Multi-Agent Federated Reinforcement Learning Approach

Deep Reinforcement Learning for Computation and Communication Resource Allocation in Multiaccess MEC Assisted Railway IoT Networks