Abstract:Mobile-edge computing (MEC) networks bring computing and storage capabilities closer to edge devices, which reduces latency and improves network performance. However, to further reduce transmission and computation costs while satisfying user-perceived quality of experience, a joint optimization in computing, pushing, and caching is needed. In this article, we formulate the joint-design problem in MEC networks as an infinite-horizon discounted-cost Markov decision process and solve it using a deep reinforcement learning (DRL)-based framework that enables the dynamic orchestration of computing, pushing, and caching. Through the deep networks embedded in the DRL structure, our framework can implicitly predict user future requests and push or cache the appropriate content to effectively enhance system performance. One issue we encountered when considering three functions collectively is the curse of dimensionality for the action space. To address it, we relaxed the discrete action space into a continuous space and then adopted soft actor–critic learning to solve the optimization problem, followed by utilizing a vector quantization method to obtain the desired discrete action. Additionally, an action correction method was proposed to compress the action space further and accelerate the convergence. Our simulations under the setting of a general single-user, single-server MEC network with dynamic transmission link quality demonstrate that the proposed framework effectively decreases transmission bandwidth and computing cost by proactively pushing data on future demand to users and jointly optimizing the three functions. We also conduct extensive parameter tuning analysis, which shows that our approach outperforms the baselines under various parameter settings.

Performance Optimization in Mobile-Edge Computing Via Deep Reinforcement Learning

Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning

Deep Q-Learning Based Computation Offloading Strategy for Mobile Edge Computing

Performance Optimization in Heterogeneous WiFi and Cellular Mobile Edge Computing Systems.

Decentralized Computation Offloading for Multi-User Mobile Edge Computing: A Deep Reinforcement Learning Approach

An Efficient Online Computation Offloading Approach for Large-Scale Mobile Edge Computing via Deep Reinforcement Learning

Energy Efficient Joint Computation Offloading and Service Caching for Mobile Edge Computing: A Deep Reinforcement Learning Approach

Delay-Optimal Computation Offloading for Computation-Constrained Mobile Edge Networks.

Smart Collaborative Optimizations Strategy for Mobile Edge Computing Based on Deep Reinforcement Learning

Joint Computation Offloading and Service Caching in Mobile Edge-Cloud Computing Via Deep Reinforcement Learning

Deep Reinforcement Learning Based Computation Offloading for Mobility-Aware Edge Computing.

Ultra-Low Latency Multi-Task Offloading in Mobile Edge Computing

Joint Offloading and Resource Allocation Using Deep Reinforcement Learning in Mobile Edge Computing

Deep Reinforcement Learning-Based Offloading Decision Optimization in Mobile Edge Computing

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

Computation Offloading Strategy Based on Deep Reinforcement Learning in Cloud-Assisted Mobile Edge Computing

Joint Computing, Pushing, and Caching Optimization for Mobile-Edge Computing Networks via Soft Actor–Critic Learning

Deep Reinforcement Learning Based Offloading Scheme for Mobile Edge Computing

Deep Reinforcement Learning Based Computation Offloading and Resource Allocation for MEC

Adaptive Edge Resource Allocation for Maximizing the Number of Tasks Completed on Time - A Deep Q-Learning Approach.

Multi-Agent Deep Reinforcement Learning for Efficient Computation Offloading in Mobile Edge Computing