Abstract:Mobile-edge computing (MEC) networks bring computing and storage capabilities closer to edge devices, which reduces latency and improves network performance. However, to further reduce transmission and computation costs while satisfying user-perceived quality of experience, a joint optimization in computing, pushing, and caching is needed. In this article, we formulate the joint-design problem in MEC networks as an infinite-horizon discounted-cost Markov decision process and solve it using a deep reinforcement learning (DRL)-based framework that enables the dynamic orchestration of computing, pushing, and caching. Through the deep networks embedded in the DRL structure, our framework can implicitly predict user future requests and push or cache the appropriate content to effectively enhance system performance. One issue we encountered when considering three functions collectively is the curse of dimensionality for the action space. To address it, we relaxed the discrete action space into a continuous space and then adopted soft actor–critic learning to solve the optimization problem, followed by utilizing a vector quantization method to obtain the desired discrete action. Additionally, an action correction method was proposed to compress the action space further and accelerate the convergence. Our simulations under the setting of a general single-user, single-server MEC network with dynamic transmission link quality demonstrate that the proposed framework effectively decreases transmission bandwidth and computing cost by proactively pushing data on future demand to users and jointly optimizing the three functions. We also conduct extensive parameter tuning analysis, which shows that our approach outperforms the baselines under various parameter settings.

Latency-Aware Resource Allocation for Mobile Edge Generation and Computing via Deep Reinforcement Learning

Joint Optimization of Task Offloading and Resource Allocation Via Deep Reinforcement Learning for Augmented Reality in Mobile Edge Network

Energy Efficient Joint Computation Offloading and Service Caching for Mobile Edge Computing: A Deep Reinforcement Learning Approach

Computing Assistance from the Sky: Decentralized Computation Efficiency Optimization for Air-Ground Integrated MEC Networks

Smart Resource Allocation for Mobile Edge Computing: A Deep Reinforcement Learning Approach

Latency Optimization for Resource Allocation in Mobile-Edge Computation Offloading.

Joint Offloading and Resource Allocation Using Deep Reinforcement Learning in Mobile Edge Computing

Data-Intensive Application Deployment at Edge: A Deep Reinforcement Learning Approach

Retrieval-Augmented Generation for Mobile Edge Computing via Large Language Model

Deep Reinforcement Learning for Performance-Aware Adaptive Resource Allocation in Mobile Edge Computing

Resource allocation algorithm for MEC based on Deep Reinforcement Learning

Deep Reinforcement Learning Based Rendering Service Placement for Cloud Gaming in Mobile Edge Computing Systems.

A collaborative optimization strategy for computing offloading and resource allocation based on multi-agent deep reinforcement learning

Performance Optimization in Mobile-Edge Computing Via Deep Reinforcement Learning

Energy and Delay-Aware Task Offloading and Resource Allocation in Mobile Edge Computing

Multi-Agent Reinforcement Learning For Joint Wireless And Computational Resource Allocation In Mobile Edge Computing System

Cache-Aided MEC for IoT: Resource Allocation Using Deep Graph Reinforcement Learning

Mobile Edge Computing Networks: Online Low-Latency and Fresh Service Provisioning

Smart Collaborative Optimizations Strategy for Mobile Edge Computing Based on Deep Reinforcement Learning

Green-Oriented Offloading and Resource Allocation by Reinforcement Learning in MEC

Joint Computing, Pushing, and Caching Optimization for Mobile-Edge Computing Networks via Soft Actor–Critic Learning