Abstract:With the growing demand for latency-critical and computation-intensive Internet of Things (IoT) services, the IoT-oriented network architecture, mobile edge computing (MEC), has emerged as a promising technique to reinforce the computation capability of the resource-constrained IoT devices. To exploit the cloud-like functions at the network edge, service caching has been implemented to reuse the computation task input/output data, thus effectively reducing the delay incurred by data retransmissions and repeated execution of the same task. In a multi-user cache-assisted MEC system, users' preferences for different types of services, possibly dependent on their locations, play an important role in joint design of communication, computation and service caching. In this paper, we consider multiple representative locations, where users at the same location share the same preference profile for a given set of services. Specifically, by exploiting the location-aware users' preference profiles, we propose joint optimization of the binary cache placement, the edge computation resource and the bandwidth allocation to minimize the expected sum-energy consumption, subject to the bandwidth and the computation limitations as well as the service latency constraints. To effectively solve the mixed-integer non-convex problem, we propose a deep learning (DL)-based offline cache placement scheme using a novel stochastic quantization based discrete-action generation method. The proposed hybrid learning framework advocates both benefits from the model-free DL approach and the model-based optimization. The simulations verify that the proposed DL-based scheme saves roughly 33% and 6.69% of energy consumption compared with the greedy caching and the popular caching, respectively, while achieving up to 99.01% of the optimal performance.

A Joint Caching and Offloading Strategy Using Reinforcement Learning for Multi-access Edge Computing Users

Joint Optimization of Task Caching and Computation Offloading for Multiuser Multitasking in Mobile Edge Computing

Hierarchical Deep Reinforcement Learning for Joint Service Caching and Computation Offloading in Mobile Edge-Cloud Computing

Joint optimization of service chain caching and task offloading in mobile edge computing

Dual-Timescale Resource Allocation for Collaborative Service Caching and Computation Offloading in IoT Systems.

Joint Computation Offloading and Resource Allocation for D2D-Assisted Mobile Edge Computing

A3C-DO: A Regional Resource Scheduling Framework Based on Deep Reinforcement Learning in Edge Scenario

Deep Reinforcement Learning-based computation offloading and distributed edge service caching for Mobile Edge Computing

Deep reinforcement learning‐based multitask hybrid computing offloading for multiaccess edge computing

Joint edge caching and dynamic service migration in SDN based mobile edge computing

Cloud-Edge–End Collaborative Task Offloading in Vehicular Edge Networks: A Multilayer Deep Reinforcement Learning Approach

Energy Efficient Joint Computation Offloading and Service Caching for Mobile Edge Computing: A Deep Reinforcement Learning Approach

CoOR: Collaborative Task Offloading and Service Caching Replacement for Vehicular Edge Computing Networks

CoPace: Edge Computation Offloading and Caching for Self-Driving with Deep Reinforcement Learning

Computation Offloading in Resource-constrained Edge Computing Systems based on Deep Reinforcement Learning

Collaborative Task Offloading and Service Caching Strategy for Mobile Edge Computing

Multi-mobile vehicles task offloading for vehicle-edge-cloud collaboration: A dependency-aware and deep reinforcement learning approach

Joint Resource Allocation and Cache Placement for Location-Aware Multi-User Mobile Edge Computing

Joint optimization of task caching and computation offloading in vehicular edge computing

Improved DDPG Based Two-Timescale Multi-Dimensional Resource Allocation for Multi-Access Edge Computing Networks

Multiuser Computation Offloading and Resource Allocation for Cloud–Edge Heterogeneous Network