Abstract:Mobile edge computing (MEC) provides extremely low-latency services for mobile users, by attaching computing resources to 5G base stations in an MEC network. Network service providers can cache their services from remote data centers to base stations to serve mobile users within their proximity, thereby reducing service latencies. However, mobile users of network services usually have bursty requests that require immediate processing in the MEC network. The data traffic of such requests is bursty, since mobile users have various hidden features including locations, group tags, and mobility patterns. Furthermore, such bursty data traffic causes uncertain congestion at base stations and thus leads to uncertain processing delays. Considering the limited resources of base stations, network services may not be able to be placed into base stations permanently to handle the bursty data traffic. As such, network services need to be dynamically cached in the MEC network to fully address the bursty data traffic and uncertain processing delays.In this paper, we investigate the problem of dynamic service caching and task offloading in an MEC network, by adopting the online learning technique to harness the challenges brought by bursty data traffic and uncertain processing delays. We first propose an online learning algorithm for the problem with uncertain processing delays, by utilizing the multi-armed bandits technique, and analyze the regret bound of the proposed algorithm. We then propose another online learning algorithm for the problem with bursty data traffic and uncertain processing delays, which adaptively learns the bursty data traffic of requests, based on small samples of mobile users’ hidden features. We also propose a novel architecture of Generative Adversarial Network (GAN) to accurately predict user demands using small samples of mobile users’ hidden features. Based on the proposed GAN model, we then devise an efficient heuristic for the problem with the uncertainties of both bursty data traffic and uncertain delays. We finally evaluate the performance of the proposed algorithms by simulations, using a real data trace. Experimental results show that the performance of the proposed algorithms outperforms existing ones by up to 44% in terms of average delay.

A Multi-Armed Bandits Learning-Based Approach to Service Caching in Edge Computing Environment.

Cache Placement Optimization in Mobile Edge Computing Networks with Unaware Environment -- An Extended Multi-armed Bandit Approach

Multi-agent Multi-armed Bandit Learning for Content Caching in Edge Networks

Reinforcement learning for cost-effective IoT service caching at the edge

Learning for Exception: Dynamic Service Caching in 5G-Enabled MECs with Bursty User Demands

Learning-driven Service Caching in MEC Networks with Bursty Data Traffic and Uncertain Delays

Efficient Caching Strategy in Wireless Networks with Mobile Edge Computing

Service caching decision-making policy for mobile edge computing using deep reinforcement learning

Proactive Content Caching Based on Actor-Critic Reinforcement Learning for Mobile Edge Networks

Reinforcement Learning-Based Optimal Computing and Caching in Mobile Edge Network

Collaborative Service Caching for Edge Computing in Dense Small Cell Networks

Energy Efficient Joint Computation Offloading and Service Caching for Mobile Edge Computing: A Deep Reinforcement Learning Approach

Multi-Time Scale Service Caching and Pricing in MEC Systems with Dynamic Program Popularity

Deep reinforcement learning-based task offloading and service migrating policies in service caching-assisted mobile edge computing

Mobility-Aware Service Caching in Mobile Edge Computing for Internet of Things

Cache-Aided MEC for IoT: Resource Allocation Using Deep Graph Reinforcement Learning

Joint Optimization of Service Caching and Task Offloading for Customer Application in MEC: A Hybrid SAC Scheme

Cooperative Task Offloading and Service Caching for Digital Twin Edge Networks: A Graph Attention Multi-Agent Reinforcement Learning Approach

Near-Optimal and Collaborative Service Caching in Mobile Edge Clouds

Joint Resource Allocation and Cache Placement for Location-Aware Multi-User Mobile Edge Computing

Deep Reinforcement Learning-based computation offloading and distributed edge service caching for Mobile Edge Computing