Abstract:With the rapid development of smart city and 5C, user demand for Internet services has increased exponentially. Through collaborative content sharing, the storage limitation of a single edge server (ES) can be broken. However, when mobile users need to download the whole content through multiple regions, independently deciding the caching content for ESs in different regions may result in redundant caching. Furthermore, frequent switching of communication connection during user movement also causes retransmission delay. As a revolutionary approach in the artificial intelligence field, deep reinforcement learning (DRL) has earned great success in solving high-dimensional and network resource management related problems. Therefore, we integrate collaborative caching and DRL to build an intelligent edge caching framework, so as to realize collaborative caching between cloud and ESs. In this caching framework, a fed-erated-machine-learning-based user behavior prediction model is first designed to characterize the content preference and movement trajectory of mobile users. Next, to achieve efficient resource aggregation of ESs, a user-behavior-aware dynamic collaborative caching domain (DCCD) construction and management mechanism is devised to divide ESs into clusters, select cluster heads, and set the re-clustering rules. Then a DRL-based content caching and delivery algorithm is presented to decide the caching content of ESs in a DCCD from a global perspective and plan the transmission path for users, which reduces redundant content and transmission delay. Especially when a user request cannot be satisfied by the current DCCD, a cross-domain content delivery strategy is presented to allow ESs in other DCCDs to provide and forward content to the user, avoiding the traffic pressure and delay caused by requesting services from cloud. The simulation results show that the proposed collaborative caching framework can improve user satisfaction in terms of content hit rate an- service delay.

Adaptive Cache Server Selection and Resource Allocation Strategy in Mobile Edge Computing

MECC: A Mobile Edge Collaborative Caching Framework Empowered by Deep Reinforcement Learning

Service caching decision-making policy for mobile edge computing using deep reinforcement learning

Enhancing Mobile User Performance Through Data Caching over Edge Computing Wireless Networks.

Efficient Caching Strategy in Wireless Networks with Mobile Edge Computing

Caching Resource Allocation and Mobility Aware in Information-Centric Networking with Mobile Edge Computing

Towards Intelligent Adaptive Edge Caching using Deep Reinforcement Learning

Deadline-Aware Cache Placement Scheme Using Fuzzy Reinforcement Learning in Device-to-Device Mobile Edge Networks

Reinforcement Learning-Based Optimal Computing and Caching in Mobile Edge Network

Joint edge caching and dynamic service migration in SDN based mobile edge computing

Adaptive Partitioning and Placement for Two-Layer Collaborative Caching in Mobile Edge Computing Networks

Joint Resource Allocation and Cache Placement for Location-Aware Multi-User Mobile Edge Computing

Edge Caching at Base Stations With Device-to-Device Offloading

Energy-latency tradeoffs for edge caching and dynamic service migration based on DQN in mobile edge computing

Deep Reinforcement Learning-based computation offloading and distributed edge service caching for Mobile Edge Computing

Collaborative Data Caching and Computation Offloading for Multi-Service Mobile Edge Computing

An Optimized Multi-Layer Resource Management in Mobile Edge Computing Networks: A Joint Computation Offloading and Caching Solution

Dynamic Offloading Strategy for Delay-Sensitive Task in Mobile-Edge Computing Networks

Energy Efficient Joint Computation Offloading and Service Caching for Mobile Edge Computing: A Deep Reinforcement Learning Approach

Cache Placement Optimization in Mobile Edge Computing Networks with Unaware Environment -- An Extended Multi-armed Bandit Approach

Proactive Content Caching Based on Actor-Critic Reinforcement Learning for Mobile Edge Networks