Abstract:With the rapid development of smart city and 5C, user demand for Internet services has increased exponentially. Through collaborative content sharing, the storage limitation of a single edge server (ES) can be broken. However, when mobile users need to download the whole content through multiple regions, independently deciding the caching content for ESs in different regions may result in redundant caching. Furthermore, frequent switching of communication connection during user movement also causes retransmission delay. As a revolutionary approach in the artificial intelligence field, deep reinforcement learning (DRL) has earned great success in solving high-dimensional and network resource management related problems. Therefore, we integrate collaborative caching and DRL to build an intelligent edge caching framework, so as to realize collaborative caching between cloud and ESs. In this caching framework, a fed-erated-machine-learning-based user behavior prediction model is first designed to characterize the content preference and movement trajectory of mobile users. Next, to achieve efficient resource aggregation of ESs, a user-behavior-aware dynamic collaborative caching domain (DCCD) construction and management mechanism is devised to divide ESs into clusters, select cluster heads, and set the re-clustering rules. Then a DRL-based content caching and delivery algorithm is presented to decide the caching content of ESs in a DCCD from a global perspective and plan the transmission path for users, which reduces redundant content and transmission delay. Especially when a user request cannot be satisfied by the current DCCD, a cross-domain content delivery strategy is presented to allow ESs in other DCCDs to provide and forward content to the user, avoiding the traffic pressure and delay caused by requesting services from cloud. The simulation results show that the proposed collaborative caching framework can improve user satisfaction in terms of content hit rate an- service delay.

Combining Lyapunov Optimization and Deep Reinforcement Learning for D2D Assisted Heterogeneous Collaborative Edge Caching

Optimal D2d Cooperative Caching System In Sdn Based Wireless Network

Reinforcement Learning-Based Optimal Computing and Caching in Mobile Edge Network

Cooperative Caching and Fetching in D2D Communications - A Fully Decentralized Multi-Agent Reinforcement Learning Approach

Exploiting Deep Reinforcement Learning for Edge Caching in Cell-Free Massive MIMO Systems

Deep Reinforcement Learning Approaches for Content Caching in Cache-Enabled D2D Networks

Delay-Aware Cache-Enabled Cooperative D2D Transmission in Mobile Cellular Networks

MECC: A Mobile Edge Collaborative Caching Framework Empowered by Deep Reinforcement Learning

Machine Learning-Based Resource Optimization for D2D Communication Underlaying Networks

Multi-Agent Reinforcement Learning for Cooperative Coded Caching via Homotopy Optimization

Edge Caching at Base Stations With Device-to-Device Offloading

Reinforcement Learning Based Cooperative Coded Caching under Dynamic Popularities in Ultra-Dense Networks

Cooperative caching algorithm for mobile edge networks based on multi-agent meta reinforcement learning

Adaptive Partitioning and Placement for Two-Layer Collaborative Caching in Mobile Edge Computing Networks

Deadline-Aware Cache Placement Scheme Using Fuzzy Reinforcement Learning in Device-to-Device Mobile Edge Networks

Energy-Efficient Collaborative Multi-Access Edge Computing Via Deep Reinforcement Learning

A DRL-Driven Intelligent Optimization Strategy for Resource Allocation in Cloud-Edge-End Cooperation Environments

Energy Efficient Joint Computation Offloading and Service Caching for Mobile Edge Computing: A Deep Reinforcement Learning Approach

Joint Optimization of Preference-Aware Caching and Content Migration in Cost-Efficient Mobile Edge Networks

Efficient Federated DRL-Based Cooperative Caching for Mobile Edge Networks

D2D-Assisted Multi-User Cooperative Partial Offloading in MEC Based on Deep Reinforcement Learning