Abstract:With the rapid development of smart city and 5C, user demand for Internet services has increased exponentially. Through collaborative content sharing, the storage limitation of a single edge server (ES) can be broken. However, when mobile users need to download the whole content through multiple regions, independently deciding the caching content for ESs in different regions may result in redundant caching. Furthermore, frequent switching of communication connection during user movement also causes retransmission delay. As a revolutionary approach in the artificial intelligence field, deep reinforcement learning (DRL) has earned great success in solving high-dimensional and network resource management related problems. Therefore, we integrate collaborative caching and DRL to build an intelligent edge caching framework, so as to realize collaborative caching between cloud and ESs. In this caching framework, a fed-erated-machine-learning-based user behavior prediction model is first designed to characterize the content preference and movement trajectory of mobile users. Next, to achieve efficient resource aggregation of ESs, a user-behavior-aware dynamic collaborative caching domain (DCCD) construction and management mechanism is devised to divide ESs into clusters, select cluster heads, and set the re-clustering rules. Then a DRL-based content caching and delivery algorithm is presented to decide the caching content of ESs in a DCCD from a global perspective and plan the transmission path for users, which reduces redundant content and transmission delay. Especially when a user request cannot be satisfied by the current DCCD, a cross-domain content delivery strategy is presented to allow ESs in other DCCDs to provide and forward content to the user, avoiding the traffic pressure and delay caused by requesting services from cloud. The simulation results show that the proposed collaborative caching framework can improve user satisfaction in terms of content hit rate an- service delay.

Joint Content Caching and Recommendation in Opportunistic Mobile Networks Through Deep Reinforcement Learning and Broad Learning

Reinforcement Learning-Based Optimal Computing and Caching in Mobile Edge Network

Federated Deep Reinforcement Learning for Recommendation-Enabled Edge Caching in Mobile Edge-Cloud Computing Networks

Proactive Content Caching Based on Actor-Critic Reinforcement Learning for Mobile Edge Networks

Multi-Agent Reinforcement Learning Based Cooperative Content Caching for Mobile Edge Networks

Joint Design of Content Delivery and Recommendation in Wireless Caching Networks

Multi-Agent Deep Reinforcement Learning-Based Cooperative Edge Caching for Ultra-Dense Next-Generation Networks

Joint Computing, Pushing, and Caching Optimization for Mobile-Edge Computing Networks via Soft Actor–Critic Learning

Localized Small Cell Caching: A Machine Learning Approach Based on Rating Data

Multi-Objective Learning for Efficient Content Caching for Mobile Edge Networks

Learning-Based Cooperative Content Caching Policy for Mobile Edge Computing.

Joint Optimization of Preference-Aware Caching and Content Migration in Cost-Efficient Mobile Edge Networks

Joint Content Caching, Recommendation, and Transmission for Layered Scalable Videos Over Dynamic Cellular Networks: A Dueling Deep Q-Learning Approach

Deep Reinforcement Learning for Cooperative Content Caching in Vehicular Edge Computing and Networks.

Energy Efficient Joint Computation Offloading and Service Caching for Mobile Edge Computing: A Deep Reinforcement Learning Approach

MECC: A Mobile Edge Collaborative Caching Framework Empowered by Deep Reinforcement Learning

Mobility Prediction-Based Wireless Edge Caching Using Deep Reinforcement Learning

A Learning-based Approach to Joint Content Caching and Recommendation at Base Stations.

Joint User-Side Recommendation and D2D-Assisted Offloading for Cache-Enabled Cellular Networks with Mobility Consideration.

Content-centric Caching Using Deep Reinforcement Learning in Mobile Computing

Multi-Agent Reinforcement Learning for Efficient Content Caching in Mobile D2D Networks