Abstract:With the rapid development of smart city and 5C, user demand for Internet services has increased exponentially. Through collaborative content sharing, the storage limitation of a single edge server (ES) can be broken. However, when mobile users need to download the whole content through multiple regions, independently deciding the caching content for ESs in different regions may result in redundant caching. Furthermore, frequent switching of communication connection during user movement also causes retransmission delay. As a revolutionary approach in the artificial intelligence field, deep reinforcement learning (DRL) has earned great success in solving high-dimensional and network resource management related problems. Therefore, we integrate collaborative caching and DRL to build an intelligent edge caching framework, so as to realize collaborative caching between cloud and ESs. In this caching framework, a fed-erated-machine-learning-based user behavior prediction model is first designed to characterize the content preference and movement trajectory of mobile users. Next, to achieve efficient resource aggregation of ESs, a user-behavior-aware dynamic collaborative caching domain (DCCD) construction and management mechanism is devised to divide ESs into clusters, select cluster heads, and set the re-clustering rules. Then a DRL-based content caching and delivery algorithm is presented to decide the caching content of ESs in a DCCD from a global perspective and plan the transmission path for users, which reduces redundant content and transmission delay. Especially when a user request cannot be satisfied by the current DCCD, a cross-domain content delivery strategy is presented to allow ESs in other DCCDs to provide and forward content to the user, avoiding the traffic pressure and delay caused by requesting services from cloud. The simulation results show that the proposed collaborative caching framework can improve user satisfaction in terms of content hit rate an- service delay.

Deep Reinforcement Learning (DRL)-Based Device-to-Device (D2D) Caching With Blockchain and Mobile Edge Computing

Blockchain-Incentivized D2D and Mobile Edge Caching: A Deep Reinforcement Learning Approach

Distributed Deep Reinforcement Learning-Based Content Caching in Edge Computing-Enabled Blockchain Networks.

Energy Minimization in D2D-Assisted Cache-Enabled Internet of Things: A Deep Reinforcement Learning Approach

Secure Deep Reinforcement Learning for Dynamic Resource Allocation in Wireless MEC Networks

Blockchain-based Trustworthy Service Caching and Task Offloading for Intelligent Edge Computing

Optimizing MDS-coded cache-enable wireless network:a blockchain-based cooperative deep reinforcement learning approach

A Reinforcement Learning Approach for D2D-Assisted Cache-Enabled HetNets

MECC: A Mobile Edge Collaborative Caching Framework Empowered by Deep Reinforcement Learning

Deep Reinforcement Learning and Permissioned Blockchain for Content Caching in Vehicular Edge Computing and Networks

Deep Reinforcement Learning-based computation offloading and distributed edge service caching for Mobile Edge Computing

Deep Reinforcement Learning Approaches for Content Caching in Cache-Enabled D2D Networks

Attention-Weighted Federated Deep Reinforcement Learning for Device-to-Device Assisted Heterogeneous Collaborative Edge Caching

Recommendation-Enabled Edge Caching and D2D Offloading Via Incentive-Driven Deep Reinforcement Learning

A Deep-Reinforcement-Learning-Based Social-Aware Cooperative Caching Scheme in D2D Communication Networks

Joint Optimization and Scheduling of Computing and Caching Resource for Blockchain-Empowered IoT via CDRL Approach

Cooperative Caching and Fetching in D2D Communications - A Fully Decentralized Multi-Agent Reinforcement Learning Approach

Energy-Efficient Content Fetching Strategies in Cache-Enabled D2D Networks Via an Actor-Critic Reinforcement Learning Structure

Deep Reinforcement Learning for Cooperative Edge Caching in Future Mobile Networks.

5G Message Cooperative Content Caching Scheme for Blockchain-Enabled Mobile Edge Networks Using Reinforcement Learning

Combining Lyapunov Optimization and Deep Reinforcement Learning for D2D Assisted Heterogeneous Collaborative Edge Caching