Abstract:As one of the important complementary technologies of the fifth-generation (5G) wireless communication and beyond, mobile device-to-device (D2D) edge caching and computing can effectively reduce the pressure on backbone networks and improve the user experience. Specific content can be pre-cached on the user devices based on personalized content placement strategies, and the cached content can be fetched by neighboring devices in the same D2D network. However, when multiple devices simultaneously fetch content from the same device, collisions will occur and reduce communication efficiency. In this paper, we design the content fetching strategies based on an actor-critic deep reinforcement learning (DRL) architecture, which can adjust the content fetching collision rate to adapt to different application scenarios. First, the optimization problem is formulated with the goal of minimizing the collision rate to improve the throughput, and a general actor-critic DRL algorithm is used to improve the content fetching strategy. Second, by optimizing the network architecture and reward function, the two-level actor-critic algorithm is improved to effectively manage the collision rate and transmission power. Furthermore, to balance the conflict between the collision rate and device energy consumption, the related reward values are weighted in the reward function to optimize the energy efficiency. The simulation results show that the content fetching collision rate based on the improved two-level actor-critic algorithm decreases significantly compared with that of the baseline algorithms, and the network energy consumption can be optimized by adjusting the weight factors.

Blockchain-Incentivized D2D and Mobile Edge Caching: A Deep Reinforcement Learning Approach

Decentralized Caching Framework Toward Edge Network Based on Blockchain

An Optimal Incentive Mechanism for Blockchain-enabled Content Caching in Device-to-Device Communication

Incentive-Driven Deep Reinforcement Learning for Content Caching and D2D Offloading

Energy Minimization in D2D-Assisted Cache-Enabled Internet of Things: A Deep Reinforcement Learning Approach

Joint Optimization of Edge Computing Resource Pricing and Wireless Caching for Blockchain-Driven Networks

Cooperative Caching and Fetching in D2D Communications - A Fully Decentralized Multi-Agent Reinforcement Learning Approach

Blockchain-Driven Contents Sharing Strategy for Wireless Cache-enabled D2D Networks

Incentive Mechanism Design for Green Mobile D2D Caching Networks

Decentralized Caching for Content Delivery Based on Blockchain: A Game Theoretic Perspective

Deep Reinforcement Learning and Permissioned Blockchain for Content Caching in Vehicular Edge Computing and Networks

Content-centric Caching Using Deep Reinforcement Learning in Mobile Computing

Deep Reinforcement Learning Approaches for Content Caching in Cache-Enabled D2D Networks

Deep Reinforcement Learning for Cooperative Edge Caching in Future Mobile Networks.

Towards Intelligent Adaptive Edge Caching using Deep Reinforcement Learning

Edge Caching for D2D Enabled Hierarchical Wireless Networks with Deep Reinforcement Learning

Energy-Efficient Content Fetching Strategies in Cache-Enabled D2D Networks Via an Actor-Critic Reinforcement Learning Structure

A Reinforcement Learning Approach for D2D-Assisted Cache-Enabled HetNets

Joint Content Popularity Prediction And Content Delivery Policy For Cache-Enabled D2d Networks: A Deep Reinforcement Learning Approach

Attention-Weighted Federated Deep Reinforcement Learning for Device-to-Device Assisted Heterogeneous Collaborative Edge Caching

Reinforcement Learning-Based Optimal Computing and Caching in Mobile Edge Network