Abstract:Internet of Things (IoT) technology suffers from the challenge that rare wireless network resources are difficult to meet the influx of a huge number of terminal devices. Cache-enabled device-to-device (D2D) communication technology is expected to relieve network pressure with the fact that the requesting contents can be easily obtained from nearby users. However, how to design an effective caching policy becomes very challenging due to the limited content storage capacity and the uncertainty of user mobility pattern. In this article, we study the jointly cache content placement and delivery policy for the cache-enabled D2D networks. Specifically, two potential recurrent neural network approaches [the echo state network (ESN) and the long short-term memory (LSTM) network] are employed to predict users' mobility and content popularity, so as to determine which content to cache and where to cache. When the local cache of the user cannot satisfy its own request, the user may consider establishing a D2D link with the neighboring user to implement the content delivery. In order to decide which user will be selected to establish the D2D link, we propose the novel schemes based on deep reinforcement learning to implement the dynamic decision making and optimization of the content delivery problems, aiming at improving the quality of experience of overall caching system. The simulation results suggest that the cache hit ratio of the system can be well improved by the proposed content placement strategy, and the proposed content delivery approaches can effectively reduce the request content delivery delay and energy consumption.

Multi-Agent Reinforcement Learning for Efficient Content Caching in Mobile D2D Networks

Efficient D2D Content Caching Using Multi-Agent Reinforcement Learning

Multi-Agent Reinforcement Learning Based Cooperative Content Caching for Mobile Edge Networks

Cooperative Caching and Fetching in D2D Communications - A Fully Decentralized Multi-Agent Reinforcement Learning Approach

Multi-agent Deep Reinforcement Learning-Based Content Caching in Cache-Enabled Networks

Multi-agent Cooperative Alternating Q-learning Caching in D2D-enabled Cellular Networks

A Learning-Based Cooperative Caching Strategy in D2D Assisted Cellular Networks

Deep Reinforcement Learning Approaches for Content Caching in Cache-Enabled D2D Networks

Jointly Optimal Caching and Routing Using Multi-Agent Reinforcement Learning

Learning-Based Cooperative Content Caching Policy for Mobile Edge Computing.

Joint Content Popularity Prediction And Content Delivery Policy For Cache-Enabled D2d Networks: A Deep Reinforcement Learning Approach

Recommendation-Driven Multi-Cell Cooperative Caching: A Multi-Agent Reinforcement Learning Approach

Q-Learning Based Edge Caching Optimization for D2D Enabled Hierarchical Wireless Networks.

Stochastic Game Based Cooperative Alternating Q-Learning Caching in Dynamic D2D Networks.

Deep Reinforcement Learning-Based Joint Caching and Routing in AI-Driven Networks

A Deep-Reinforcement-Learning-Based Social-Aware Cooperative Caching Scheme in D2D Communication Networks

Content-centric Caching Using Deep Reinforcement Learning in Mobile Computing

Multi-Agent Reinforcement Learning for Cooperative Edge Caching in Heterogeneous Networks.

A Reinforcement Learning Approach for D2D-Assisted Cache-Enabled HetNets

Multi-Agent Reinforcement Learning for Cooperative Coded Caching via Homotopy Optimization

Attention-Weighted Federated Deep Reinforcement Learning for Device-to-Device Assisted Heterogeneous Collaborative Edge Caching