Abstract:Internet of Things (IoT) technology suffers from the challenge that rare wireless network resources are difficult to meet the influx of a huge number of terminal devices. Cache-enabled device-to-device (D2D) communication technology is expected to relieve network pressure with the fact that the requesting contents can be easily obtained from nearby users. However, how to design an effective caching policy becomes very challenging due to the limited content storage capacity and the uncertainty of user mobility pattern. In this article, we study the jointly cache content placement and delivery policy for the cache-enabled D2D networks. Specifically, two potential recurrent neural network approaches [the echo state network (ESN) and the long short-term memory (LSTM) network] are employed to predict users' mobility and content popularity, so as to determine which content to cache and where to cache. When the local cache of the user cannot satisfy its own request, the user may consider establishing a D2D link with the neighboring user to implement the content delivery. In order to decide which user will be selected to establish the D2D link, we propose the novel schemes based on deep reinforcement learning to implement the dynamic decision making and optimization of the content delivery problems, aiming at improving the quality of experience of overall caching system. The simulation results suggest that the cache hit ratio of the system can be well improved by the proposed content placement strategy, and the proposed content delivery approaches can effectively reduce the request content delivery delay and energy consumption.

Content Update Via Deep Reinforcement Learning in Recommendation-Aware Edge Caching Network

Dynamic Content Update for Wireless Edge Caching via Deep Reinforcement Learning

Deep Reinforcement Learning-Based Edge Caching in Single-Cell Wireless Networks

Deep Reinforcement Learning for Cooperative Edge Caching in Future Mobile Networks.

A DQN-Based Cache Strategy for Mobile Edge Networks

Joint User Scheduling and Content Caching Strategy for Mobile Edge Networks Using Deep Reinforcement Learning

Distributed Edge Caching with Content Recommendation in Fog-RANs Via Deep Reinforcement Learning

Content-centric Caching Using Deep Reinforcement Learning in Mobile Computing

Mobility Prediction-Based Wireless Edge Caching Using Deep Reinforcement Learning

Federated Distributed Deep Reinforcement Learning for Recommendation-enabled Edge Caching

Federated Deep Reinforcement Learning for Recommendation-Enabled Edge Caching in Mobile Edge-Cloud Computing Networks

Edge Caching for D2D Enabled Hierarchical Wireless Networks with Deep Reinforcement Learning

Towards Intelligent Adaptive Edge Caching using Deep Reinforcement Learning

RECC: A Relationship-Enhanced Content Caching Algorithm Using Deep Reinforcement Learning

Exploiting Deep Reinforcement Learning for Edge Caching in Cell-Free Massive MIMO Systems

Intelligent Edge Content Caching: A Deep Recurrent Reinforcement Learning Method

Deep Reinforcement Learning Based Caching Placement and User Association for Dynamic Cellular Networks

Reinforcement Learning-Based Optimal Computing and Caching in Mobile Edge Network

Deep Reinforcement Learning Approaches for Content Caching in Cache-Enabled D2D Networks

A Reinforcement Learning Based Smart Cache Strategy for Cache-Aided Ultra-Dense Network.

Deep Reinforcement Learning for Mobile Edge Caching: Review, New Features, and Open Issues