Abstract:Internet of Things (IoT) technology suffers from the challenge that rare wireless network resources are difficult to meet the influx of a huge number of terminal devices. Cache-enabled device-to-device (D2D) communication technology is expected to relieve network pressure with the fact that the requesting contents can be easily obtained from nearby users. However, how to design an effective caching policy becomes very challenging due to the limited content storage capacity and the uncertainty of user mobility pattern. In this article, we study the jointly cache content placement and delivery policy for the cache-enabled D2D networks. Specifically, two potential recurrent neural network approaches [the echo state network (ESN) and the long short-term memory (LSTM) network] are employed to predict users' mobility and content popularity, so as to determine which content to cache and where to cache. When the local cache of the user cannot satisfy its own request, the user may consider establishing a D2D link with the neighboring user to implement the content delivery. In order to decide which user will be selected to establish the D2D link, we propose the novel schemes based on deep reinforcement learning to implement the dynamic decision making and optimization of the content delivery problems, aiming at improving the quality of experience of overall caching system. The simulation results suggest that the cache hit ratio of the system can be well improved by the proposed content placement strategy, and the proposed content delivery approaches can effectively reduce the request content delivery delay and energy consumption.

A Green DDPG Reinforcement Learning-Based Framework for Content Caching

Edge Caching for D2D Enabled Hierarchical Wireless Networks with Deep Reinforcement Learning

Multi-agent Deep Reinforcement Learning-Based Content Caching in Cache-Enabled Networks

Deep Reinforcement Learning Approaches for Content Caching in Cache-Enabled D2D Networks

Q-Learning Based Edge Caching Optimization for D2D Enabled Hierarchical Wireless Networks.

Delay-Optimal Edge Cache Replacement with Non-Markovian Content Fetching

Content-centric Caching Using Deep Reinforcement Learning in Mobile Computing

Intelligent Edge Content Caching: A Deep Recurrent Reinforcement Learning Method

Content Collaborative Caching Strategy in the Edge Maintenance of Communication Network: A Joint Download Delay and Energy Consumption Method

Deep Reinforcement Learning for Cooperative Edge Caching in Future Mobile Networks.

A DQN-Based Cache Strategy for Mobile Edge Networks

Double Coded Caching in Ultra Dense Networks: Caching and Multicast Scheduling Via Deep Reinforcement Learning.

How to Cache Important Contents for Multi-modal Service in Dynamic Networks: A DRL-based Caching Scheme

Dynamic Content Update for Wireless Edge Caching via Deep Reinforcement Learning

Attention Mechanism-Aided Deep Reinforcement Learning for Dynamic Edge Caching

Reinforcement Learning-Based Optimal Computing and Caching in Mobile Edge Network

Content Caching Policy Based on GAN and Distributional Reinforcement Learning

Multi-Agent Reinforcement Learning for Efficient Content Caching in Mobile D2D Networks

Efficient D2D Content Caching Using Multi-Agent Reinforcement Learning

Joint User Scheduling and Content Caching Strategy for Mobile Edge Networks Using Deep Reinforcement Learning