Abstract:Internet of Things (IoT) technology suffers from the challenge that rare wireless network resources are difficult to meet the influx of a huge number of terminal devices. Cache-enabled device-to-device (D2D) communication technology is expected to relieve network pressure with the fact that the requesting contents can be easily obtained from nearby users. However, how to design an effective caching policy becomes very challenging due to the limited content storage capacity and the uncertainty of user mobility pattern. In this article, we study the jointly cache content placement and delivery policy for the cache-enabled D2D networks. Specifically, two potential recurrent neural network approaches [the echo state network (ESN) and the long short-term memory (LSTM) network] are employed to predict users' mobility and content popularity, so as to determine which content to cache and where to cache. When the local cache of the user cannot satisfy its own request, the user may consider establishing a D2D link with the neighboring user to implement the content delivery. In order to decide which user will be selected to establish the D2D link, we propose the novel schemes based on deep reinforcement learning to implement the dynamic decision making and optimization of the content delivery problems, aiming at improving the quality of experience of overall caching system. The simulation results suggest that the cache hit ratio of the system can be well improved by the proposed content placement strategy, and the proposed content delivery approaches can effectively reduce the request content delivery delay and energy consumption.

Caching Transient Data for Internet of Things: A Deep Reinforcement Learning Approach

A Deep Reinforcement Learning-Based Caching Strategy for IoT Networks With Transient Data

Edge Caching for IoT Transient Data Using Deep Reinforcement Learning

Deep Reinforcement Learning for IoT Networks: Age of Information and Energy Cost Tradeoff

Towards Intelligent Adaptive Edge Caching using Deep Reinforcement Learning

Deep Reinforcement Learning for Mobile Edge Caching: Review, New Features, and Open Issues

Transient Data Caching Based on Maximum Entropy Actor–Critic in Internet-of-Things Networks

Energy Minimization in D2D-Assisted Cache-Enabled Internet of Things: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning Approaches for Content Caching in Cache-Enabled D2D Networks

Asynchronous Federated and Reinforcement Learning for Mobility-Aware Edge Caching in IoV

Federated Deep Reinforcement Learning for Internet of Things with Decentralized Cooperative Edge Caching.

Deep Reinforcement Learning-Based Traffic Engineering in Cloud-Edge-End Collaboration Environments

Mobility Prediction-Based Wireless Edge Caching Using Deep Reinforcement Learning

Deep Reinforcement Learning for Cooperative Edge Caching in Future Mobile Networks.

Deep Reinforcement Learning-Based Resource Allocation for Content Distribution in IoT-Edge-Cloud Computing Environments

Deep Reinforcement Learning-based Edge Caching and Multi-link Cooperative Communication in Internet-of-Vehicles

Content-centric Caching Using Deep Reinforcement Learning in Mobile Computing

Deep reinforcement learning for IoT cache updating based on age of incorrect information

Deep Reinforcement Learning-based Joint Caching and Computing Edge Service Placement for Sensing-Data-Driven IIoT Applications

A Transferable Edge Caching Method Based On Reinforcement Learning for Dense Small Cell Network