Abstract:Internet of Things (IoT) technology suffers from the challenge that rare wireless network resources are difficult to meet the influx of a huge number of terminal devices. Cache-enabled device-to-device (D2D) communication technology is expected to relieve network pressure with the fact that the requesting contents can be easily obtained from nearby users. However, how to design an effective caching policy becomes very challenging due to the limited content storage capacity and the uncertainty of user mobility pattern. In this article, we study the jointly cache content placement and delivery policy for the cache-enabled D2D networks. Specifically, two potential recurrent neural network approaches [the echo state network (ESN) and the long short-term memory (LSTM) network] are employed to predict users' mobility and content popularity, so as to determine which content to cache and where to cache. When the local cache of the user cannot satisfy its own request, the user may consider establishing a D2D link with the neighboring user to implement the content delivery. In order to decide which user will be selected to establish the D2D link, we propose the novel schemes based on deep reinforcement learning to implement the dynamic decision making and optimization of the content delivery problems, aiming at improving the quality of experience of overall caching system. The simulation results suggest that the cache hit ratio of the system can be well improved by the proposed content placement strategy, and the proposed content delivery approaches can effectively reduce the request content delivery delay and energy consumption.

Reinforcement Learning Based Content Push Policy for HetNets with Energy Harvesting Small Cells.

Proactive push with energy harvesting based small cells in heterogeneous networks

Joint Optimization of Content Caching and Push in Renewable Energy Powered Small Cells.

Deep Reinforcement Learning-Assisted Energy Harvesting Wireless Networks

Policy Optimization for Content Push via Energy Harvesting Small Cells in Heterogeneous Networks

Proactive Content Push in Heterogeneous Networks with Multiple Energy Harvesting Small Cells

Dynamic Content Update for Wireless Edge Caching via Deep Reinforcement Learning

Reinforcement Learning-Based Optimal Computing and Caching in Mobile Edge Network

Q-Learning Based Selection Strategies for Load Balance and Energy Balance in Heterogeneous Networks

Reinforcement Learning based Multi-Access Control and Battery Prediction with Energy Harvesting in IoT Systems

DRAG: Deep Reinforcement Learning Based Base Station Activation in Heterogeneous Networks

GreenDelivery: Proactive Content Caching and Push with Energy-Harvesting-based Small Cells

BESS Aided Reconfigurable Energy Supply using Deep Reinforcement Learning for 5G and Beyond

Q-Learning-Based Adaptive Power Control in Wireless RF Energy Harvesting Heterogeneous Networks

Distributed Cache Replacement for Caching-Enable Base Stations in Cellular Networks.

GCD Optimization and Intelligent Management for Green Base Station with Battery Control

Green Resource Allocation and Energy Management in Heterogeneous Small Cell Networks Powered by Hybrid Energy

Energy Saving Through a Learning Framework in Greener Cellular Radio Access Networks.

Reinforcement Learning (RL)-Based Energy Efficient Resource Allocation for Energy Harvesting-Powered Wireless Body Area Network

Deep Reinforcement Learning for Network Energy Saving in 6G and Beyond Networks

Deep Reinforcement Learning Approaches for Content Caching in Cache-Enabled D2D Networks