Abstract:With the popularity of smart devices and the growth of high-bandwidth applications, the wireless industry is facing an increased surge in data traffic. This challenge highlights the limitations of traditional edge-caching solutions, especially in terms of content-caching effectiveness and network-communication latency. To address this problem, we investigated efficient caching strategies in heterogeneous network environments. The caching decision process becomes more complex due to the heterogeneity of the network environment, as well as due to the diversity of user behaviors and content requests. To address the problem of increased system latency due to the dynamically changing nature of content popularity and limited cache capacity, we propose a novel content placement strategy, the long-short-term-memory–content-population-prediction model, to capture the correlation of request patterns between different contents and the periodicity in the time domain, in order to improve the accuracy of the prediction of content popularity. Then, to address the heterogeneity of heterogeneous network environments, we propose an efficient content delivery strategy: the multi-intelligent critical collaborative caching policy. This strategy models the edge-caching problem in heterogeneous scenarios as a Markov decision process using multi-base-station-environment information. In order to fully utilize the multi-intelligence information, we have improved the actor–critic approach by integrating the attention mechanism into a neural network. Whereas the actor network is responsible for making decisions based on local information, the critic network evaluates and enhances the actor's performance. We conducted extensive simulations, and the results showed that the Long Short Term Memory content population prediction model was more advantageous, in terms of content-popularity-prediction accuracy, with a 28.61% improvement in prediction error, compared to several other existing methods. The proposed multi-intelligence actor–critic collaborative caching policy algorithm improved the cache-hit-rate metric by up to 32.3% and reduced the system latency by 1.6%, demonstrating the feasibility and effectiveness of the algorithm.

Deep Reinforcement Learning Approaches for Content Caching in Cache-Enabled D2D Networks

Optimal D2d Cooperative Caching System In Sdn Based Wireless Network

Deep Reinforcement Learning for Cooperative Coded Caching Strategy in Fog Radio Access Network

Crowdcaching: Incentivizing D2D-Enabled Caching Via Coalitional Game for IoT

A Deep Reinforcement Learning-Based Caching Strategy for IoT Networks With Transient Data

How to Cache Important Contents for Multi-modal Service in Dynamic Networks: A DRL-based Caching Scheme

Deep Reinforcement Learning for Adaptive Caching in Hierarchical Content Delivery Networks

A Deep Reinforcement Learning Approach for Dynamic Contents Caching in HetNets

MECC: A Mobile Edge Collaborative Caching Framework Empowered by Deep Reinforcement Learning

Delay-Aware Cache-Enabled Cooperative D2D Transmission in Mobile Cellular Networks

Towards Intelligent Adaptive Edge Caching using Deep Reinforcement Learning

Dynamic Content Update for Wireless Edge Caching via Deep Reinforcement Learning

Cooperative Caching and Fetching in D2D Communications - A Fully Decentralized Multi-Agent Reinforcement Learning Approach

Combining Lyapunov Optimization and Deep Reinforcement Learning for D2D Assisted Heterogeneous Collaborative Edge Caching

Distributed Caching in Converged Networks: A Deep Reinforcement Learning Approach

Dynamic Content Caching Based on Actor-Critic Reinforcement Learning for IoT Systems.

Social Aware Edge Caching in D2D Enabled Communication

Enhancing Heterogeneous Network Performance: Advanced Content Popularity Prediction and Efficient Caching

Incentive-Driven Deep Reinforcement Learning for Content Caching and D2D Offloading

Caching on the Move: A User Interest-Driven Caching Strategy for D2D Content Sharing